[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:24:53.809417 20917 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.109.126:36513
I20260709 12:24:53.811198 20917 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:24:53.812366 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:53.831259 20923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:53.831288 20926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:53.831575 20924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:53.832473 20917 server_base.cc:1061] running on GCE node
I20260709 12:24:54.949954 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:54.950217 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:54.950414 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599894950393 us; error 0 us; skew 500 ppm
I20260709 12:24:54.951287 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:54.956709 20917 webserver.cc:533] Webserver started at http://127.20.109.126:33077/ using document root <none> and password file <none>
I20260709 12:24:54.957581 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:54.957787 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:54.958253 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:54.964175 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/master-0-root/instance:
uuid: "3c81487201424eb88e9d00ac87818c40"
format_stamp: "Formatted at 2026-07-09 12:24:54 on dist-test-slave-sc4p"
I20260709 12:24:54.972496 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:24:54.978376 20932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:54.979938 20917 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:24:54.980317 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/master-0-root
uuid: "3c81487201424eb88e9d00ac87818c40"
format_stamp: "Formatted at 2026-07-09 12:24:54 on dist-test-slave-sc4p"
I20260709 12:24:54.980669 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.030287 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.031955 20917 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:24:55.032426 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.101778 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.126:36513
I20260709 12:24:55.101850 20983 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.126:36513 every 8 connection(s)
I20260709 12:24:55.109479 20984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:55.131404 20984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40: Bootstrap starting.
I20260709 12:24:55.137095 20984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:55.138964 20984 log.cc:826] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40: Log is configured to *not* fsync() on all Append() calls
I20260709 12:24:55.143625 20984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40: No bootstrap required, opened a new log
I20260709 12:24:55.164878 20984 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c81487201424eb88e9d00ac87818c40" member_type: VOTER }
I20260709 12:24:55.165452 20984 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:55.165720 20984 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c81487201424eb88e9d00ac87818c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.166685 20984 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c81487201424eb88e9d00ac87818c40" member_type: VOTER }
I20260709 12:24:55.167203 20984 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:55.167498 20984 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:55.167835 20984 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.172138 20984 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c81487201424eb88e9d00ac87818c40" member_type: VOTER }
I20260709 12:24:55.172907 20984 leader_election.cc:304] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c81487201424eb88e9d00ac87818c40; no voters: 
I20260709 12:24:55.174664 20984 leader_election.cc:290] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:55.175019 20987 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:55.177407 20987 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 1 LEADER]: Becoming Leader. State: Replica: 3c81487201424eb88e9d00ac87818c40, State: Running, Role: LEADER
I20260709 12:24:55.178326 20987 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c81487201424eb88e9d00ac87818c40" member_type: VOTER }
I20260709 12:24:55.179459 20984 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:55.189095 20989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c81487201424eb88e9d00ac87818c40. Latest consensus state: current_term: 1 leader_uuid: "3c81487201424eb88e9d00ac87818c40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c81487201424eb88e9d00ac87818c40" member_type: VOTER } }
I20260709 12:24:55.189584 20988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c81487201424eb88e9d00ac87818c40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c81487201424eb88e9d00ac87818c40" member_type: VOTER } }
I20260709 12:24:55.189886 20989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:55.190230 20988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:55.192610 20997 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:55.203929 20997 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:55.206239 20917 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:55.219821 20997 catalog_manager.cc:1383] Generated new cluster ID: 2cc0b5a35d46434a9dd176313a9b0208
I20260709 12:24:55.220162 20997 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:55.239792 20997 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:55.241917 20997 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:55.255692 20997 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40: Generated new TSK 0
I20260709 12:24:55.256633 20997 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:55.272884 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:55.281919 21006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.283227 21007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.286943 21009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.287254 20917 server_base.cc:1061] running on GCE node
I20260709 12:24:55.289299 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:55.289523 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:55.289703 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599895289683 us; error 0 us; skew 500 ppm
I20260709 12:24:55.290325 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:55.294580 20917 webserver.cc:533] Webserver started at http://127.20.109.65:36103/ using document root <none> and password file <none>
I20260709 12:24:55.295178 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:55.295367 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:55.295650 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:55.296797 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-0-root/instance:
uuid: "31dd8def025b475b868a4b286862f2cc"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-sc4p"
I20260709 12:24:55.303226 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:24:55.307940 21014 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.308919 20917 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:24:55.309294 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "31dd8def025b475b868a4b286862f2cc"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-sc4p"
I20260709 12:24:55.309713 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.346554 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.348412 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.351246 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:55.356751 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:55.357456 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 12:24:55.357873 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:55.358122 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.450778 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:39629
I20260709 12:24:55.450847 21076 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:39629 every 8 connection(s)
I20260709 12:24:55.458892 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:55.468477 21081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.472434 21082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.482334 21084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.482899 20917 server_base.cc:1061] running on GCE node
I20260709 12:24:55.483906 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:55.484171 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:55.484385 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599895484365 us; error 0 us; skew 500 ppm
I20260709 12:24:55.485221 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:55.487737 21077 heartbeater.cc:344] Connected to a master server at 127.20.109.126:36513
I20260709 12:24:55.488227 21077 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:55.488592 20917 webserver.cc:533] Webserver started at http://127.20.109.66:40893/ using document root <none> and password file <none>
I20260709 12:24:55.489100 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:55.489292 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:55.489400 21077 heartbeater.cc:507] Master 127.20.109.126:36513 requested a full tablet report, sending...
I20260709 12:24:55.489557 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:55.491518 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-1-root/instance:
uuid: "fff39eb7549447108eae058730f25943"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-sc4p"
I20260709 12:24:55.493072 20949 ts_manager.cc:194] Registered new tserver with Master: 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629)
I20260709 12:24:55.496059 20949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32818
I20260709 12:24:55.497094 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:24:55.502138 21089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.502952 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:24:55.503216 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-1-root
uuid: "fff39eb7549447108eae058730f25943"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-sc4p"
I20260709 12:24:55.503464 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.534825 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.536098 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.539626 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:55.542979 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:55.543200 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.543452 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:55.543602 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.642988 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.66:37495
I20260709 12:24:55.643121 21151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.66:37495 every 8 connection(s)
I20260709 12:24:55.649480 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 12:24:55.666939 21152 heartbeater.cc:344] Connected to a master server at 127.20.109.126:36513
I20260709 12:24:55.667573 21152 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:55.668824 21152 heartbeater.cc:507] Master 127.20.109.126:36513 requested a full tablet report, sending...
W20260709 12:24:55.670063 21156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.672403 20949 ts_manager.cc:194] Registered new tserver with Master: fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
W20260709 12:24:55.673580 21157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.674615 20949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32822
I20260709 12:24:55.677807 20917 server_base.cc:1061] running on GCE node
W20260709 12:24:55.678843 21159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.679709 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:55.679903 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:55.680070 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599895680054 us; error 0 us; skew 500 ppm
I20260709 12:24:55.680625 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:55.683432 20917 webserver.cc:533] Webserver started at http://127.20.109.67:38505/ using document root <none> and password file <none>
I20260709 12:24:55.683947 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:55.684129 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:55.684401 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:55.685520 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-2-root/instance:
uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-sc4p"
I20260709 12:24:55.690371 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:24:55.693769 21164 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.694561 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:55.694881 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-2-root
uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-sc4p"
I20260709 12:24:55.695152 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893634731-20917-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.718346 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.719612 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.721101 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:55.724085 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:55.724288 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.724541 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:55.724687 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.819828 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.67:33847
I20260709 12:24:55.819921 21226 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.67:33847 every 8 connection(s)
I20260709 12:24:55.838581 21227 heartbeater.cc:344] Connected to a master server at 127.20.109.126:36513
I20260709 12:24:55.838974 21227 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:55.839763 21227 heartbeater.cc:507] Master 127.20.109.126:36513 requested a full tablet report, sending...
I20260709 12:24:55.841750 20949 ts_manager.cc:194] Registered new tserver with Master: c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:55.842046 20917 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014979249s
I20260709 12:24:55.843582 20949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32830
I20260709 12:24:55.897989 20949 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32844:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:55.902130 20949 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:56.016647 21042 tablet_service.cc:1511] Processing CreateTablet for tablet 516e19eea9a54a52919d13a4718f04bc (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:56.018399 21042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516e19eea9a54a52919d13a4718f04bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.028046 21041 tablet_service.cc:1511] Processing CreateTablet for tablet f4c3d489a5d447389a65551240ab7984 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:56.028452 21040 tablet_service.cc:1511] Processing CreateTablet for tablet c685575c2b5e4c2085be4249d35043ae (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:56.029525 21041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c3d489a5d447389a65551240ab7984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.032976 21191 tablet_service.cc:1511] Processing CreateTablet for tablet f4c3d489a5d447389a65551240ab7984 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:56.038959 21040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c685575c2b5e4c2085be4249d35043ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.040274 21190 tablet_service.cc:1511] Processing CreateTablet for tablet c685575c2b5e4c2085be4249d35043ae (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:56.037516 21189 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91c439d9b64002aa5b4bb182da7680 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:56.038617 21039 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91c439d9b64002aa5b4bb182da7680 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:56.040311 21192 tablet_service.cc:1511] Processing CreateTablet for tablet 516e19eea9a54a52919d13a4718f04bc (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:56.045744 21188 tablet_service.cc:1511] Processing CreateTablet for tablet d29079dd9d204e38959cfe6212434892 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:56.058035 21191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c3d489a5d447389a65551240ab7984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.059919 21038 tablet_service.cc:1511] Processing CreateTablet for tablet d29079dd9d204e38959cfe6212434892 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:56.062573 21117 tablet_service.cc:1511] Processing CreateTablet for tablet 516e19eea9a54a52919d13a4718f04bc (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:56.063886 21039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91c439d9b64002aa5b4bb182da7680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.067060 21038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29079dd9d204e38959cfe6212434892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.062528 21115 tablet_service.cc:1511] Processing CreateTablet for tablet c685575c2b5e4c2085be4249d35043ae (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:56.059244 21116 tablet_service.cc:1511] Processing CreateTablet for tablet f4c3d489a5d447389a65551240ab7984 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:56.057384 21037 tablet_service.cc:1511] Processing CreateTablet for tablet a285427964954e32ae723d1a8ab22f8b (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:56.072317 21036 tablet_service.cc:1511] Processing CreateTablet for tablet 6a962003c7b44ca0be045c461ab3cb78 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:56.079339 21037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a285427964954e32ae723d1a8ab22f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.074769 21192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516e19eea9a54a52919d13a4718f04bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.071385 21187 tablet_service.cc:1511] Processing CreateTablet for tablet a285427964954e32ae723d1a8ab22f8b (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:56.082332 21117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516e19eea9a54a52919d13a4718f04bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.075505 21114 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91c439d9b64002aa5b4bb182da7680 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:56.098584 21112 tablet_service.cc:1511] Processing CreateTablet for tablet a285427964954e32ae723d1a8ab22f8b (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:56.099937 21115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c685575c2b5e4c2085be4249d35043ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.090806 21113 tablet_service.cc:1511] Processing CreateTablet for tablet d29079dd9d204e38959cfe6212434892 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:56.099427 21190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c685575c2b5e4c2085be4249d35043ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.119313 21112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a285427964954e32ae723d1a8ab22f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.125342 21187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a285427964954e32ae723d1a8ab22f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.129443 21110 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae4ab20b09a4e6eb1288283f6f84728 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:56.132432 21114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91c439d9b64002aa5b4bb182da7680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.135954 21189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91c439d9b64002aa5b4bb182da7680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.136049 21110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae4ab20b09a4e6eb1288283f6f84728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.134097 21036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a962003c7b44ca0be045c461ab3cb78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.132133 21186 tablet_service.cc:1511] Processing CreateTablet for tablet 6a962003c7b44ca0be045c461ab3cb78 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:56.121560 21035 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae4ab20b09a4e6eb1288283f6f84728 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:56.137956 21111 tablet_service.cc:1511] Processing CreateTablet for tablet 6a962003c7b44ca0be045c461ab3cb78 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:56.145752 21035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae4ab20b09a4e6eb1288283f6f84728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.144222 21188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29079dd9d204e38959cfe6212434892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.160738 21185 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae4ab20b09a4e6eb1288283f6f84728 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:56.159284 21116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c3d489a5d447389a65551240ab7984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.168941 21113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29079dd9d204e38959cfe6212434892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.169807 21186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a962003c7b44ca0be045c461ab3cb78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.180987 21185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae4ab20b09a4e6eb1288283f6f84728. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:56.220328 20996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:56.220312 21042 tablet_service.cc:1511] Processing CreateTablet for tablet e80d36bc4f4e425188ba309540bfe285 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:56.221791 21042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80d36bc4f4e425188ba309540bfe285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.224275 21111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a962003c7b44ca0be045c461ab3cb78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.272233 21245 tablet_bootstrap.cc:492] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:56.320570 21109 tablet_service.cc:1511] Processing CreateTablet for tablet e80d36bc4f4e425188ba309540bfe285 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:56.325171 21109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80d36bc4f4e425188ba309540bfe285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.358095 21247 tablet_bootstrap.cc:492] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:56.371388 21246 tablet_bootstrap.cc:492] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943: Bootstrap starting.
I20260709 12:24:56.379256 21192 tablet_service.cc:1511] Processing CreateTablet for tablet e80d36bc4f4e425188ba309540bfe285 (DEFAULT_TABLE table=test-workload [id=e8ef7e1e60664b04b742775ac7317443]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:56.380635 21192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80d36bc4f4e425188ba309540bfe285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.393546 21247 tablet_bootstrap.cc:654] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.404888 21246 tablet_bootstrap.cc:654] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.411491 21245 tablet_bootstrap.cc:654] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.435034 21247 tablet_bootstrap.cc:492] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:56.435356 21246 tablet_bootstrap.cc:492] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:56.435647 21247 ts_tablet_manager.cc:1403] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.009s
I20260709 12:24:56.435755 21246 ts_tablet_manager.cc:1403] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.004s
I20260709 12:24:56.442780 21246 raft_consensus.cc:359] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.445569 21247 raft_consensus.cc:359] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.450780 21247 raft_consensus.cc:385] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.451139 21247 raft_consensus.cc:740] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.446712 21246 raft_consensus.cc:385] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.452358 21247 consensus_queue.cc:260] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.452000 21246 raft_consensus.cc:740] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.455863 21247 ts_tablet_manager.cc:1434] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:24:56.456116 21245 tablet_bootstrap.cc:492] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
I20260709 12:24:56.455876 21246 consensus_queue.cc:260] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.456602 21245 ts_tablet_manager.cc:1403] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.231s	user 0.013s	sys 0.011s
I20260709 12:24:56.456805 21227 heartbeater.cc:499] Master 127.20.109.126:36513 was elected leader, sending a full tablet report...
I20260709 12:24:56.457098 21247 tablet_bootstrap.cc:492] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:56.465945 21245 raft_consensus.cc:359] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.466871 21245 raft_consensus.cc:385] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.467177 21245 raft_consensus.cc:740] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.467993 21245 consensus_queue.cc:260] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.471765 21247 tablet_bootstrap.cc:654] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.478382 21152 heartbeater.cc:499] Master 127.20.109.126:36513 was elected leader, sending a full tablet report...
I20260709 12:24:56.479166 21077 heartbeater.cc:499] Master 127.20.109.126:36513 was elected leader, sending a full tablet report...
I20260709 12:24:56.482112 21246 ts_tablet_manager.cc:1434] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:24:56.483098 21246 tablet_bootstrap.cc:492] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943: Bootstrap starting.
I20260709 12:24:56.486546 21247 tablet_bootstrap.cc:492] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:56.487103 21247 ts_tablet_manager.cc:1403] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.002s
I20260709 12:24:56.489645 21246 tablet_bootstrap.cc:654] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.489877 21247 raft_consensus.cc:359] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.490573 21247 raft_consensus.cc:385] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.490881 21247 raft_consensus.cc:740] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.491395 21245 ts_tablet_manager.cc:1434] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:24:56.491700 21247 consensus_queue.cc:260] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.492357 21245 tablet_bootstrap.cc:492] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:56.494051 21247 ts_tablet_manager.cc:1434] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:24:56.495048 21247 tablet_bootstrap.cc:492] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:56.499430 21245 tablet_bootstrap.cc:654] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.500996 21247 tablet_bootstrap.cc:654] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.508885 21252 raft_consensus.cc:493] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.509398 21252 raft_consensus.cc:515] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.513572 21252 leader_election.cc:290] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:56.518374 21246 tablet_bootstrap.cc:492] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:56.518896 21246 ts_tablet_manager.cc:1403] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.002s
I20260709 12:24:56.521668 21246 raft_consensus.cc:359] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.522372 21246 raft_consensus.cc:385] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.537798 21246 raft_consensus.cc:740] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.538739 21246 consensus_queue.cc:260] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.546648 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:56.547206 21246 ts_tablet_manager.cc:1434] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 12:24:56.547528 21202 raft_consensus.cc:2468] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 0.
I20260709 12:24:56.549039 21246 tablet_bootstrap.cc:492] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943: Bootstrap starting.
I20260709 12:24:56.549546 21092 leader_election.cc:304] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:56.550356 21252 raft_consensus.cc:2804] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.550774 21252 raft_consensus.cc:493] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.551126 21252 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.558187 21252 raft_consensus.cc:515] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.560405 21252 leader_election.cc:290] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:56.561484 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:56.562077 21202 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.569499 21245 tablet_bootstrap.cc:492] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
I20260709 12:24:56.570132 21245 ts_tablet_manager.cc:1403] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.013s
I20260709 12:24:56.570974 21246 tablet_bootstrap.cc:654] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.572580 21051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:56.572512 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:56.573697 21051 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.572072 21202 raft_consensus.cc:2468] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 1.
I20260709 12:24:56.577198 21245 raft_consensus.cc:359] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.577958 21245 raft_consensus.cc:385] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.579247 21092 leader_election.cc:304] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:56.578258 21245 raft_consensus.cc:740] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
W20260709 12:24:56.579952 21228 tablet.cc:2406] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:56.580129 21252 raft_consensus.cc:2804] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.580865 21245 consensus_queue.cc:260] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.581892 21247 tablet_bootstrap.cc:492] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:56.582325 21247 ts_tablet_manager.cc:1403] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.088s	user 0.024s	sys 0.027s
I20260709 12:24:56.585106 21051 raft_consensus.cc:2468] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 1.
I20260709 12:24:56.588069 21245 ts_tablet_manager.cc:1434] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:24:56.589074 21245 tablet_bootstrap.cc:492] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:56.590498 21246 tablet_bootstrap.cc:492] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:56.591017 21246 ts_tablet_manager.cc:1403] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.042s	user 0.003s	sys 0.009s
I20260709 12:24:56.585157 21247 raft_consensus.cc:359] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.594727 21247 raft_consensus.cc:385] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.595067 21247 raft_consensus.cc:740] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.595325 21252 raft_consensus.cc:697] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:56.594180 21246 raft_consensus.cc:359] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.595530 21245 tablet_bootstrap.cc:654] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.595845 21247 consensus_queue.cc:260] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.596314 21246 raft_consensus.cc:385] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.596189 21252 consensus_queue.cc:237] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.597112 21246 raft_consensus.cc:740] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.597873 21246 consensus_queue.cc:260] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.599968 21246 ts_tablet_manager.cc:1434] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:24:56.601157 21246 tablet_bootstrap.cc:492] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943: Bootstrap starting.
I20260709 12:24:56.605353 21247 ts_tablet_manager.cc:1434] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:24:56.610613 21246 tablet_bootstrap.cc:654] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.613458 21247 tablet_bootstrap.cc:492] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:56.617241 20947 catalog_manager.cc:5697] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 0 to 1, leader changed from <none> to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.620734 21247 tablet_bootstrap.cc:654] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.623530 21245 tablet_bootstrap.cc:492] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
I20260709 12:24:56.624019 21245 ts_tablet_manager.cc:1403] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.007s
I20260709 12:24:56.624514 21246 tablet_bootstrap.cc:492] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:56.625006 21246 ts_tablet_manager.cc:1403] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 12:24:56.626897 21245 raft_consensus.cc:359] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.627697 21245 raft_consensus.cc:385] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.628008 21245 raft_consensus.cc:740] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.628741 21245 consensus_queue.cc:260] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.628803 21246 raft_consensus.cc:359] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.629997 21246 raft_consensus.cc:385] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.630350 21246 raft_consensus.cc:740] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.630875 21245 ts_tablet_manager.cc:1434] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:24:56.631178 21246 consensus_queue.cc:260] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.631975 21245 tablet_bootstrap.cc:492] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:56.633731 21246 ts_tablet_manager.cc:1434] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:56.634800 21246 tablet_bootstrap.cc:492] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943: Bootstrap starting.
I20260709 12:24:56.639870 21245 tablet_bootstrap.cc:654] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.642877 21246 tablet_bootstrap.cc:654] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.669786 21247 tablet_bootstrap.cc:492] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:56.670274 21247 ts_tablet_manager.cc:1403] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.004s
I20260709 12:24:56.673388 21247 raft_consensus.cc:359] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.674122 21247 raft_consensus.cc:385] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.679335 21247 raft_consensus.cc:740] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.680018 21247 consensus_queue.cc:260] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.685768 21245 tablet_bootstrap.cc:492] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
I20260709 12:24:56.686278 21245 ts_tablet_manager.cc:1403] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.019s
I20260709 12:24:56.687429 21246 tablet_bootstrap.cc:492] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:56.687930 21246 ts_tablet_manager.cc:1403] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.024s
I20260709 12:24:56.689142 21245 raft_consensus.cc:359] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.689867 21245 raft_consensus.cc:385] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.690160 21245 raft_consensus.cc:740] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.690927 21246 raft_consensus.cc:359] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.691740 21246 raft_consensus.cc:385] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.691957 21247 ts_tablet_manager.cc:1434] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:24:56.692104 21246 raft_consensus.cc:740] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.693100 21247 tablet_bootstrap.cc:492] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:56.692958 21246 consensus_queue.cc:260] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.695307 21246 ts_tablet_manager.cc:1434] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:56.696426 21246 tablet_bootstrap.cc:492] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943: Bootstrap starting.
I20260709 12:24:56.697182 21245 consensus_queue.cc:260] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.703171 21247 tablet_bootstrap.cc:654] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.703670 21251 raft_consensus.cc:493] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.704182 21251 raft_consensus.cc:515] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.706063 21245 ts_tablet_manager.cc:1434] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:24:56.707916 21251 leader_election.cc:290] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:24:56.714432 21245 tablet_bootstrap.cc:492] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:56.725489 21247 tablet_bootstrap.cc:492] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:56.726504 21247 ts_tablet_manager.cc:1403] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.007s
I20260709 12:24:56.729780 21247 raft_consensus.cc:359] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.730638 21247 raft_consensus.cc:385] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.730978 21247 raft_consensus.cc:740] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.731879 21247 consensus_queue.cc:260] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.732996 21246 tablet_bootstrap.cc:654] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.734509 21247 ts_tablet_manager.cc:1434] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:24:56.735651 21247 tablet_bootstrap.cc:492] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:56.734278 21245 tablet_bootstrap.cc:654] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.742184 21247 tablet_bootstrap.cc:654] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.749009 21251 raft_consensus.cc:493] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.749611 21251 raft_consensus.cc:515] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.751808 21251 leader_election.cc:290] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:24:56.754383 21051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:56.755460 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
I20260709 12:24:56.755887 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:56.756783 21052 raft_consensus.cc:2468] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 0.
I20260709 12:24:56.764808 21126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
W20260709 12:24:56.766674 21168 leader_election.cc:343] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.767303 21245 tablet_bootstrap.cc:492] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
W20260709 12:24:56.767413 21168 leader_election.cc:343] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fff39eb7549447108eae058730f25943 (127.20.109.66:37495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.766180 21126 raft_consensus.cc:2468] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 0.
I20260709 12:24:56.767803 21245 ts_tablet_manager.cc:1403] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.010s
I20260709 12:24:56.768285 21247 tablet_bootstrap.cc:492] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:56.767810 21168 leader_election.cc:304] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943
I20260709 12:24:56.768723 21247 ts_tablet_manager.cc:1403] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.012s
I20260709 12:24:56.769254 21251 raft_consensus.cc:2749] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:56.769690 21168 leader_election.cc:304] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:24:56.770357 21251 raft_consensus.cc:2804] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.770741 21251 raft_consensus.cc:493] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.771091 21251 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.771320 21245 raft_consensus.cc:359] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.772114 21245 raft_consensus.cc:385] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.772498 21245 raft_consensus.cc:740] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.772969 21246 tablet_bootstrap.cc:492] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:56.773494 21246 ts_tablet_manager.cc:1403] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.004s
I20260709 12:24:56.773396 21245 consensus_queue.cc:260] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.776096 21245 ts_tablet_manager.cc:1434] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:56.777107 21245 tablet_bootstrap.cc:492] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:56.778208 21251 raft_consensus.cc:515] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.780419 21251 leader_election.cc:290] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:24:56.783919 21245 tablet_bootstrap.cc:654] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.798776 21246 raft_consensus.cc:359] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.783675 21247 raft_consensus.cc:359] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.803222 21246 raft_consensus.cc:385] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.784530 21252 raft_consensus.cc:493] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.803637 21246 raft_consensus.cc:740] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.803861 21252 raft_consensus.cc:515] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.786464 21126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:24:56.804790 21246 consensus_queue.cc:260] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.785442 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:56.803336 21247 raft_consensus.cc:385] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.807420 21051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:56.811954 21247 raft_consensus.cc:740] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.808272 21252 leader_election.cc:290] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:56.805405 21126 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.809333 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:56.805826 21052 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.810945 21246 ts_tablet_manager.cc:1434] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:24:56.835932 21246 tablet_bootstrap.cc:492] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943: Bootstrap starting.
W20260709 12:24:56.836481 21092 leader_election.cc:343] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.838660 21247 consensus_queue.cc:260] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.840052 21051 raft_consensus.cc:2468] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 0.
I20260709 12:24:56.841912 21093 leader_election.cc:304] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: c58f06aa8f5b41fbbe33dc27d8fe269b
I20260709 12:24:56.843194 21261 raft_consensus.cc:493] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.843854 21245 tablet_bootstrap.cc:492] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
I20260709 12:24:56.843667 21261 raft_consensus.cc:515] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.844921 21252 raft_consensus.cc:2804] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.846005 21261 leader_election.cc:290] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:56.844295 21245 ts_tablet_manager.cc:1403] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.003s
I20260709 12:24:56.847322 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:56.851689 21252 raft_consensus.cc:493] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.847083 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:56.853385 21252 raft_consensus.cc:3060] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:56.854038 21093 leader_election.cc:343] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.854241 21247 ts_tablet_manager.cc:1434] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.085s	user 0.023s	sys 0.020s
I20260709 12:24:56.854792 21202 raft_consensus.cc:2468] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 0.
I20260709 12:24:56.855659 21251 raft_consensus.cc:493] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.856098 21251 raft_consensus.cc:515] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.856350 21092 leader_election.cc:304] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 31dd8def025b475b868a4b286862f2cc
I20260709 12:24:56.854239 21126 raft_consensus.cc:2468] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 1.
I20260709 12:24:56.858034 21251 leader_election.cc:290] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:24:56.858489 21168 leader_election.cc:304] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:56.858733 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29079dd9d204e38959cfe6212434892" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:56.858964 21261 raft_consensus.cc:2804] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.859409 21261 raft_consensus.cc:493] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.858944 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29079dd9d204e38959cfe6212434892" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
I20260709 12:24:56.859905 21251 raft_consensus.cc:2804] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.860203 21247 tablet_bootstrap.cc:492] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:56.859341 21050 raft_consensus.cc:2468] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 0.
I20260709 12:24:56.860149 21261 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.861001 21127 raft_consensus.cc:2468] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 0.
I20260709 12:24:56.864441 21168 leader_election.cc:304] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:24:56.864111 21052 raft_consensus.cc:2468] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 1.
I20260709 12:24:56.872653 21252 raft_consensus.cc:515] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.882887 21246 tablet_bootstrap.cc:654] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.883983 21245 raft_consensus.cc:359] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.886302 21245 raft_consensus.cc:385] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.889599 21245 raft_consensus.cc:740] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.890776 21251 raft_consensus.cc:697] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Becoming Leader. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:24:56.891301 21261 raft_consensus.cc:515] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.893184 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:56.892913 21245 consensus_queue.cc:260] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.894052 21052 raft_consensus.cc:3060] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.894644 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:56.895915 21245 ts_tablet_manager.cc:1434] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
W20260709 12:24:56.897120 21092 leader_election.cc:343] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.892505 21281 raft_consensus.cc:2804] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.898931 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:56.893311 21252 leader_election.cc:290] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:56.900085 21245 tablet_bootstrap.cc:492] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:56.901741 21251 consensus_queue.cc:237] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.902680 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:56.903669 21202 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.900880 21261 leader_election.cc:290] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
W20260709 12:24:56.904935 21093 leader_election.cc:343] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.902688 21281 raft_consensus.cc:493] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.908165 21281 raft_consensus.cc:3060] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.912052 21052 raft_consensus.cc:2468] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 1.
I20260709 12:24:56.913324 21247 tablet_bootstrap.cc:654] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.914892 21093 leader_election.cc:304] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: c58f06aa8f5b41fbbe33dc27d8fe269b
I20260709 12:24:56.916481 21261 raft_consensus.cc:2804] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.916649 21246 tablet_bootstrap.cc:492] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:56.916988 21261 raft_consensus.cc:697] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:56.917167 21246 ts_tablet_manager.cc:1403] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.010s
I20260709 12:24:56.918123 21261 consensus_queue.cc:237] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.920147 21202 raft_consensus.cc:2468] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 1.
I20260709 12:24:56.922833 21092 leader_election.cc:304] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 31dd8def025b475b868a4b286862f2cc
I20260709 12:24:56.924052 21252 raft_consensus.cc:2804] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.927094 21245 tablet_bootstrap.cc:654] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.934928 21251 raft_consensus.cc:493] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.937542 21252 raft_consensus.cc:697] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:56.940868 21252 consensus_queue.cc:237] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.938338 21251 raft_consensus.cc:515] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.944331 20948 catalog_manager.cc:5697] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b reported cstate change: term changed from 0 to 1, leader changed from <none> to c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67). New cstate: current_term: 1 leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.950901 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
I20260709 12:24:56.951427 20949 catalog_manager.cc:5697] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 0 to 1, leader changed from <none> to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.952497 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
W20260709 12:24:56.952898 21168 leader_election.cc:343] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fff39eb7549447108eae058730f25943 (127.20.109.66:37495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.949400 21251 leader_election.cc:290] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:24:56.954205 21281 raft_consensus.cc:515] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
W20260709 12:24:56.957876 21168 leader_election.cc:343] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.959798 21168 leader_election.cc:304] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943
I20260709 12:24:56.962215 21281 leader_election.cc:290] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:24:56.961256 21251 raft_consensus.cc:2749] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:56.955369 21246 raft_consensus.cc:359] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.966890 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29079dd9d204e38959cfe6212434892" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:56.967574 21052 raft_consensus.cc:3060] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.964352 21246 raft_consensus.cc:385] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.972978 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29079dd9d204e38959cfe6212434892" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:24:56.973609 21246 raft_consensus.cc:740] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.974809 21127 raft_consensus.cc:3060] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.976553 21246 consensus_queue.cc:260] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:56.977862 21247 tablet_bootstrap.cc:492] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:56.978435 21247 ts_tablet_manager.cc:1403] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.123s	user 0.018s	sys 0.001s
I20260709 12:24:56.979578 21246 ts_tablet_manager.cc:1434] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.004s
I20260709 12:24:56.980824 21246 tablet_bootstrap.cc:492] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943: Bootstrap starting.
I20260709 12:24:56.988407 21052 raft_consensus.cc:2468] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 1.
I20260709 12:24:56.996570 21168 leader_election.cc:304] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:24:56.997507 21251 raft_consensus.cc:2804] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.998067 21251 raft_consensus.cc:697] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Becoming Leader. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:24:56.998478 21127 raft_consensus.cc:2468] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 1.
I20260709 12:24:56.999377 21251 consensus_queue.cc:237] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.003710 21245 tablet_bootstrap.cc:492] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
I20260709 12:24:57.006942 21245 ts_tablet_manager.cc:1403] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.016s
I20260709 12:24:57.010499 21245 raft_consensus.cc:359] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.012768 21245 raft_consensus.cc:385] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.013124 21245 raft_consensus.cc:740] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.005756 21247 raft_consensus.cc:359] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.013592 21247 raft_consensus.cc:385] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.013867 21247 raft_consensus.cc:740] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.014674 21247 consensus_queue.cc:260] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.010344 20949 catalog_manager.cc:5697] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 0 to 1, leader changed from <none> to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.017732 21247 ts_tablet_manager.cc:1434] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 12:24:57.018790 21247 tablet_bootstrap.cc:492] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:57.026038 21247 tablet_bootstrap.cc:654] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.027055 21245 consensus_queue.cc:260] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.029850 21245 ts_tablet_manager.cc:1434] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:24:57.030925 21245 tablet_bootstrap.cc:492] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:57.033480 20946 catalog_manager.cc:5697] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b reported cstate change: term changed from 0 to 1, leader changed from <none> to c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67). New cstate: current_term: 1 leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:57.037601 21245 tablet_bootstrap.cc:654] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.050169 21245 tablet_bootstrap.cc:492] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
I20260709 12:24:57.050652 21245 ts_tablet_manager.cc:1403] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:24:57.053306 21246 tablet_bootstrap.cc:654] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.053040 21245 raft_consensus.cc:359] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.053838 21245 raft_consensus.cc:385] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.054127 21245 raft_consensus.cc:740] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.054872 21245 consensus_queue.cc:260] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.057068 21245 ts_tablet_manager.cc:1434] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:57.058030 21245 tablet_bootstrap.cc:492] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc: Bootstrap starting.
I20260709 12:24:57.063561 21245 tablet_bootstrap.cc:654] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.066625 21252 raft_consensus.cc:493] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.067157 21252 raft_consensus.cc:515] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.068943 21245 tablet_bootstrap.cc:492] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc: No bootstrap required, opened a new log
I20260709 12:24:57.069207 21252 leader_election.cc:290] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.069387 21245 ts_tablet_manager.cc:1403] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:57.070446 21284 consensus_queue.cc:1048] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:57.070978 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:57.071573 21202 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 0.
I20260709 12:24:57.072379 21246 tablet_bootstrap.cc:492] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:57.072763 21092 leader_election.cc:304] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.072993 21246 ts_tablet_manager.cc:1403] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.004s
I20260709 12:24:57.073678 21284 raft_consensus.cc:2804] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:57.074043 21284 raft_consensus.cc:493] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.074371 21284 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.075299 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:57.075897 21052 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 0.
I20260709 12:24:57.084024 21246 raft_consensus.cc:359] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.086354 21246 raft_consensus.cc:385] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.086767 21246 raft_consensus.cc:740] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.087066 21245 raft_consensus.cc:359] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.087714 21245 raft_consensus.cc:385] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.088100 21245 raft_consensus.cc:740] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.087725 21246 consensus_queue.cc:260] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.086848 21247 tablet_bootstrap.cc:492] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:57.090695 21247 ts_tablet_manager.cc:1403] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.028s
I20260709 12:24:57.091636 21246 ts_tablet_manager.cc:1434] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:24:57.085647 21284 raft_consensus.cc:515] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.092649 21246 tablet_bootstrap.cc:492] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943: Bootstrap starting.
I20260709 12:24:57.093724 21284 leader_election.cc:290] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.094825 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:57.095363 21052 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.095398 21247 raft_consensus.cc:359] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.096127 21247 raft_consensus.cc:385] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.089793 21245 consensus_queue.cc:260] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.096390 21247 raft_consensus.cc:740] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.097081 21247 consensus_queue.cc:260] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.098419 21245 ts_tablet_manager.cc:1434] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:24:57.099068 21247 ts_tablet_manager.cc:1434] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:57.100109 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:57.100462 21247 tablet_bootstrap.cc:492] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b: Bootstrap starting.
I20260709 12:24:57.100678 21202 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.101518 21246 tablet_bootstrap.cc:654] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.106061 21253 raft_consensus.cc:493] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.106644 21253 raft_consensus.cc:515] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.109372 21253 leader_election.cc:290] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.128573 21261 raft_consensus.cc:493] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.129169 21261 raft_consensus.cc:515] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.129463 21052 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 1.
I20260709 12:24:57.131377 21261 leader_election.cc:290] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.131192 21093 leader_election.cc:304] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.131855 21253 raft_consensus.cc:493] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.132815 21253 raft_consensus.cc:515] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.134277 21051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:57.135000 21051 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 0.
I20260709 12:24:57.134981 21253 leader_election.cc:290] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.135258 21261 raft_consensus.cc:2804] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.136188 21247 tablet_bootstrap.cc:654] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.136319 21261 raft_consensus.cc:697] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:57.136363 21093 leader_election.cc:304] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.137279 21252 raft_consensus.cc:2804] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:57.137630 21252 raft_consensus.cc:493] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.137962 21252 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.124336 21202 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 1.
I20260709 12:24:57.144498 21252 raft_consensus.cc:515] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.146925 21261 consensus_queue.cc:237] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.147709 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:57.148330 21052 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.150378 21252 leader_election.cc:290] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.152333 21246 tablet_bootstrap.cc:492] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943: No bootstrap required, opened a new log
I20260709 12:24:57.152226 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:57.152832 21246 ts_tablet_manager.cc:1403] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.021s
I20260709 12:24:57.152935 21201 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.155515 21253 raft_consensus.cc:493] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.156044 21253 raft_consensus.cc:515] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.158159 21253 leader_election.cc:290] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.159758 21246 raft_consensus.cc:359] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.160529 21246 raft_consensus.cc:385] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.160808 21246 raft_consensus.cc:740] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.161597 21246 consensus_queue.cc:260] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.163482 21201 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 1.
I20260709 12:24:57.164084 21246 ts_tablet_manager.cc:1434] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 12:24:57.164731 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:57.165614 21202 raft_consensus.cc:2376] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fff39eb7549447108eae058730f25943 in term 1. Re-sending same reply.
I20260709 12:24:57.165253 20949 catalog_manager.cc:5697] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 0 to 1, leader changed from <none> to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.171355 21092 leader_election.cc:304] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.174376 21261 raft_consensus.cc:2804] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.175279 21261 raft_consensus.cc:697] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:57.176446 21261 consensus_queue.cc:237] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.198772 21052 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 1.
I20260709 12:24:57.199702 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
I20260709 12:24:57.201539 21261 consensus_queue.cc:1048] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.201969 21247 tablet_bootstrap.cc:492] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b: No bootstrap required, opened a new log
I20260709 12:24:57.202375 21247 ts_tablet_manager.cc:1403] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.000s
I20260709 12:24:57.202306 21126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80d36bc4f4e425188ba309540bfe285" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
I20260709 12:24:57.204730 21126 raft_consensus.cc:2468] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 0.
I20260709 12:24:57.210860 21126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
I20260709 12:24:57.213361 21126 raft_consensus.cc:2468] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 0.
I20260709 12:24:57.214622 21247 raft_consensus.cc:359] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.215265 21247 raft_consensus.cc:385] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.215529 21247 raft_consensus.cc:740] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.216172 21247 consensus_queue.cc:260] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.218223 21247 ts_tablet_manager.cc:1434] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.000s
I20260709 12:24:57.219187 21018 leader_election.cc:304] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.219929 21253 raft_consensus.cc:2804] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:57.220156 21018 leader_election.cc:304] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.220299 21253 raft_consensus.cc:493] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.220717 21253 raft_consensus.cc:3060] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.221170 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:57.221966 21201 raft_consensus.cc:2393] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31dd8def025b475b868a4b286862f2cc in current term 1: Already voted for candidate fff39eb7549447108eae058730f25943 in this term.
I20260709 12:24:57.224934 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80d36bc4f4e425188ba309540bfe285" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:57.226750 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:57.228276 21200 raft_consensus.cc:2468] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 0.
W20260709 12:24:57.229849 20996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:57.231051 21201 raft_consensus.cc:2468] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 0.
I20260709 12:24:57.231303 21017 leader_election.cc:304] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc; no voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943
I20260709 12:24:57.234004 21307 raft_consensus.cc:2804] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:57.234795 20949 catalog_manager.cc:5697] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 0 to 1, leader changed from <none> to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.236950 21307 raft_consensus.cc:493] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.237690 21307 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.240710 21306 raft_consensus.cc:2749] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:57.240826 21253 raft_consensus.cc:515] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.244084 21253 leader_election.cc:290] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 election: Requested vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.244336 21126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80d36bc4f4e425188ba309540bfe285" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:24:57.244913 21126 raft_consensus.cc:3060] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.245368 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80d36bc4f4e425188ba309540bfe285" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:57.245903 21201 raft_consensus.cc:3060] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.254581 21201 raft_consensus.cc:2468] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 1.
I20260709 12:24:57.257211 21126 raft_consensus.cc:2468] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 1.
I20260709 12:24:57.258303 21017 leader_election.cc:304] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:24:57.259119 21253 raft_consensus.cc:2804] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.259516 21253 raft_consensus.cc:697] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Becoming Leader. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:24:57.260303 21253 consensus_queue.cc:237] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.260908 21307 raft_consensus.cc:515] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.264793 21126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:24:57.265568 21126 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.266396 21307 leader_election.cc:290] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 election: Requested vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.268030 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:57.268683 21201 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.275451 21126 raft_consensus.cc:2468] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 1.
I20260709 12:24:57.275956 21201 raft_consensus.cc:2468] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 1.
I20260709 12:24:57.277484 21018 leader_election.cc:304] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.278218 21253 raft_consensus.cc:2804] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.278741 21253 raft_consensus.cc:697] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Becoming Leader. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:24:57.279421 21253 consensus_queue.cc:237] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.280520 21251 raft_consensus.cc:493] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.280988 21251 raft_consensus.cc:515] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.282884 21251 leader_election.cc:290] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:24:57.283967 20949 catalog_manager.cc:5697] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 31dd8def025b475b868a4b286862f2cc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "31dd8def025b475b868a4b286862f2cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.288949 21126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
I20260709 12:24:57.290222 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31dd8def025b475b868a4b286862f2cc" is_pre_election: true
I20260709 12:24:57.291039 21052 raft_consensus.cc:2393] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c58f06aa8f5b41fbbe33dc27d8fe269b in current term 1: Already voted for candidate fff39eb7549447108eae058730f25943 in this term.
I20260709 12:24:57.292106 21168 leader_election.cc:304] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943
I20260709 12:24:57.293102 21251 raft_consensus.cc:3060] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.300266 21251 raft_consensus.cc:2749] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:57.300379 20949 catalog_manager.cc:5697] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 31dd8def025b475b868a4b286862f2cc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "31dd8def025b475b868a4b286862f2cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.327610 21251 consensus_queue.cc:1048] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.338075 21281 consensus_queue.cc:1048] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.442953 21304 consensus_queue.cc:1048] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:57.446575 21304 consensus_queue.cc:1048] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:57.465237 21253 raft_consensus.cc:493] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.465808 21253 raft_consensus.cc:515] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.467970 21253 leader_election.cc:290] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.470736 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" is_pre_election: true
I20260709 12:24:57.472350 21126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fff39eb7549447108eae058730f25943" is_pre_election: true
I20260709 12:24:57.473826 21018 leader_election.cc:304] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc; no voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943
I20260709 12:24:57.475375 21253 raft_consensus.cc:2749] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:57.476341 21261 consensus_queue.cc:1048] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.479369 21052 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.492094 21284 consensus_queue.cc:1048] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.500603 21281 consensus_queue.cc:1048] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.553309 21126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:51402
I20260709 12:24:57.554469 21126 raft_consensus.cc:606] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Received request to transfer leadership to TS 31dd8def025b475b868a4b286862f2cc
I20260709 12:24:57.557788 21280 consensus_queue.cc:1048] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:57.566931 21127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:51402
I20260709 12:24:57.567586 21127 raft_consensus.cc:606] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Received request to transfer leadership to TS 31dd8def025b475b868a4b286862f2cc
I20260709 12:24:57.571388 21284 consensus_queue.cc:1048] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.576366 21127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:51402
I20260709 12:24:57.576995 21127 raft_consensus.cc:606] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Received request to transfer leadership to TS 31dd8def025b475b868a4b286862f2cc
I20260709 12:24:57.578569 21284 consensus_queue.cc:1048] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.598814 21201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d29079dd9d204e38959cfe6212434892"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
mode: GRACEFUL
new_leader_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:38544
I20260709 12:24:57.599450 21201 raft_consensus.cc:606] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Received request to transfer leadership to TS fff39eb7549447108eae058730f25943
I20260709 12:24:57.606740 21201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
mode: GRACEFUL
new_leader_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:38544
I20260709 12:24:57.607362 21201 raft_consensus.cc:606] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Received request to transfer leadership to TS fff39eb7549447108eae058730f25943
I20260709 12:24:57.639777 21280 raft_consensus.cc:993] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b: : Instructing follower fff39eb7549447108eae058730f25943 to start an election
I20260709 12:24:57.640225 21280 raft_consensus.cc:1081] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Signalling peer fff39eb7549447108eae058730f25943 to start an election
I20260709 12:24:57.645790 21126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d29079dd9d204e38959cfe6212434892"
dest_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:51384
I20260709 12:24:57.646394 21126 raft_consensus.cc:493] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.646788 21126 raft_consensus.cc:3060] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.652583 21052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e80d36bc4f4e425188ba309540bfe285"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
mode: GRACEFUL
new_leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:45458
I20260709 12:24:57.653203 21052 raft_consensus.cc:606] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Received request to transfer leadership to TS c58f06aa8f5b41fbbe33dc27d8fe269b
I20260709 12:24:57.653517 21126 raft_consensus.cc:515] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.655745 21126 leader_election.cc:290] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 2 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.658448 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29079dd9d204e38959cfe6212434892" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:57.659125 21052 raft_consensus.cc:3060] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.658524 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29079dd9d204e38959cfe6212434892" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:57.659741 21202 raft_consensus.cc:3055] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.659956 21202 raft_consensus.cc:740] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:24:57.660579 21202 consensus_queue.cc:260] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.661593 21202 raft_consensus.cc:3060] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.668260 21202 raft_consensus.cc:2468] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 2.
I20260709 12:24:57.669096 21052 raft_consensus.cc:2468] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 2.
I20260709 12:24:57.669627 21092 leader_election.cc:304] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.670686 21304 raft_consensus.cc:2804] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.671202 21304 raft_consensus.cc:697] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:57.671541 21253 consensus_queue.cc:1048] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.672008 21304 consensus_queue.cc:237] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.681806 21306 raft_consensus.cc:993] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc: : Instructing follower c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:24:57.681054 20946 catalog_manager.cc:5697] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 1 to 2, leader changed from c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67) to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.682245 21306 raft_consensus.cc:1081] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Signalling peer c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:24:57.685088 21201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e80d36bc4f4e425188ba309540bfe285"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:38532
I20260709 12:24:57.685688 21201 raft_consensus.cc:493] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.686061 21201 raft_consensus.cc:3060] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.693403 21201 raft_consensus.cc:515] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.698153 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80d36bc4f4e425188ba309540bfe285" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:24:57.698776 21127 raft_consensus.cc:3060] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.699522 21306 consensus_queue.cc:1048] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.703125 21306 consensus_queue.cc:1048] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.705549 21052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80d36bc4f4e425188ba309540bfe285" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:57.705991 21284 raft_consensus.cc:993] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943: : Instructing follower 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:24:57.706200 21127 raft_consensus.cc:2468] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 2.
I20260709 12:24:57.706971 21201 leader_election.cc:290] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 2 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:24:57.707448 21125 raft_consensus.cc:1240] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Rejecting Update request from peer 31dd8def025b475b868a4b286862f2cc for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:24:57.706465 21202 raft_consensus.cc:1240] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Rejecting Update request from peer 31dd8def025b475b868a4b286862f2cc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:57.706491 21284 raft_consensus.cc:1081] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Signalling peer 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:24:57.706219 21052 raft_consensus.cc:3055] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.709153 21168 leader_election.cc:304] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.710583 21251 raft_consensus.cc:2804] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.711200 21251 raft_consensus.cc:697] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Becoming Leader. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:24:57.712087 21251 consensus_queue.cc:237] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.709793 21052 raft_consensus.cc:740] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:24:57.713359 21050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:45438
I20260709 12:24:57.713469 21306 consensus_queue.cc:1059] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.713985 21050 raft_consensus.cc:493] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.714341 21050 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.715094 21052 consensus_queue.cc:260] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.716602 21052 raft_consensus.cc:3060] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.726475 21052 raft_consensus.cc:2468] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 2.
I20260709 12:24:57.735487 21050 raft_consensus.cc:515] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.737731 21050 leader_election.cc:290] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 2 election: Requested vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.737591 21304 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:57.740845 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:57.742107 21200 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.741315 21253 consensus_queue.cc:1048] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.747139 21125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:24:57.747699 21125 raft_consensus.cc:3055] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.747984 21125 raft_consensus.cc:740] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:57.748704 21125 consensus_queue.cc:260] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.749850 21125 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.750125 21304 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.752617 21200 raft_consensus.cc:2468] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 2.
I20260709 12:24:57.755198 21017 leader_election.cc:304] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:24:57.756011 21306 raft_consensus.cc:2804] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.756454 21306 raft_consensus.cc:697] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Becoming Leader. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:24:57.757230 21306 consensus_queue.cc:237] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.753667 20949 catalog_manager.cc:5697] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b reported cstate change: term changed from 1 to 2, leader changed from 31dd8def025b475b868a4b286862f2cc (127.20.109.65) to c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67). New cstate: current_term: 2 leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:57.767706 21304 raft_consensus.cc:993] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943: : Instructing follower 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:24:57.768111 21304 raft_consensus.cc:1081] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Signalling peer 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:24:57.772368 21051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:45438
I20260709 12:24:57.772900 21051 raft_consensus.cc:493] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.773236 21051 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.780257 20948 catalog_manager.cc:5697] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc reported cstate change: term changed from 1 to 2, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to 31dd8def025b475b868a4b286862f2cc (127.20.109.65). New cstate: current_term: 2 leader_uuid: "31dd8def025b475b868a4b286862f2cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.784431 21125 raft_consensus.cc:2468] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 2.
I20260709 12:24:57.789356 21051 raft_consensus.cc:515] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.791616 21051 leader_election.cc:290] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 2 election: Requested vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.792641 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:57.793228 21200 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.803186 21200 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 2.
I20260709 12:24:57.803814 21202 raft_consensus.cc:1240] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Rejecting Update request from peer fff39eb7549447108eae058730f25943 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:57.804227 21017 leader_election.cc:304] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:24:57.804772 21125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:24:57.805090 21306 raft_consensus.cc:2804] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.805549 21125 raft_consensus.cc:3055] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.805598 21306 raft_consensus.cc:697] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Becoming Leader. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:24:57.806038 21125 raft_consensus.cc:740] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:57.806464 21306 consensus_queue.cc:237] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.806905 21125 consensus_queue.cc:260] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.808025 21125 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.814832 20946 catalog_manager.cc:5697] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc reported cstate change: term changed from 1 to 2, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to 31dd8def025b475b868a4b286862f2cc (127.20.109.65). New cstate: current_term: 2 leader_uuid: "31dd8def025b475b868a4b286862f2cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.815989 21125 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 2.
I20260709 12:24:57.945025 21280 raft_consensus.cc:993] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b: : Instructing follower fff39eb7549447108eae058730f25943 to start an election
I20260709 12:24:57.945511 21281 raft_consensus.cc:1081] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Signalling peer fff39eb7549447108eae058730f25943 to start an election
I20260709 12:24:57.947062 21125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b"
dest_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:51384
I20260709 12:24:57.947638 21125 raft_consensus.cc:493] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.948015 21125 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.954927 21125 raft_consensus.cc:515] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.957160 21125 leader_election.cc:290] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 2 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:57.958077 21051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:24:57.958268 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:57.958813 21051 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.958814 21200 raft_consensus.cc:3055] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.959440 21200 raft_consensus.cc:740] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:24:57.960265 21200 consensus_queue.cc:260] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.961537 21200 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.965930 21051 raft_consensus.cc:2468] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 2.
I20260709 12:24:57.967465 21093 leader_election.cc:304] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:24:57.968364 21284 raft_consensus.cc:2804] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.968372 21200 raft_consensus.cc:2468] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 2.
I20260709 12:24:57.969072 21284 raft_consensus.cc:697] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:57.970041 21284 consensus_queue.cc:237] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.979094 20946 catalog_manager.cc:5697] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 1 to 2, leader changed from c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67) to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.986517 21284 raft_consensus.cc:993] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943: : Instructing follower 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:24:57.987030 21252 raft_consensus.cc:1081] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Signalling peer 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:24:57.988785 21051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:45438
I20260709 12:24:57.989465 21051 raft_consensus.cc:493] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.989881 21051 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.997396 21051 raft_consensus.cc:515] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:57.999658 21051 leader_election.cc:290] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 2 election: Requested vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:24:58.000278 21125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:24:58.000881 21125 raft_consensus.cc:3055] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:58.000974 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:24:58.001231 21125 raft_consensus.cc:740] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:24:58.001526 21200 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.002055 21125 consensus_queue.cc:260] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:58.003245 21125 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.008250 21200 raft_consensus.cc:2468] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 2.
I20260709 12:24:58.009616 21017 leader_election.cc:304] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:24:58.009606 21125 raft_consensus.cc:2468] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 2.
I20260709 12:24:58.010367 21306 raft_consensus.cc:2804] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:58.010923 21306 raft_consensus.cc:697] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Becoming Leader. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:24:58.011960 21306 consensus_queue.cc:237] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:24:58.019186 20946 catalog_manager.cc:5697] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc reported cstate change: term changed from 1 to 2, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to 31dd8def025b475b868a4b286862f2cc (127.20.109.65). New cstate: current_term: 2 leader_uuid: "31dd8def025b475b868a4b286862f2cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.160792 21200 raft_consensus.cc:1275] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.161439 21125 raft_consensus.cc:1275] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.162149 21252 consensus_queue.cc:1048] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.162642 21306 consensus_queue.cc:1048] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.175709 21051 raft_consensus.cc:1275] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.175983 21202 raft_consensus.cc:1275] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.177696 21304 consensus_queue.cc:1048] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.179178 21253 consensus_queue.cc:1048] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.192214 21051 raft_consensus.cc:1275] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.194262 21281 consensus_queue.cc:1048] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.204429 21125 raft_consensus.cc:1275] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.208052 21251 consensus_queue.cc:1048] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:58.248476 21202 raft_consensus.cc:1275] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.249816 21328 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:58.258648 21125 raft_consensus.cc:1275] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.260390 21328 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.434736 21125 raft_consensus.cc:1275] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.436278 21328 consensus_queue.cc:1048] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.443379 21202 raft_consensus.cc:1275] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.445065 21307 consensus_queue.cc:1048] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.566130 21050 raft_consensus.cc:1275] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.567646 21304 consensus_queue.cc:1048] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.570068 21202 raft_consensus.cc:1275] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.571273 21261 consensus_queue.cc:1048] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:00.686874 20917 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:25:00.687628 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.709997 21050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
mode: GRACEFUL
new_leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:45464
I20260709 12:25:00.710536 21050 raft_consensus.cc:606] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Received request to transfer leadership to TS c58f06aa8f5b41fbbe33dc27d8fe269b
I20260709 12:25:00.721164 21125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:51408
I20260709 12:25:00.721819 21125 raft_consensus.cc:606] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Received request to transfer leadership to TS c58f06aa8f5b41fbbe33dc27d8fe269b
I20260709 12:25:00.723246 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:00.723706 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:00.786136 21307 raft_consensus.cc:993] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc: : Instructing follower c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:25:00.786567 21307 raft_consensus.cc:1081] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Signalling peer c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:25:00.788298 21202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:38532
I20260709 12:25:00.788836 21202 raft_consensus.cc:493] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:00.789142 21202 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:00.793994 21202 raft_consensus.cc:515] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:00.795698 21202 leader_election.cc:290] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 3 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:25:00.796770 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:00.797011 21125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:25:00.797279 21050 raft_consensus.cc:3055] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:00.797565 21050 raft_consensus.cc:740] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:25:00.797573 21125 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:00.798285 21050 consensus_queue.cc:260] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:00.799605 21050 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:00.803339 21125 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 3.
I20260709 12:25:00.804570 21168 leader_election.cc:304] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:25:00.804790 21050 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 3.
I20260709 12:25:00.805723 21333 raft_consensus.cc:2804] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:00.807351 21333 raft_consensus.cc:697] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 LEADER]: Becoming Leader. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:25:00.808174 21333 consensus_queue.cc:237] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:00.815269 20949 catalog_manager.cc:5697] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b reported cstate change: term changed from 2 to 3, leader changed from 31dd8def025b475b868a4b286862f2cc (127.20.109.65) to c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67). New cstate: current_term: 3 leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:00.849478 21344 raft_consensus.cc:993] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943: : Instructing follower c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:25:00.849947 21284 raft_consensus.cc:1081] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Signalling peer c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:25:00.851403 21202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:38530
I20260709 12:25:00.851858 21202 raft_consensus.cc:493] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:00.852161 21202 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:00.856598 21202 raft_consensus.cc:515] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:00.858197 21202 leader_election.cc:290] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 2 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:25:00.859496 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:00.859589 21125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:25:00.860239 21050 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:00.860427 21125 raft_consensus.cc:3055] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:00.860738 21125 raft_consensus.cc:740] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:00.861440 21125 consensus_queue.cc:260] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:00.862640 21125 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:00.865418 21050 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 2.
I20260709 12:25:00.866360 21168 leader_election.cc:304] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:25:00.867053 21333 raft_consensus.cc:2804] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:00.867518 21333 raft_consensus.cc:697] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Becoming Leader. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:25:00.868130 21125 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 2.
I20260709 12:25:00.868304 21333 consensus_queue.cc:237] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:00.879607 20949 catalog_manager.cc:5697] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b reported cstate change: term changed from 1 to 2, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67). New cstate: current_term: 2 leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.258302 21050 raft_consensus.cc:1275] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:01.259765 21333 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:01.270510 21125 raft_consensus.cc:1275] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:01.272004 21338 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:01.292773 21125 raft_consensus.cc:1275] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.294122 21338 consensus_queue.cc:1048] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:01.304770 21050 raft_consensus.cc:1275] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.308374 21352 consensus_queue.cc:1048] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:01.724859 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.731828 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:01.732201 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:02.733091 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.737946 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:02.738344 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:03.739238 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:03.745517 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:03.746073 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:04.747618 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.753175 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:04.753660 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:06.434105 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:06.439483 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:06.440016 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:06.933714 21073 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7060 after lost signal to thread 20920
W20260709 12:25:06.934902 21073 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7740 after lost signal to thread 20983
W20260709 12:25:06.935967 21073 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8d60 after lost signal to thread 21076
W20260709 12:25:06.936776 21073 debug-util.cc:398] Leaking SignalData structure 0x7b080010edc0 after lost signal to thread 21151
W20260709 12:25:06.937567 21073 debug-util.cc:398] Leaking SignalData structure 0x7b08001eacc0 after lost signal to thread 21226
I20260709 12:25:07.441151 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:07.448819 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:07.449345 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:08.450539 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.457751 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:08.458248 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:09.459218 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:09.463840 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:09.464185 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:10.465030 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:10.470942 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:10.471336 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:11.503839 20917 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:25:11.510061 21050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
mode: GRACEFUL
new_leader_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:45458
I20260709 12:25:11.510792 21050 raft_consensus.cc:606] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Received request to transfer leadership to TS fff39eb7549447108eae058730f25943
I20260709 12:25:11.516137 21050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
mode: GRACEFUL
new_leader_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:45458
I20260709 12:25:11.516743 21050 raft_consensus.cc:606] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Received request to transfer leadership to TS fff39eb7549447108eae058730f25943
I20260709 12:25:11.521798 21050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
mode: GRACEFUL
new_leader_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:45458
I20260709 12:25:11.522316 21050 raft_consensus.cc:606] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Received request to transfer leadership to TS fff39eb7549447108eae058730f25943
I20260709 12:25:11.528020 21199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
mode: GRACEFUL
new_leader_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:38544
I20260709 12:25:11.528499 21199 raft_consensus.cc:606] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 LEADER]: Received request to transfer leadership to TS fff39eb7549447108eae058730f25943
I20260709 12:25:11.541334 21199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
mode: GRACEFUL
new_leader_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:38544
I20260709 12:25:11.541847 21199 raft_consensus.cc:606] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Received request to transfer leadership to TS fff39eb7549447108eae058730f25943
I20260709 12:25:11.641681 21367 raft_consensus.cc:993] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc: : Instructing follower fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:11.642149 21367 raft_consensus.cc:1081] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Signalling peer fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:11.643805 21127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc"
dest_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:51386
I20260709 12:25:11.644299 21127 raft_consensus.cc:493] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.644647 21127 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.650287 21127 raft_consensus.cc:515] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.652776 21127 leader_election.cc:290] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 3 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:25:11.653973 21199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:25:11.654346 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516e19eea9a54a52919d13a4718f04bc" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:11.654872 21199 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.655179 21050 raft_consensus.cc:3055] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:11.655562 21050 raft_consensus.cc:740] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:25:11.656603 21050 consensus_queue.cc:260] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.657954 21050 raft_consensus.cc:3060] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.662676 21199 raft_consensus.cc:2468] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 3.
I20260709 12:25:11.664747 21092 leader_election.cc:304] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:25:11.665867 21363 raft_consensus.cc:2804] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:11.666977 21050 raft_consensus.cc:2468] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 3.
I20260709 12:25:11.667934 21363 raft_consensus.cc:697] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:11.669130 21363 consensus_queue.cc:237] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.671650 21367 raft_consensus.cc:993] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc: : Instructing follower fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:11.672305 21368 raft_consensus.cc:1081] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Signalling peer fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:11.674039 21127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae"
dest_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:51386
I20260709 12:25:11.674639 21127 raft_consensus.cc:493] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.675017 21127 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.680541 21127 raft_consensus.cc:515] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.682691 21127 leader_election.cc:290] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 3 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:25:11.682384 20948 catalog_manager.cc:5697] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 2 to 3, leader changed from 31dd8def025b475b868a4b286862f2cc (127.20.109.65) to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.683491 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:11.683768 21199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c685575c2b5e4c2085be4249d35043ae" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:25:11.684123 21050 raft_consensus.cc:3055] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:11.684381 21199 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.684541 21050 raft_consensus.cc:740] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:25:11.685581 21050 consensus_queue.cc:260] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.687073 21050 raft_consensus.cc:3060] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.692562 21199 raft_consensus.cc:2468] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 3.
I20260709 12:25:11.692945 21050 raft_consensus.cc:2468] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 3.
I20260709 12:25:11.693758 21092 leader_election.cc:304] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:25:11.694765 21363 raft_consensus.cc:2804] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:11.695266 21363 raft_consensus.cc:697] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:11.696054 21363 consensus_queue.cc:237] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.705789 20948 catalog_manager.cc:5697] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 2 to 3, leader changed from 31dd8def025b475b868a4b286862f2cc (127.20.109.65) to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.965983 21376 raft_consensus.cc:993] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b: : Instructing follower fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:11.966377 21376 raft_consensus.cc:1081] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Signalling peer fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:11.967882 21127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728"
dest_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:51384
I20260709 12:25:11.968346 21127 raft_consensus.cc:493] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.968619 21127 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.972988 21127 raft_consensus.cc:515] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.974524 21127 leader_election.cc:290] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 3 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:25:11.975425 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:11.975517 21199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:25:11.975943 21050 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.976023 21199 raft_consensus.cc:3055] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:11.976343 21199 raft_consensus.cc:740] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:25:11.977013 21199 consensus_queue.cc:260] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.977942 21199 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.980116 21050 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 3.
I20260709 12:25:11.981498 21093 leader_election.cc:304] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:25:11.982357 21363 raft_consensus.cc:2804] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:11.982525 21199 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 3.
I20260709 12:25:11.982808 21363 raft_consensus.cc:697] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:11.983753 21363 consensus_queue.cc:237] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:11.990238 20948 catalog_manager.cc:5697] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 2 to 3, leader changed from c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67) to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.022002 21367 raft_consensus.cc:993] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc: : Instructing follower fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:12.022420 21368 raft_consensus.cc:1081] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Signalling peer fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:12.023916 21127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984"
dest_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:51386
I20260709 12:25:12.024350 21127 raft_consensus.cc:493] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.024600 21127 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.028995 21127 raft_consensus.cc:515] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:12.030531 21127 leader_election.cc:290] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 2 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:25:12.031301 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:12.031529 21199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:25:12.031810 21050 raft_consensus.cc:3055] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:12.032001 21199 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.032100 21050 raft_consensus.cc:740] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:25:12.032742 21050 consensus_queue.cc:260] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:12.033695 21050 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.036777 21199 raft_consensus.cc:2468] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 2.
I20260709 12:25:12.037791 21050 raft_consensus.cc:2468] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 2.
I20260709 12:25:12.038044 21092 leader_election.cc:304] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58f06aa8f5b41fbbe33dc27d8fe269b, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:25:12.039306 21363 raft_consensus.cc:2804] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.039719 21363 raft_consensus.cc:697] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:12.040539 21363 consensus_queue.cc:237] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:12.048446 20948 catalog_manager.cc:5697] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 1 to 2, leader changed from 31dd8def025b475b868a4b286862f2cc (127.20.109.65) to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.054313 21050 raft_consensus.cc:1275] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:12.055752 21363 consensus_queue.cc:1048] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:12.066267 21199 raft_consensus.cc:1275] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:12.068109 21369 consensus_queue.cc:1048] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:12.082382 21050 raft_consensus.cc:1275] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:12.083873 21363 consensus_queue.cc:1048] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:12.093025 21199 raft_consensus.cc:1275] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:12.094437 21369 consensus_queue.cc:1048] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:12.110287 21376 raft_consensus.cc:993] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b: : Instructing follower fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:12.110906 21360 raft_consensus.cc:1081] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 LEADER]: Signalling peer fff39eb7549447108eae058730f25943 to start an election
I20260709 12:25:12.112315 21127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680"
dest_uuid: "fff39eb7549447108eae058730f25943"
 from {username='slave'} at 127.0.0.1:51384
I20260709 12:25:12.112833 21127 raft_consensus.cc:493] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.113137 21127 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:12.117393 21127 raft_consensus.cc:515] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:12.118923 21127 leader_election.cc:290] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 4 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:25:12.119890 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:12.119894 21199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "fff39eb7549447108eae058730f25943" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:25:12.120601 21050 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:12.120687 21199 raft_consensus.cc:3055] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:12.121044 21199 raft_consensus.cc:740] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:25:12.121718 21199 consensus_queue.cc:260] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:12.122691 21199 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:12.125399 21050 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 4.
I20260709 12:25:12.126489 21093 leader_election.cc:304] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, fff39eb7549447108eae058730f25943; no voters: 
I20260709 12:25:12.127566 21385 raft_consensus.cc:2804] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:12.127650 21199 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fff39eb7549447108eae058730f25943 in term 4.
I20260709 12:25:12.128000 21385 raft_consensus.cc:697] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 4 LEADER]: Becoming Leader. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:12.128870 21385 consensus_queue.cc:237] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:12.136181 20948 catalog_manager.cc:5697] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 reported cstate change: term changed from 3 to 4, leader changed from c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67) to fff39eb7549447108eae058730f25943 (127.20.109.66). New cstate: current_term: 4 leader_uuid: "fff39eb7549447108eae058730f25943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.491902 21050 raft_consensus.cc:1275] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.492990 21385 consensus_queue.cc:1048] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:12.501973 21199 raft_consensus.cc:1275] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.503367 21363 consensus_queue.cc:1048] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:12.538108 21199 raft_consensus.cc:1275] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 4 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:12.539500 21363 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:12.548596 21050 raft_consensus.cc:1275] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 4 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:12.550344 21389 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:12.601811 21199 raft_consensus.cc:1275] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:12.603077 21389 consensus_queue.cc:1048] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:12.606980 21050 raft_consensus.cc:1275] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Refusing update from remote peer fff39eb7549447108eae058730f25943: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:12.608547 21389 consensus_queue.cc:1048] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.967769 20917 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:25:14.968753 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:14.976730 21127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:51408
I20260709 12:25:14.977617 21127 raft_consensus.cc:606] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 4 LEADER]: Received request to transfer leadership to TS c58f06aa8f5b41fbbe33dc27d8fe269b
I20260709 12:25:14.980911 21127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:51408
I20260709 12:25:14.981379 21127 raft_consensus.cc:606] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Received request to transfer leadership to TS 31dd8def025b475b868a4b286862f2cc
I20260709 12:25:14.983800 21127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:51408
I20260709 12:25:14.984267 21127 raft_consensus.cc:606] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Received request to transfer leadership to TS c58f06aa8f5b41fbbe33dc27d8fe269b
I20260709 12:25:14.986574 21127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:51408
I20260709 12:25:14.987015 21127 raft_consensus.cc:606] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Received request to transfer leadership to TS 31dd8def025b475b868a4b286862f2cc
I20260709 12:25:14.989351 21127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984"
dest_uuid: "fff39eb7549447108eae058730f25943"
mode: GRACEFUL
new_leader_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:51408
I20260709 12:25:14.989756 21127 raft_consensus.cc:606] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Received request to transfer leadership to TS 31dd8def025b475b868a4b286862f2cc
I20260709 12:25:14.991119 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:14.991909 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:15.080435 21399 raft_consensus.cc:993] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943: : Instructing follower c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:25:15.080969 21398 raft_consensus.cc:1081] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Signalling peer c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:25:15.082448 21199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:38530
I20260709 12:25:15.082937 21199 raft_consensus.cc:493] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.083220 21199 raft_consensus.cc:3060] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.088057 21199 raft_consensus.cc:515] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.089964 21199 leader_election.cc:290] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 2 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:25:15.091048 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:25:15.091058 21049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a962003c7b44ca0be045c461ab3cb78" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:15.091809 21127 raft_consensus.cc:3055] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:15.091924 21049 raft_consensus.cc:3060] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.092075 21127 raft_consensus.cc:740] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:15.092790 21127 consensus_queue.cc:260] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.093674 21127 raft_consensus.cc:3060] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.097014 21049 raft_consensus.cc:2468] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 2.
I20260709 12:25:15.097975 21127 raft_consensus.cc:2468] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 2.
I20260709 12:25:15.098248 21168 leader_election.cc:304] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:25:15.099089 21396 raft_consensus.cc:2804] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:15.100251 21396 raft_consensus.cc:697] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Becoming Leader. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:25:15.101208 21396 consensus_queue.cc:237] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.112147 20948 catalog_manager.cc:5697] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b reported cstate change: term changed from 1 to 2, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67). New cstate: current_term: 2 leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:15.181790 21399 raft_consensus.cc:993] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943: : Instructing follower 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:25:15.182247 21399 raft_consensus.cc:1081] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Signalling peer 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:25:15.183831 21049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:45438
I20260709 12:25:15.184310 21049 raft_consensus.cc:493] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.184604 21049 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:15.191638 21049 raft_consensus.cc:515] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.193786 21049 leader_election.cc:290] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 4 election: Requested vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:25:15.194625 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:25:15.194764 21199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae4ab20b09a4e6eb1288283f6f84728" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:25:15.195165 21127 raft_consensus.cc:3055] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:15.195293 21199 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:15.195448 21127 raft_consensus.cc:740] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:15.196175 21127 consensus_queue.cc:260] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.197075 21127 raft_consensus.cc:3060] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:15.199724 21199 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 4.
I20260709 12:25:15.200925 21017 leader_election.cc:304] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:25:15.201460 21127 raft_consensus.cc:2468] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 4.
I20260709 12:25:15.202873 21409 raft_consensus.cc:2804] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:15.203900 21409 raft_consensus.cc:697] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 4 LEADER]: Becoming Leader. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:25:15.204731 21409 consensus_queue.cc:237] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.211647 20948 catalog_manager.cc:5697] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc reported cstate change: term changed from 3 to 4, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to 31dd8def025b475b868a4b286862f2cc (127.20.109.65). New cstate: current_term: 4 leader_uuid: "31dd8def025b475b868a4b286862f2cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.213949 21399 raft_consensus.cc:993] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943: : Instructing follower c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:25:15.214571 21401 raft_consensus.cc:1081] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 4 LEADER]: Signalling peer c58f06aa8f5b41fbbe33dc27d8fe269b to start an election
I20260709 12:25:15.216415 21199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680"
dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
 from {username='slave'} at 127.0.0.1:38530
I20260709 12:25:15.216718 21398 raft_consensus.cc:993] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943: : Instructing follower 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:25:15.216995 21199 raft_consensus.cc:493] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.217185 21401 raft_consensus.cc:1081] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Signalling peer 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:25:15.217396 21199 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.218911 21049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:45438
I20260709 12:25:15.219463 21049 raft_consensus.cc:493] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.219769 21049 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.223552 21199 raft_consensus.cc:515] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.224548 21049 raft_consensus.cc:515] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.226073 21050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "31dd8def025b475b868a4b286862f2cc"
I20260709 12:25:15.226236 21127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91c439d9b64002aa5b4bb182da7680" candidate_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:25:15.226677 21050 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.226784 21127 raft_consensus.cc:3055] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:15.227159 21127 raft_consensus.cc:740] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:15.228235 21127 consensus_queue.cc:260] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.229118 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:25:15.229645 21127 raft_consensus.cc:3060] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.229696 21201 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.230284 21125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a285427964954e32ae723d1a8ab22f8b" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:25:15.231021 21125 raft_consensus.cc:3055] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:15.231303 21125 raft_consensus.cc:740] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:15.232021 21125 consensus_queue.cc:260] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.233019 21125 raft_consensus.cc:3060] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.233713 21050 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 5.
I20260709 12:25:15.228240 21049 leader_election.cc:290] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 3 election: Requested vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:25:15.235193 21168 leader_election.cc:304] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:25:15.236186 21396 raft_consensus.cc:2804] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:15.236639 21396 raft_consensus.cc:697] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 5 LEADER]: Becoming Leader. State: Replica: c58f06aa8f5b41fbbe33dc27d8fe269b, State: Running, Role: LEADER
I20260709 12:25:15.237550 21127 raft_consensus.cc:2468] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58f06aa8f5b41fbbe33dc27d8fe269b in term 5.
I20260709 12:25:15.237593 21396 consensus_queue.cc:237] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.225019 21199 leader_election.cc:290] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [CANDIDATE]: Term 5 election: Requested vote from peers 31dd8def025b475b868a4b286862f2cc (127.20.109.65:39629), fff39eb7549447108eae058730f25943 (127.20.109.66:37495)
I20260709 12:25:15.239604 21201 raft_consensus.cc:2468] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 3.
I20260709 12:25:15.240363 21125 raft_consensus.cc:2468] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 3.
I20260709 12:25:15.240801 21017 leader_election.cc:304] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:25:15.241536 21409 raft_consensus.cc:2804] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:15.241967 21409 raft_consensus.cc:697] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 3 LEADER]: Becoming Leader. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:25:15.242816 21409 consensus_queue.cc:237] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.247066 20948 catalog_manager.cc:5697] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b reported cstate change: term changed from 4 to 5, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67). New cstate: current_term: 5 leader_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:15.250002 20946 catalog_manager.cc:5697] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc reported cstate change: term changed from 2 to 3, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to 31dd8def025b475b868a4b286862f2cc (127.20.109.65). New cstate: current_term: 3 leader_uuid: "31dd8def025b475b868a4b286862f2cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.311260 21398 raft_consensus.cc:993] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943: : Instructing follower 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:25:15.311671 21401 raft_consensus.cc:1081] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Signalling peer 31dd8def025b475b868a4b286862f2cc to start an election
I20260709 12:25:15.313062 21050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984"
dest_uuid: "31dd8def025b475b868a4b286862f2cc"
 from {username='slave'} at 127.0.0.1:45438
I20260709 12:25:15.313475 21050 raft_consensus.cc:493] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.313714 21050 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.317694 21050 raft_consensus.cc:515] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.319142 21050 leader_election.cc:290] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 3 election: Requested vote from peers fff39eb7549447108eae058730f25943 (127.20.109.66:37495), c58f06aa8f5b41fbbe33dc27d8fe269b (127.20.109.67:33847)
I20260709 12:25:15.319912 21125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fff39eb7549447108eae058730f25943"
I20260709 12:25:15.320066 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c3d489a5d447389a65551240ab7984" candidate_uuid: "31dd8def025b475b868a4b286862f2cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b"
I20260709 12:25:15.320405 21125 raft_consensus.cc:3055] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:15.320582 21201 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.320683 21125 raft_consensus.cc:740] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fff39eb7549447108eae058730f25943, State: Running, Role: LEADER
I20260709 12:25:15.321345 21125 consensus_queue.cc:260] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.322176 21125 raft_consensus.cc:3060] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.325052 21201 raft_consensus.cc:2468] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 3.
I20260709 12:25:15.325929 21017 leader_election.cc:304] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31dd8def025b475b868a4b286862f2cc, c58f06aa8f5b41fbbe33dc27d8fe269b; no voters: 
I20260709 12:25:15.326212 21125 raft_consensus.cc:2468] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31dd8def025b475b868a4b286862f2cc in term 3.
I20260709 12:25:15.326531 21409 raft_consensus.cc:2804] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:15.327132 21409 raft_consensus.cc:697] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 3 LEADER]: Becoming Leader. State: Replica: 31dd8def025b475b868a4b286862f2cc, State: Running, Role: LEADER
I20260709 12:25:15.327857 21409 consensus_queue.cc:237] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } }
I20260709 12:25:15.335249 20946 catalog_manager.cc:5697] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc reported cstate change: term changed from 2 to 3, leader changed from fff39eb7549447108eae058730f25943 (127.20.109.66) to 31dd8def025b475b868a4b286862f2cc (127.20.109.65). New cstate: current_term: 3 leader_uuid: "31dd8def025b475b868a4b286862f2cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.490731 21125 raft_consensus.cc:1275] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:15.491871 21396 consensus_queue.cc:1048] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:15.501015 21050 raft_consensus.cc:1275] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:15.502786 21396 consensus_queue.cc:1048] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:15.584820 20980 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 20920
W20260709 12:25:15.585634 20980 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 20983
W20260709 12:25:15.586480 20980 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8300 after lost signal to thread 21076
W20260709 12:25:15.587217 20980 debug-util.cc:398] Leaking SignalData structure 0x7b0800090080 after lost signal to thread 21151
W20260709 12:25:15.587915 20980 debug-util.cc:398] Leaking SignalData structure 0x7b080017d500 after lost signal to thread 21226
I20260709 12:25:15.650661 21125 raft_consensus.cc:1275] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 5 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:15.652030 21396 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:15.655673 21127 raft_consensus.cc:1275] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:15.657547 21409 consensus_queue.cc:1048] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:15.689055 21201 raft_consensus.cc:1275] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:15.689633 21050 raft_consensus.cc:1275] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 5 FOLLOWER]: Refusing update from remote peer c58f06aa8f5b41fbbe33dc27d8fe269b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:15.690618 21409 consensus_queue.cc:1048] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:15.708000 21199 raft_consensus.cc:1275] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 4 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:15.716635 21409 consensus_queue.cc:1048] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:15.720541 21202 raft_consensus.cc:1275] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:15.723115 21403 consensus_queue.cc:1048] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31dd8def025b475b868a4b286862f2cc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:15.725821 21410 consensus_queue.cc:1048] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58f06aa8f5b41fbbe33dc27d8fe269b" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:15.727874 21126 raft_consensus.cc:1275] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 4 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:15.729573 21410 consensus_queue.cc:1048] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:25:15.748113 21073 debug-util.cc:398] Leaking SignalData structure 0x7b08001eadc0 after lost signal to thread 20920
W20260709 12:25:15.749159 21073 debug-util.cc:398] Leaking SignalData structure 0x7b0800116060 after lost signal to thread 20983
W20260709 12:25:15.750389 21073 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7160 after lost signal to thread 21076
W20260709 12:25:15.751298 21073 debug-util.cc:398] Leaking SignalData structure 0x7b08001e95a0 after lost signal to thread 21151
W20260709 12:25:15.752138 21073 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4020 after lost signal to thread 21226
I20260709 12:25:15.788205 21127 raft_consensus.cc:1275] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Refusing update from remote peer 31dd8def025b475b868a4b286862f2cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:15.789621 21409 consensus_queue.cc:1048] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fff39eb7549447108eae058730f25943" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:15.993535 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.001029 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:16.001598 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:17.003126 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:17.011023 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:17.011590 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:18.012784 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.017645 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:18.018208 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:19.019537 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.025832 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:19.026295 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:20.027722 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:20.033613 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:20.034274 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:21.035528 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.040405 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:21.040856 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:22.042107 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.048813 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:22.049343 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.050652 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.055647 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:23.056102 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:24.057806 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:24.064680 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:24.065136 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:25.093189 20917 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:25:25.093794 20917 tablet_server.cc:179] TabletServer@127.20.109.65:0 shutting down...
I20260709 12:25:25.124219 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.125207 20917 tablet_replica.cc:333] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.126305 20917 raft_consensus.cc:2243] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.127251 20917 raft_consensus.cc:2272] T c685575c2b5e4c2085be4249d35043ae P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.131325 20917 tablet_replica.cc:333] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.132140 20917 raft_consensus.cc:2243] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.133276 20917 raft_consensus.cc:2272] T f4c3d489a5d447389a65551240ab7984 P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.135856 20917 tablet_replica.cc:333] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.136615 20917 raft_consensus.cc:2243] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.137216 20917 raft_consensus.cc:2272] T 1c91c439d9b64002aa5b4bb182da7680 P 31dd8def025b475b868a4b286862f2cc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.139631 20917 tablet_replica.cc:333] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.140213 20917 raft_consensus.cc:2243] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.140599 20917 raft_consensus.cc:2272] T e80d36bc4f4e425188ba309540bfe285 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.142264 20917 tablet_replica.cc:333] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.142755 20917 raft_consensus.cc:2243] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.143097 20917 raft_consensus.cc:2272] T 6a962003c7b44ca0be045c461ab3cb78 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.144642 20917 tablet_replica.cc:333] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.145079 20917 raft_consensus.cc:2243] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.145444 20917 raft_consensus.cc:2272] T d29079dd9d204e38959cfe6212434892 P 31dd8def025b475b868a4b286862f2cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.147030 20917 tablet_replica.cc:333] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.147482 20917 raft_consensus.cc:2243] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.147852 20917 raft_consensus.cc:2272] T 516e19eea9a54a52919d13a4718f04bc P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.149497 20917 tablet_replica.cc:333] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.149930 20917 raft_consensus.cc:2243] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.150678 20917 raft_consensus.cc:2272] T a285427964954e32ae723d1a8ab22f8b P 31dd8def025b475b868a4b286862f2cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.152282 20917 tablet_replica.cc:333] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc: stopping tablet replica
I20260709 12:25:25.152714 20917 raft_consensus.cc:2243] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.153409 20917 raft_consensus.cc:2272] T 2ae4ab20b09a4e6eb1288283f6f84728 P 31dd8def025b475b868a4b286862f2cc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.267289 20917 tablet_server.cc:196] TabletServer@127.20.109.65:0 shutdown complete.
I20260709 12:25:25.285506 20917 tablet_server.cc:179] TabletServer@127.20.109.66:0 shutting down...
I20260709 12:25:25.316854 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.317618 20917 tablet_replica.cc:333] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.318476 20917 raft_consensus.cc:2243] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.319142 20917 raft_consensus.cc:2272] T f4c3d489a5d447389a65551240ab7984 P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.320945 20917 tablet_replica.cc:333] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.321444 20917 raft_consensus.cc:2243] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.322232 20917 raft_consensus.cc:2272] T c685575c2b5e4c2085be4249d35043ae P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.323935 20917 tablet_replica.cc:333] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.324411 20917 raft_consensus.cc:2243] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.324828 20917 raft_consensus.cc:2272] T e80d36bc4f4e425188ba309540bfe285 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.326428 20917 tablet_replica.cc:333] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.326951 20917 raft_consensus.cc:2243] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.327499 20917 raft_consensus.cc:2272] T 1c91c439d9b64002aa5b4bb182da7680 P fff39eb7549447108eae058730f25943 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.329538 20917 tablet_replica.cc:333] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.330066 20917 raft_consensus.cc:2243] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.330453 20917 raft_consensus.cc:2272] T 6a962003c7b44ca0be045c461ab3cb78 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.332141 20917 tablet_replica.cc:333] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.332578 20917 raft_consensus.cc:2243] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.333310 20917 raft_consensus.cc:2272] T d29079dd9d204e38959cfe6212434892 P fff39eb7549447108eae058730f25943 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.335215 20917 tablet_replica.cc:333] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.335673 20917 raft_consensus.cc:2243] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.336396 20917 raft_consensus.cc:2272] T 516e19eea9a54a52919d13a4718f04bc P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.338114 20917 tablet_replica.cc:333] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.338534 20917 raft_consensus.cc:2243] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.338969 20917 raft_consensus.cc:2272] T a285427964954e32ae723d1a8ab22f8b P fff39eb7549447108eae058730f25943 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.340687 20917 tablet_replica.cc:333] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943: stopping tablet replica
I20260709 12:25:25.341079 20917 raft_consensus.cc:2243] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.341431 20917 raft_consensus.cc:2272] T 2ae4ab20b09a4e6eb1288283f6f84728 P fff39eb7549447108eae058730f25943 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.371630 20917 tablet_server.cc:196] TabletServer@127.20.109.66:0 shutdown complete.
I20260709 12:25:25.390758 20917 tablet_server.cc:179] TabletServer@127.20.109.67:0 shutting down...
W20260709 12:25:25.411512 21168 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.66:37495: connect: Connection refused (error 111)
W20260709 12:25:25.415828 21168 consensus_peers.cc:597] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b -> Peer fff39eb7549447108eae058730f25943 (127.20.109.66:37495): Couldn't send request to peer fff39eb7549447108eae058730f25943. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:37495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:25.421434 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.422158 20917 tablet_replica.cc:333] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.422904 20917 raft_consensus.cc:2243] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.423385 20917 raft_consensus.cc:2272] T 2ae4ab20b09a4e6eb1288283f6f84728 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.425063 20917 tablet_replica.cc:333] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.425606 20917 raft_consensus.cc:2243] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.426093 20917 raft_consensus.cc:2272] T f4c3d489a5d447389a65551240ab7984 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.427819 20917 tablet_replica.cc:333] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.428309 20917 raft_consensus.cc:2243] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.428895 20917 raft_consensus.cc:2272] T c685575c2b5e4c2085be4249d35043ae P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.430552 20917 tablet_replica.cc:333] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.431056 20917 raft_consensus.cc:2243] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.431790 20917 raft_consensus.cc:2272] T 6a962003c7b44ca0be045c461ab3cb78 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.433358 20917 tablet_replica.cc:333] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.433892 20917 raft_consensus.cc:2243] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.434651 20917 raft_consensus.cc:2272] T e80d36bc4f4e425188ba309540bfe285 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.436301 20917 tablet_replica.cc:333] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.436769 20917 raft_consensus.cc:2243] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.437489 20917 raft_consensus.cc:2272] T 1c91c439d9b64002aa5b4bb182da7680 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.439152 20917 tablet_replica.cc:333] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.439575 20917 raft_consensus.cc:2243] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.439955 20917 raft_consensus.cc:2272] T d29079dd9d204e38959cfe6212434892 P c58f06aa8f5b41fbbe33dc27d8fe269b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.441438 20917 tablet_replica.cc:333] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.441946 20917 raft_consensus.cc:2243] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.442451 20917 raft_consensus.cc:2272] T a285427964954e32ae723d1a8ab22f8b P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.444075 20917 tablet_replica.cc:333] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b: stopping tablet replica
I20260709 12:25:25.444447 20917 raft_consensus.cc:2243] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.444775 20917 raft_consensus.cc:2272] T 516e19eea9a54a52919d13a4718f04bc P c58f06aa8f5b41fbbe33dc27d8fe269b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.471751 20917 tablet_server.cc:196] TabletServer@127.20.109.67:0 shutdown complete.
I20260709 12:25:25.489820 20917 master.cc:562] Master@127.20.109.126:36513 shutting down...
I20260709 12:25:25.691135 20917 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.691751 20917 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.692028 20917 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3c81487201424eb88e9d00ac87818c40: stopping tablet replica
I20260709 12:25:25.727591 20917 master.cc:584] Master@127.20.109.126:36513 shutdown complete.
31dd8def025b475b868a4b286862f2cc  4
c58f06aa8f5b41fbbe33dc27d8fe269b  1
fff39eb7549447108eae058730f25943  4
31dd8def025b475b868a4b286862f2cc  3
c58f06aa8f5b41fbbe33dc27d8fe269b  3
fff39eb7549447108eae058730f25943  3
31dd8def025b475b868a4b286862f2cc  0
c58f06aa8f5b41fbbe33dc27d8fe269b  1
fff39eb7549447108eae058730f25943  8
31dd8def025b475b868a4b286862f2cc  3
c58f06aa8f5b41fbbe33dc27d8fe269b  3
fff39eb7549447108eae058730f25943  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31963 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:25:25.769166 20917 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.109.126:40691
I20260709 12:25:25.770457 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.775938 21441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.776307 21442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.776997 21444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.777281 20917 server_base.cc:1061] running on GCE node
I20260709 12:25:25.778262 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:25.778446 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.778585 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599925778572 us; error 0 us; skew 500 ppm
I20260709 12:25:25.779105 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.781481 20917 webserver.cc:533] Webserver started at http://127.20.109.126:37259/ using document root <none> and password file <none>
I20260709 12:25:25.781975 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.782151 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.782405 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.783650 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/master-0-root/instance:
uuid: "f0ca385a1c6a4ed486c853189692ff52"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sc4p"
I20260709 12:25:25.788116 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:25:25.792371 21449 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.793119 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:25.793418 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/master-0-root
uuid: "f0ca385a1c6a4ed486c853189692ff52"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sc4p"
I20260709 12:25:25.793716 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.804448 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:25.805768 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:25.846279 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.126:40691
I20260709 12:25:25.846374 21500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.126:40691 every 8 connection(s)
I20260709 12:25:25.850232 21501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.860643 21501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52: Bootstrap starting.
I20260709 12:25:25.865540 21501 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.869920 21501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52: No bootstrap required, opened a new log
I20260709 12:25:25.872155 21501 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0ca385a1c6a4ed486c853189692ff52" member_type: VOTER }
I20260709 12:25:25.872596 21501 raft_consensus.cc:385] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.872789 21501 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ca385a1c6a4ed486c853189692ff52, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.873318 21501 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0ca385a1c6a4ed486c853189692ff52" member_type: VOTER }
I20260709 12:25:25.873782 21501 raft_consensus.cc:399] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:25.873978 21501 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:25.874185 21501 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.878173 21501 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0ca385a1c6a4ed486c853189692ff52" member_type: VOTER }
I20260709 12:25:25.878749 21501 leader_election.cc:304] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0ca385a1c6a4ed486c853189692ff52; no voters: 
I20260709 12:25:25.879834 21501 leader_election.cc:290] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:25.880282 21504 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.881608 21504 raft_consensus.cc:697] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 1 LEADER]: Becoming Leader. State: Replica: f0ca385a1c6a4ed486c853189692ff52, State: Running, Role: LEADER
I20260709 12:25:25.882360 21504 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0ca385a1c6a4ed486c853189692ff52" member_type: VOTER }
I20260709 12:25:25.882638 21501 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:25.887600 21506 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ca385a1c6a4ed486c853189692ff52. Latest consensus state: current_term: 1 leader_uuid: "f0ca385a1c6a4ed486c853189692ff52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0ca385a1c6a4ed486c853189692ff52" member_type: VOTER } }
I20260709 12:25:25.887743 21505 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0ca385a1c6a4ed486c853189692ff52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0ca385a1c6a4ed486c853189692ff52" member_type: VOTER } }
I20260709 12:25:25.888511 21506 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:25.888530 21505 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:25.891673 21512 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:25.897097 21512 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:25.900601 20917 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:25.906148 21512 catalog_manager.cc:1383] Generated new cluster ID: 52e39fa873e444b0ab103b8ba9f6a122
I20260709 12:25:25.906503 21512 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:25.928129 21512 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:25.929544 21512 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:25.941373 21512 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52: Generated new TSK 0
I20260709 12:25:25.941984 21512 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:25.967796 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.973553 21522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.974184 21523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.975767 21525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.976441 20917 server_base.cc:1061] running on GCE node
I20260709 12:25:25.977419 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:25.977600 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.977764 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599925977744 us; error 0 us; skew 500 ppm
I20260709 12:25:25.978272 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.980479 20917 webserver.cc:533] Webserver started at http://127.20.109.65:33893/ using document root <none> and password file <none>
I20260709 12:25:25.980957 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.981117 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.981370 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.982404 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-0-root/instance:
uuid: "96e9fc7d43934aabaa518215a4c1efc8"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sc4p"
I20260709 12:25:25.986703 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:25:25.989706 21530 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.990370 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:25.990662 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "96e9fc7d43934aabaa518215a4c1efc8"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sc4p"
I20260709 12:25:25.990921 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.999150 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:26.000344 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:26.001811 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:26.004071 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:26.004256 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.004496 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:26.004657 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.046373 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:41989
I20260709 12:25:26.046483 21592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:41989 every 8 connection(s)
I20260709 12:25:26.051183 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:26.058562 21597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:26.061982 21598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:26.065465 21600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:26.065950 20917 server_base.cc:1061] running on GCE node
I20260709 12:25:26.066428 21593 heartbeater.cc:344] Connected to a master server at 127.20.109.126:40691
I20260709 12:25:26.066879 21593 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:26.067323 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:26.067530 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:26.067619 21593 heartbeater.cc:507] Master 127.20.109.126:40691 requested a full tablet report, sending...
I20260709 12:25:26.067701 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599926067685 us; error 0 us; skew 500 ppm
I20260709 12:25:26.068347 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:26.069881 21466 ts_manager.cc:194] Registered new tserver with Master: 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989)
I20260709 12:25:26.071745 21466 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57802
I20260709 12:25:26.072346 20917 webserver.cc:533] Webserver started at http://127.20.109.66:38621/ using document root <none> and password file <none>
I20260709 12:25:26.072875 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:26.073107 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:26.073362 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:26.074455 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-1-root/instance:
uuid: "906a474bd6f14debb41b703776fa62b9"
format_stamp: "Formatted at 2026-07-09 12:25:26 on dist-test-slave-sc4p"
I20260709 12:25:26.078753 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:25:26.082114 21605 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.082852 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:26.083096 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-1-root
uuid: "906a474bd6f14debb41b703776fa62b9"
format_stamp: "Formatted at 2026-07-09 12:25:26 on dist-test-slave-sc4p"
I20260709 12:25:26.083335 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:26.108135 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:26.109336 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:26.110744 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:26.112920 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:26.113094 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.113333 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:26.113471 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.152540 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.66:33199
I20260709 12:25:26.152637 21667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.66:33199 every 8 connection(s)
I20260709 12:25:26.157112 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:26.163892 21671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:26.164917 21672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:26.167881 21674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:26.168485 20917 server_base.cc:1061] running on GCE node
I20260709 12:25:26.169450 21668 heartbeater.cc:344] Connected to a master server at 127.20.109.126:40691
I20260709 12:25:26.169482 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:26.169883 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:26.169957 21668 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:26.170132 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599926170110 us; error 0 us; skew 500 ppm
I20260709 12:25:26.170939 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:26.170917 21668 heartbeater.cc:507] Master 127.20.109.126:40691 requested a full tablet report, sending...
I20260709 12:25:26.173187 21466 ts_manager.cc:194] Registered new tserver with Master: 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:26.173776 20917 webserver.cc:533] Webserver started at http://127.20.109.67:44159/ using document root <none> and password file <none>
I20260709 12:25:26.174278 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:26.174459 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:26.174731 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:26.174710 21466 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57806
I20260709 12:25:26.176085 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-2-root/instance:
uuid: "1c23f634234e40679639814fa011067f"
format_stamp: "Formatted at 2026-07-09 12:25:26 on dist-test-slave-sc4p"
I20260709 12:25:26.180433 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:26.183763 21679 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.184645 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:26.184938 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-2-root
uuid: "1c23f634234e40679639814fa011067f"
format_stamp: "Formatted at 2026-07-09 12:25:26 on dist-test-slave-sc4p"
I20260709 12:25:26.185243 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893634731-20917-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:26.197285 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:26.198479 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:26.199925 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:26.202134 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:26.202354 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.202579 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:26.202754 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:25:26.242537 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.67:40621
I20260709 12:25:26.242672 21741 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.67:40621 every 8 connection(s)
I20260709 12:25:26.256577 21742 heartbeater.cc:344] Connected to a master server at 127.20.109.126:40691
I20260709 12:25:26.257055 21742 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:26.258101 21742 heartbeater.cc:507] Master 127.20.109.126:40691 requested a full tablet report, sending...
I20260709 12:25:26.260473 21466 ts_manager.cc:194] Registered new tserver with Master: 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:26.261379 20917 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01576964s
I20260709 12:25:26.262305 21466 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57808
I20260709 12:25:26.286994 21466 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57812:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:26.289990 21466 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:26.359100 21707 tablet_service.cc:1511] Processing CreateTablet for tablet 93d8fa6ed4874ac9912542daf03d7487 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:26.360721 21707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d8fa6ed4874ac9912542daf03d7487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.367115 21706 tablet_service.cc:1511] Processing CreateTablet for tablet aab95fe744a14df78ee7bebc68962d24 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:26.368860 21706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab95fe744a14df78ee7bebc68962d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.371272 21705 tablet_service.cc:1511] Processing CreateTablet for tablet e2d6300e82504666b015290ab0842072 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:26.372710 21705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d6300e82504666b015290ab0842072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.374454 21555 tablet_service.cc:1511] Processing CreateTablet for tablet a742b796bf0440e0b043962e3e0fe919 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:26.375344 21703 tablet_service.cc:1511] Processing CreateTablet for tablet 0085164c4b654097aa3dab8ef669ad63 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:26.375929 21555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a742b796bf0440e0b043962e3e0fe919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.376682 21703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0085164c4b654097aa3dab8ef669ad63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.379885 21704 tablet_service.cc:1511] Processing CreateTablet for tablet a742b796bf0440e0b043962e3e0fe919 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:26.380523 21633 tablet_service.cc:1511] Processing CreateTablet for tablet 93d8fa6ed4874ac9912542daf03d7487 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:26.381678 21704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a742b796bf0440e0b043962e3e0fe919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.382207 21633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d8fa6ed4874ac9912542daf03d7487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.388370 21554 tablet_service.cc:1511] Processing CreateTablet for tablet 0085164c4b654097aa3dab8ef669ad63 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:26.385205 21632 tablet_service.cc:1511] Processing CreateTablet for tablet aab95fe744a14df78ee7bebc68962d24 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:26.385448 21557 tablet_service.cc:1511] Processing CreateTablet for tablet aab95fe744a14df78ee7bebc68962d24 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:26.387179 21701 tablet_service.cc:1511] Processing CreateTablet for tablet cc7a380710d94a3bbf84f5d5c1b0106a (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:26.387182 21556 tablet_service.cc:1511] Processing CreateTablet for tablet e2d6300e82504666b015290ab0842072 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:26.389732 21554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0085164c4b654097aa3dab8ef669ad63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.394439 21630 tablet_service.cc:1511] Processing CreateTablet for tablet a742b796bf0440e0b043962e3e0fe919 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:26.383888 21702 tablet_service.cc:1511] Processing CreateTablet for tablet 72c1f869820842158f5181cb76fc0d5f (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:26.394330 21631 tablet_service.cc:1511] Processing CreateTablet for tablet e2d6300e82504666b015290ab0842072 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:26.396857 21629 tablet_service.cc:1511] Processing CreateTablet for tablet 0085164c4b654097aa3dab8ef669ad63 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:26.397768 21553 tablet_service.cc:1511] Processing CreateTablet for tablet 72c1f869820842158f5181cb76fc0d5f (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:26.399844 21700 tablet_service.cc:1511] Processing CreateTablet for tablet a53f1018597147d8a05790228a70bd7b (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:26.399983 21628 tablet_service.cc:1511] Processing CreateTablet for tablet 72c1f869820842158f5181cb76fc0d5f (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:26.383867 21558 tablet_service.cc:1511] Processing CreateTablet for tablet 93d8fa6ed4874ac9912542daf03d7487 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:26.407673 21627 tablet_service.cc:1511] Processing CreateTablet for tablet cc7a380710d94a3bbf84f5d5c1b0106a (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:26.408464 21626 tablet_service.cc:1511] Processing CreateTablet for tablet a53f1018597147d8a05790228a70bd7b (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:26.411474 21552 tablet_service.cc:1511] Processing CreateTablet for tablet cc7a380710d94a3bbf84f5d5c1b0106a (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:26.413646 21557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab95fe744a14df78ee7bebc68962d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.413441 21551 tablet_service.cc:1511] Processing CreateTablet for tablet a53f1018597147d8a05790228a70bd7b (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:26.415124 21558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d8fa6ed4874ac9912542daf03d7487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.417900 21551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53f1018597147d8a05790228a70bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.422297 21552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7a380710d94a3bbf84f5d5c1b0106a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.427966 21556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d6300e82504666b015290ab0842072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.435808 21700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53f1018597147d8a05790228a70bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.439342 21702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c1f869820842158f5181cb76fc0d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.440068 21701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7a380710d94a3bbf84f5d5c1b0106a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.445959 21553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c1f869820842158f5181cb76fc0d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.445482 21625 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff9489147c249a7878b3975ba562765 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:26.450220 21632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab95fe744a14df78ee7bebc68962d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.450682 21550 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff9489147c249a7878b3975ba562765 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:26.452076 21550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff9489147c249a7878b3975ba562765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.473249 21699 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff9489147c249a7878b3975ba562765 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:26.474642 21699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff9489147c249a7878b3975ba562765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.474666 21629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0085164c4b654097aa3dab8ef669ad63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.479777 21627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7a380710d94a3bbf84f5d5c1b0106a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.483532 21626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53f1018597147d8a05790228a70bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.484798 21628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c1f869820842158f5181cb76fc0d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.485410 21757 tablet_bootstrap.cc:492] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:26.486017 21631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d6300e82504666b015290ab0842072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.491411 21625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff9489147c249a7878b3975ba562765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.510700 21758 tablet_bootstrap.cc:492] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:26.514804 21630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a742b796bf0440e0b043962e3e0fe919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.522411 21758 tablet_bootstrap.cc:654] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.536476 21624 tablet_service.cc:1511] Processing CreateTablet for tablet cf407b8eba5840f1bddee67dc6d42092 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:26.531842 21557 tablet_service.cc:1511] Processing CreateTablet for tablet cf407b8eba5840f1bddee67dc6d42092 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:26.552192 21557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf407b8eba5840f1bddee67dc6d42092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.559057 21624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf407b8eba5840f1bddee67dc6d42092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.566769 21702 tablet_service.cc:1511] Processing CreateTablet for tablet cf407b8eba5840f1bddee67dc6d42092 (DEFAULT_TABLE table=test-workload [id=0eedfc5219404b66b703fbbea4d8ee74]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:26.569510 21702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf407b8eba5840f1bddee67dc6d42092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.588258 21757 tablet_bootstrap.cc:654] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.596751 21758 tablet_bootstrap.cc:492] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:26.597258 21758 ts_tablet_manager.cc:1403] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.045s
I20260709 12:25:26.600059 21758 raft_consensus.cc:359] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.600816 21758 raft_consensus.cc:385] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.601114 21758 raft_consensus.cc:740] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.604019 21758 consensus_queue.cc:260] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.611254 21760 tablet_bootstrap.cc:492] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:26.621649 21593 heartbeater.cc:499] Master 127.20.109.126:40691 was elected leader, sending a full tablet report...
I20260709 12:25:26.630012 21760 tablet_bootstrap.cc:654] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.634563 21757 tablet_bootstrap.cc:492] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:26.635138 21757 ts_tablet_manager.cc:1403] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.150s	user 0.006s	sys 0.012s
I20260709 12:25:26.636413 21758 ts_tablet_manager.cc:1434] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.017s
I20260709 12:25:26.637466 21758 tablet_bootstrap.cc:492] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:26.638090 21757 raft_consensus.cc:359] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:26.642005 21757 raft_consensus.cc:385] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.642295 21757 raft_consensus.cc:740] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.642984 21757 consensus_queue.cc:260] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:26.644791 21742 heartbeater.cc:499] Master 127.20.109.126:40691 was elected leader, sending a full tablet report...
I20260709 12:25:26.645313 21757 ts_tablet_manager.cc:1434] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:26.646232 21757 tablet_bootstrap.cc:492] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:26.647617 21758 tablet_bootstrap.cc:654] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.652913 21758 tablet_bootstrap.cc:492] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:26.653260 21757 tablet_bootstrap.cc:654] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.653388 21758 ts_tablet_manager.cc:1403] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:25:26.656519 21758 raft_consensus.cc:359] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.657166 21760 tablet_bootstrap.cc:492] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:26.657282 21758 raft_consensus.cc:385] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.657644 21758 raft_consensus.cc:740] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.657864 21760 ts_tablet_manager.cc:1403] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.006s
I20260709 12:25:26.658447 21758 consensus_queue.cc:260] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.660696 21758 ts_tablet_manager.cc:1434] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:26.661698 21758 tablet_bootstrap.cc:492] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:26.664253 21760 raft_consensus.cc:359] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:26.664713 21757 tablet_bootstrap.cc:492] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:26.664991 21760 raft_consensus.cc:385] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.665334 21757 ts_tablet_manager.cc:1403] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:25:26.665318 21760 raft_consensus.cc:740] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.666333 21760 consensus_queue.cc:260] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:26.668135 21758 tablet_bootstrap.cc:654] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.668982 21757 raft_consensus.cc:359] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.669734 21757 raft_consensus.cc:385] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.670028 21757 raft_consensus.cc:740] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.670969 21757 consensus_queue.cc:260] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.673707 21757 ts_tablet_manager.cc:1434] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:25:26.674865 21757 tablet_bootstrap.cc:492] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:26.681703 21757 tablet_bootstrap.cc:654] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.685170 21668 heartbeater.cc:499] Master 127.20.109.126:40691 was elected leader, sending a full tablet report...
I20260709 12:25:26.685575 21758 tablet_bootstrap.cc:492] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:26.686080 21758 ts_tablet_manager.cc:1403] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.002s
I20260709 12:25:26.689109 21760 ts_tablet_manager.cc:1434] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.031s	user 0.015s	sys 0.008s
I20260709 12:25:26.690200 21760 tablet_bootstrap.cc:492] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:26.690822 21758 raft_consensus.cc:359] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.691390 21758 raft_consensus.cc:385] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.691570 21758 raft_consensus.cc:740] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.692152 21758 consensus_queue.cc:260] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.694105 21758 ts_tablet_manager.cc:1434] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 12:25:26.695115 21758 tablet_bootstrap.cc:492] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:26.697556 21760 tablet_bootstrap.cc:654] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.703603 21758 tablet_bootstrap.cc:654] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.716452 21758 tablet_bootstrap.cc:492] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:26.717092 21758 ts_tablet_manager.cc:1403] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.002s
I20260709 12:25:26.720278 21757 tablet_bootstrap.cc:492] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:26.720122 21758 raft_consensus.cc:359] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.720783 21757 ts_tablet_manager.cc:1403] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.013s
I20260709 12:25:26.720853 21758 raft_consensus.cc:385] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.721239 21760 tablet_bootstrap.cc:492] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:26.721212 21758 raft_consensus.cc:740] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.721884 21760 ts_tablet_manager.cc:1403] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.007s
I20260709 12:25:26.722244 21758 consensus_queue.cc:260] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.723783 21757 raft_consensus.cc:359] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.724512 21757 raft_consensus.cc:385] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.724637 21758 ts_tablet_manager.cc:1434] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:25:26.724817 21757 raft_consensus.cc:740] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.725682 21758 tablet_bootstrap.cc:492] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:26.725589 21757 consensus_queue.cc:260] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.727123 21760 raft_consensus.cc:359] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.727880 21757 ts_tablet_manager.cc:1434] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:26.727950 21760 raft_consensus.cc:385] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.728382 21760 raft_consensus.cc:740] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.728925 21757 tablet_bootstrap.cc:492] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:26.729223 21760 consensus_queue.cc:260] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.731381 21760 ts_tablet_manager.cc:1434] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:25:26.735342 21760 tablet_bootstrap.cc:492] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:26.739259 21758 tablet_bootstrap.cc:654] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.735416 21757 tablet_bootstrap.cc:654] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.742468 21760 tablet_bootstrap.cc:654] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:26.746553 21743 tablet.cc:2406] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:26.748054 21757 tablet_bootstrap.cc:492] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:26.748790 21757 ts_tablet_manager.cc:1403] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:25:26.749825 21758 tablet_bootstrap.cc:492] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:26.750252 21758 ts_tablet_manager.cc:1403] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.025s	user 0.002s	sys 0.010s
I20260709 12:25:26.751627 21760 tablet_bootstrap.cc:492] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:26.752135 21760 ts_tablet_manager.cc:1403] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:25:26.752043 21757 raft_consensus.cc:359] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.752399 21758 raft_consensus.cc:359] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.752859 21757 raft_consensus.cc:385] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.753016 21758 raft_consensus.cc:385] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.753319 21758 raft_consensus.cc:740] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.753252 21757 raft_consensus.cc:740] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.754108 21758 consensus_queue.cc:260] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.754249 21757 consensus_queue.cc:260] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.755153 21760 raft_consensus.cc:359] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.755887 21760 raft_consensus.cc:385] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.756181 21760 raft_consensus.cc:740] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.757030 21757 ts_tablet_manager.cc:1434] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:26.757634 21758 ts_tablet_manager.cc:1434] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:25:26.758452 21757 tablet_bootstrap.cc:492] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:26.758769 21758 tablet_bootstrap.cc:492] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:26.757027 21760 consensus_queue.cc:260] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.761894 21760 ts_tablet_manager.cc:1434] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 12:25:26.762964 21760 tablet_bootstrap.cc:492] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:26.766053 21758 tablet_bootstrap.cc:654] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.767939 21757 tablet_bootstrap.cc:654] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.769459 21760 tablet_bootstrap.cc:654] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.777381 21758 tablet_bootstrap.cc:492] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:26.777861 21758 ts_tablet_manager.cc:1403] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.014s
I20260709 12:25:26.780467 21767 raft_consensus.cc:493] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.780900 21758 raft_consensus.cc:359] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.781030 21767 raft_consensus.cc:515] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.784667 21760 tablet_bootstrap.cc:492] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:26.785180 21760 ts_tablet_manager.cc:1403] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.005s
I20260709 12:25:26.787986 21767 leader_election.cc:290] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:26.788069 21760 raft_consensus.cc:359] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.788923 21760 raft_consensus.cc:385] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.789239 21760 raft_consensus.cc:740] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.781697 21758 raft_consensus.cc:385] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.790114 21758 raft_consensus.cc:740] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.791071 21757 tablet_bootstrap.cc:492] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:26.790927 21758 consensus_queue.cc:260] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.791529 21757 ts_tablet_manager.cc:1403] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.014s
I20260709 12:25:26.796396 21762 raft_consensus.cc:493] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.796892 21762 raft_consensus.cc:515] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.799235 21757 raft_consensus.cc:359] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.799978 21757 raft_consensus.cc:385] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.800276 21757 raft_consensus.cc:740] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.800998 21757 consensus_queue.cc:260] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.807816 21762 leader_election.cc:290] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:26.810333 21757 ts_tablet_manager.cc:1434] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:25:26.819103 21757 tablet_bootstrap.cc:492] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:26.795673 21758 ts_tablet_manager.cc:1434] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260709 12:25:26.822495 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:26.823186 21758 tablet_bootstrap.cc:492] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:26.823344 21717 raft_consensus.cc:2468] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 0.
I20260709 12:25:26.824122 21760 consensus_queue.cc:260] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.824880 21607 leader_election.cc:304] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:26.825081 21767 raft_consensus.cc:493] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.827137 21767 raft_consensus.cc:515] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.829720 21757 tablet_bootstrap.cc:654] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.831161 21767 leader_election.cc:290] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:26.831936 21767 raft_consensus.cc:2804] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.832281 21767 raft_consensus.cc:493] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.833153 21767 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.833679 21758 tablet_bootstrap.cc:654] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.844707 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
W20260709 12:25:26.846355 21532 leader_election.cc:343] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c23f634234e40679639814fa011067f (127.20.109.67:40621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.848176 21758 tablet_bootstrap.cc:492] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:26.848335 21757 tablet_bootstrap.cc:492] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:26.848862 21758 ts_tablet_manager.cc:1403] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.002s
I20260709 12:25:26.848989 21757 ts_tablet_manager.cc:1403] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.006s
I20260709 12:25:26.852367 21758 raft_consensus.cc:359] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:26.852727 21757 raft_consensus.cc:359] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.853293 21758 raft_consensus.cc:385] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.853569 21757 raft_consensus.cc:385] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.853750 21758 raft_consensus.cc:740] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.854017 21757 raft_consensus.cc:740] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.854826 21758 consensus_queue.cc:260] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:26.855134 21757 consensus_queue.cc:260] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.857894 21758 ts_tablet_manager.cc:1434] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:26.857968 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a380710d94a3bbf84f5d5c1b0106a" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:26.859400 21758 tablet_bootstrap.cc:492] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
W20260709 12:25:26.859593 21607 leader_election.cc:343] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c23f634234e40679639814fa011067f (127.20.109.67:40621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.866174 21758 tablet_bootstrap.cc:654] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.867075 21767 raft_consensus.cc:515] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.873706 21757 ts_tablet_manager.cc:1434] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.003s
I20260709 12:25:26.875977 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:26.877734 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a380710d94a3bbf84f5d5c1b0106a" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:26.878489 21567 raft_consensus.cc:2468] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 0.
I20260709 12:25:26.879835 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
W20260709 12:25:26.881899 21609 leader_election.cc:343] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.882726 21757 tablet_bootstrap.cc:492] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:26.882994 21609 leader_election.cc:304] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 1c23f634234e40679639814fa011067f
W20260709 12:25:26.884269 21609 leader_election.cc:343] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.885165 21784 raft_consensus.cc:493] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.886533 21762 raft_consensus.cc:493] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.886366 21784 raft_consensus.cc:515] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:26.887060 21762 raft_consensus.cc:515] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.889200 21762 leader_election.cc:290] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:26.889765 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:26.890445 21757 tablet_bootstrap.cc:654] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.890491 21717 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 0.
I20260709 12:25:26.891217 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab95fe744a14df78ee7bebc68962d24" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:26.891932 21716 raft_consensus.cc:2468] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 0.
I20260709 12:25:26.892155 21607 leader_election.cc:304] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:26.893380 21532 leader_election.cc:304] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:26.894397 21762 raft_consensus.cc:2804] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.894820 21762 raft_consensus.cc:493] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.895151 21762 raft_consensus.cc:3060] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:26.896957 21514 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:26.901654 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:26.903389 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab95fe744a14df78ee7bebc68962d24" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:26.904198 21642 raft_consensus.cc:2468] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 0.
I20260709 12:25:26.903260 21762 raft_consensus.cc:515] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
W20260709 12:25:26.905828 21534 leader_election.cc:343] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.906363 21534 leader_election.cc:304] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96e9fc7d43934aabaa518215a4c1efc8; no voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:26.907529 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab95fe744a14df78ee7bebc68962d24" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:26.908242 21716 raft_consensus.cc:3060] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.917068 21716 raft_consensus.cc:2468] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 1.
I20260709 12:25:26.918320 21767 leader_election.cc:290] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:26.918689 21532 leader_election.cc:304] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:26.919031 21767 raft_consensus.cc:2804] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.919456 21767 raft_consensus.cc:493] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.919829 21767 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.924816 21760 ts_tablet_manager.cc:1434] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.139s	user 0.029s	sys 0.025s
I20260709 12:25:26.925242 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:26.926111 21566 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 0.
I20260709 12:25:26.928905 21790 raft_consensus.cc:2749] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.929840 21790 raft_consensus.cc:2804] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.930677 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab95fe744a14df78ee7bebc68962d24" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:26.931396 21642 raft_consensus.cc:3060] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.933565 21792 raft_consensus.cc:493] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.936314 21760 tablet_bootstrap.cc:492] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:26.940753 21642 raft_consensus.cc:2468] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 1.
I20260709 12:25:26.942893 21784 leader_election.cc:290] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c23f634234e40679639814fa011067f (127.20.109.67:40621), 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989)
I20260709 12:25:26.916942 21783 raft_consensus.cc:2804] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.943840 21762 leader_election.cc:290] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:26.934150 21792 raft_consensus.cc:515] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.947641 21783 raft_consensus.cc:493] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.948130 21783 raft_consensus.cc:3060] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.948721 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
W20260709 12:25:26.950409 21532 leader_election.cc:343] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c23f634234e40679639814fa011067f (127.20.109.67:40621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.930334 21790 raft_consensus.cc:697] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:26.953085 21790 consensus_queue.cc:237] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.954728 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:26.956667 21792 leader_election.cc:290] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
W20260709 12:25:26.956511 21534 leader_election.cc:343] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.957482 21534 leader_election.cc:304] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96e9fc7d43934aabaa518215a4c1efc8; no voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:26.959159 21792 raft_consensus.cc:2749] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.966353 21760 tablet_bootstrap.cc:654] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.970685 21757 tablet_bootstrap.cc:492] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:26.971287 21757 ts_tablet_manager.cc:1403] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.089s	user 0.036s	sys 0.047s
I20260709 12:25:26.974282 21757 raft_consensus.cc:359] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.975383 21757 raft_consensus.cc:385] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.975775 21757 raft_consensus.cc:740] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.977209 21757 consensus_queue.cc:260] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
W20260709 12:25:26.979287 21607 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:40621, user_credentials={real_user=slave}} blocked reactor thread for 87213.2us
I20260709 12:25:26.981413 21760 tablet_bootstrap.cc:492] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:26.981326 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:26.982029 21760 ts_tablet_manager.cc:1403] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.004s
I20260709 12:25:26.982064 21716 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.983650 21464 catalog_manager.cc:5697] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.985272 21760 raft_consensus.cc:359] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.986006 21760 raft_consensus.cc:385] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.986409 21760 raft_consensus.cc:740] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.987186 21760 consensus_queue.cc:260] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:26.989377 21757 ts_tablet_manager.cc:1434] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:25:26.990658 21757 tablet_bootstrap.cc:492] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:26.989378 21760 ts_tablet_manager.cc:1434] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:25:26.993894 21760 tablet_bootstrap.cc:492] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:27.000520 21760 tablet_bootstrap.cc:654] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.003669 21716 raft_consensus.cc:2468] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 1.
I20260709 12:25:27.004316 21790 raft_consensus.cc:493] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.004838 21790 raft_consensus.cc:515] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.005102 21607 leader_election.cc:304] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.005585 21758 tablet_bootstrap.cc:492] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:27.006269 21758 ts_tablet_manager.cc:1403] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.147s	user 0.048s	sys 0.079s
I20260709 12:25:27.006841 21788 raft_consensus.cc:2804] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.007229 21790 leader_election.cc:290] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.007593 21788 raft_consensus.cc:697] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:27.008841 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d6300e82504666b015290ab0842072" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:27.008518 21788 consensus_queue.cc:237] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.009076 21758 raft_consensus.cc:359] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.009717 21758 raft_consensus.cc:385] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.009995 21758 raft_consensus.cc:740] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
W20260709 12:25:27.010234 21534 leader_election.cc:343] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.010826 21758 consensus_queue.cc:260] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.011294 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d6300e82504666b015290ab0842072" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:27.011927 21716 raft_consensus.cc:2468] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 0.
I20260709 12:25:27.012326 21757 tablet_bootstrap.cc:654] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.013047 21758 ts_tablet_manager.cc:1434] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:27.013123 21532 leader_election.cc:304] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:27.014185 21758 tablet_bootstrap.cc:492] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:27.014308 21790 raft_consensus.cc:2804] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.014716 21790 raft_consensus.cc:493] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.015115 21790 raft_consensus.cc:3060] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.014820 21783 raft_consensus.cc:515] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.017793 21760 tablet_bootstrap.cc:492] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:27.018054 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a380710d94a3bbf84f5d5c1b0106a" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:27.018301 21760 ts_tablet_manager.cc:1403] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:25:27.018800 21566 raft_consensus.cc:3060] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.020288 21758 tablet_bootstrap.cc:654] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.021301 21760 raft_consensus.cc:359] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.021983 21760 raft_consensus.cc:385] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.022281 21760 raft_consensus.cc:740] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.022403 21790 raft_consensus.cc:515] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.025669 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d6300e82504666b015290ab0842072" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:27.026783 21757 tablet_bootstrap.cc:492] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:27.026640 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d6300e82504666b015290ab0842072" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.027256 21717 raft_consensus.cc:3060] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:27.027480 21534 leader_election.cc:343] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.027261 21757 ts_tablet_manager.cc:1403] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 12:25:27.030490 21757 raft_consensus.cc:359] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.031183 21757 raft_consensus.cc:385] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.032394 21566 raft_consensus.cc:2468] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 1.
I20260709 12:25:27.033537 21760 consensus_queue.cc:260] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.033932 21609 leader_election.cc:304] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:27.034224 21717 raft_consensus.cc:2468] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 1.
I20260709 12:25:27.035403 21784 raft_consensus.cc:2804] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.035698 21532 leader_election.cc:304] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:27.036378 21760 ts_tablet_manager.cc:1434] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:25:27.036929 21792 raft_consensus.cc:2804] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.037279 21790 leader_election.cc:290] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.037511 21792 raft_consensus.cc:697] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:27.031451 21757 raft_consensus.cc:740] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.037684 21760 tablet_bootstrap.cc:492] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:27.038657 21757 consensus_queue.cc:260] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.040962 21757 ts_tablet_manager.cc:1434] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:25:27.041946 21757 tablet_bootstrap.cc:492] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:27.045594 21760 tablet_bootstrap.cc:654] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.047691 21757 tablet_bootstrap.cc:654] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.038455 21792 consensus_queue.cc:237] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.047784 21767 raft_consensus.cc:515] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:27.057184 21784 raft_consensus.cc:697] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:27.058362 21784 consensus_queue.cc:237] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.071274 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a380710d94a3bbf84f5d5c1b0106a" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.071939 21716 raft_consensus.cc:3060] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.076727 21764 raft_consensus.cc:493] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.077296 21764 raft_consensus.cc:515] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.080276 21764 leader_election.cc:290] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:27.094079 21764 raft_consensus.cc:493] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.094937 21764 raft_consensus.cc:515] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.097546 21764 leader_election.cc:290] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:27.102178 21716 raft_consensus.cc:2468] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 1.
I20260709 12:25:27.114449 21762 raft_consensus.cc:493] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.118170 21762 raft_consensus.cc:515] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.120746 21762 leader_election.cc:290] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.122799 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:27.123143 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:27.123710 21717 raft_consensus.cc:2468] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 0.
W20260709 12:25:27.124352 21534 leader_election.cc:343] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.125015 21532 leader_election.cc:304] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:27.126672 21762 raft_consensus.cc:2804] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.127132 21762 raft_consensus.cc:493] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.127523 21762 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.116110 21464 catalog_manager.cc:5697] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.081809 21783 leader_election.cc:290] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.140970 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.141682 21717 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.148990 21717 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 1.
I20260709 12:25:27.150413 21607 leader_election.cc:304] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:27.151676 21783 raft_consensus.cc:2804] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.159855 21783 raft_consensus.cc:697] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:27.160884 21783 consensus_queue.cc:237] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:27.154479 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:27.164316 21566 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.159154 21788 raft_consensus.cc:493] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.161927 21767 leader_election.cc:290] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Requested vote from peers 1c23f634234e40679639814fa011067f (127.20.109.67:40621), 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989)
I20260709 12:25:27.169587 21762 raft_consensus.cc:515] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.175009 21784 raft_consensus.cc:493] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.179087 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:27.179598 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.166306 21788 raft_consensus.cc:515] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.180191 21717 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:27.180529 21534 leader_election.cc:343] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.184746 21788 leader_election.cc:290] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.187804 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
W20260709 12:25:27.189589 21607 leader_election.cc:343] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c23f634234e40679639814fa011067f (127.20.109.67:40621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.187804 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.190963 21567 raft_consensus.cc:2468] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 0.
I20260709 12:25:27.192374 21609 leader_election.cc:304] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 1c23f634234e40679639814fa011067f
I20260709 12:25:27.194039 21788 raft_consensus.cc:2804] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.194432 21788 raft_consensus.cc:493] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.194796 21788 raft_consensus.cc:3060] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.198968 21465 catalog_manager.cc:5697] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.202008 21566 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 1.
I20260709 12:25:27.204543 21717 raft_consensus.cc:2468] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 1.
I20260709 12:25:27.205823 21532 leader_election.cc:304] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:27.206691 21792 raft_consensus.cc:2804] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.207154 21792 raft_consensus.cc:697] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:27.207952 21792 consensus_queue.cc:237] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.212488 21758 tablet_bootstrap.cc:492] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:27.213068 21758 ts_tablet_manager.cc:1403] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.199s	user 0.027s	sys 0.048s
I20260709 12:25:27.184026 21762 leader_election.cc:290] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 1 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.182780 21784 raft_consensus.cc:515] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.226804 21760 tablet_bootstrap.cc:492] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:27.227314 21760 ts_tablet_manager.cc:1403] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.190s	user 0.044s	sys 0.087s
I20260709 12:25:27.228216 21757 tablet_bootstrap.cc:492] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:27.228734 21757 ts_tablet_manager.cc:1403] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.187s	user 0.048s	sys 0.089s
I20260709 12:25:27.230480 21760 raft_consensus.cc:359] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.231248 21760 raft_consensus.cc:385] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.231547 21760 raft_consensus.cc:740] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.231547 21788 raft_consensus.cc:515] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.232661 21784 leader_election.cc:290] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.233661 21764 raft_consensus.cc:493] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.233783 21757 raft_consensus.cc:359] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.234011 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:27.234220 21764 raft_consensus.cc:515] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.234702 21757 raft_consensus.cc:385] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.235164 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:27.235272 21760 consensus_queue.cc:260] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.235212 21757 raft_consensus.cc:740] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.236313 21567 raft_consensus.cc:3060] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.236655 21764 leader_election.cc:290] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:27.237658 21757 consensus_queue.cc:260] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.238483 21760 ts_tablet_manager.cc:1434] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:27.239689 21760 tablet_bootstrap.cc:492] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:27.240113 21757 ts_tablet_manager.cc:1434] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:27.243360 21757 tablet_bootstrap.cc:492] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f: Bootstrap starting.
I20260709 12:25:27.235438 21717 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 0.
I20260709 12:25:27.245326 21567 raft_consensus.cc:2468] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 1.
I20260709 12:25:27.246785 21465 catalog_manager.cc:5697] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.248397 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.253286 21788 leader_election.cc:290] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.254925 21607 leader_election.cc:304] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:27.255729 21788 raft_consensus.cc:2804] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.256078 21788 raft_consensus.cc:493] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.256402 21788 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.254577 21609 leader_election.cc:304] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:27.257058 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.257661 21784 raft_consensus.cc:2804] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.258105 21784 raft_consensus.cc:697] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
W20260709 12:25:27.258493 21607 leader_election.cc:343] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c23f634234e40679639814fa011067f (127.20.109.67:40621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.259205 21784 consensus_queue.cc:237] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.249404 21465 catalog_manager.cc:5697] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.260615 21568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff9489147c249a7878b3975ba562765" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.261250 21568 raft_consensus.cc:2468] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 0.
I20260709 12:25:27.262494 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.262382 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.252094 21566 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 0.
I20260709 12:25:27.275790 21757 tablet_bootstrap.cc:654] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.280732 21788 raft_consensus.cc:515] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.283586 21758 raft_consensus.cc:359] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.284675 21758 raft_consensus.cc:385] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.284981 21758 raft_consensus.cc:740] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.285727 21758 consensus_queue.cc:260] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.286356 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:27.287824 21758 ts_tablet_manager.cc:1434] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.002s
I20260709 12:25:27.288738 21758 tablet_bootstrap.cc:492] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8: Bootstrap starting.
I20260709 12:25:27.263672 21683 leader_election.cc:304] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:27.289361 21757 tablet_bootstrap.cc:492] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f: No bootstrap required, opened a new log
I20260709 12:25:27.290074 21757 ts_tablet_manager.cc:1403] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 12:25:27.290939 21764 raft_consensus.cc:2804] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.291289 21764 raft_consensus.cc:493] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.291604 21764 raft_consensus.cc:3060] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.294116 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:27.294189 21641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:27.295473 21641 raft_consensus.cc:2393] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c23f634234e40679639814fa011067f in current term 1: Already voted for candidate 906a474bd6f14debb41b703776fa62b9 in this term.
I20260709 12:25:27.294878 21642 raft_consensus.cc:2468] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 0.
I20260709 12:25:27.295627 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.296016 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff9489147c249a7878b3975ba562765" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:27.296460 21717 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.293511 21463 catalog_manager.cc:5697] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.290625 21567 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.303928 21683 leader_election.cc:304] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c23f634234e40679639814fa011067f; no voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.305905 21717 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 1.
I20260709 12:25:27.292791 21760 tablet_bootstrap.cc:654] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.307106 21764 raft_consensus.cc:515] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.306828 21567 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 1.
I20260709 12:25:27.295307 21788 leader_election.cc:290] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.307565 21464 catalog_manager.cc:5697] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.309726 21607 leader_election.cc:304] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:27.311404 21683 leader_election.cc:304] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.314910 21757 raft_consensus.cc:359] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.315872 21757 raft_consensus.cc:385] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.316246 21757 raft_consensus.cc:740] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Initialized, Role: FOLLOWER
W20260709 12:25:27.317212 21683 leader_election.cc:343] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.317137 21757 consensus_queue.cc:260] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.315912 21788 raft_consensus.cc:2804] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.319227 21788 raft_consensus.cc:697] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:27.317014 21814 raft_consensus.cc:2749] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.326977 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff9489147c249a7878b3975ba562765" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:27.327702 21567 raft_consensus.cc:3060] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.327540 21788 consensus_queue.cc:237] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.331614 21758 tablet_bootstrap.cc:654] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.333616 21567 raft_consensus.cc:2468] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 1.
I20260709 12:25:27.334972 21814 raft_consensus.cc:2764] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:25:27.335742 21757 ts_tablet_manager.cc:1434] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f: Time spent starting tablet: real 0.045s	user 0.020s	sys 0.001s
I20260709 12:25:27.336213 21683 leader_election.cc:304] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:27.337014 21814 raft_consensus.cc:2804] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.337395 21760 tablet_bootstrap.cc:492] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:27.337915 21760 ts_tablet_manager.cc:1403] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.098s	user 0.018s	sys 0.006s
I20260709 12:25:27.337854 21814 raft_consensus.cc:697] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 1 LEADER]: Becoming Leader. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:27.339062 21814 consensus_queue.cc:237] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.339550 21764 leader_election.cc:290] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:27.341002 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff9489147c249a7878b3975ba562765" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:27.342537 21760 raft_consensus.cc:359] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.343261 21760 raft_consensus.cc:385] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.343534 21760 raft_consensus.cc:740] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.344318 21760 consensus_queue.cc:260] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.346709 21760 ts_tablet_manager.cc:1434] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
W20260709 12:25:27.346287 21683 leader_election.cc:343] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.347702 21760 tablet_bootstrap.cc:492] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:27.352587 21758 tablet_bootstrap.cc:492] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8: No bootstrap required, opened a new log
I20260709 12:25:27.353098 21758 ts_tablet_manager.cc:1403] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.001s
I20260709 12:25:27.353775 21760 tablet_bootstrap.cc:654] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.356500 21758 raft_consensus.cc:359] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.357232 21758 raft_consensus.cc:385] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.357520 21758 raft_consensus.cc:740] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.357487 21464 catalog_manager.cc:5697] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.358826 21758 consensus_queue.cc:260] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.365896 21760 tablet_bootstrap.cc:492] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:27.366508 21760 ts_tablet_manager.cc:1403] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:25:27.367754 21758 ts_tablet_manager.cc:1434] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 12:25:27.369144 21760 raft_consensus.cc:359] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.369781 21760 raft_consensus.cc:385] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.370028 21760 raft_consensus.cc:740] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.370814 21760 consensus_queue.cc:260] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.373548 21465 catalog_manager.cc:5697] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c23f634234e40679639814fa011067f (127.20.109.67). New cstate: current_term: 1 leader_uuid: "1c23f634234e40679639814fa011067f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.374575 21792 consensus_queue.cc:1048] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.377177 21760 ts_tablet_manager.cc:1434] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:25:27.378204 21760 tablet_bootstrap.cc:492] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9: Bootstrap starting.
I20260709 12:25:27.383798 21760 tablet_bootstrap.cc:654] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.393358 21760 tablet_bootstrap.cc:492] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9: No bootstrap required, opened a new log
I20260709 12:25:27.393841 21760 ts_tablet_manager.cc:1403] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 12:25:27.396620 21760 raft_consensus.cc:359] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.397387 21760 raft_consensus.cc:385] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.397665 21760 raft_consensus.cc:740] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.398362 21760 consensus_queue.cc:260] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.401292 21760 ts_tablet_manager.cc:1434] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:27.403702 21792 consensus_queue.cc:1048] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.418376 21567 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.419070 21788 raft_consensus.cc:493] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.419715 21788 raft_consensus.cc:515] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.422851 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d6300e82504666b015290ab0842072" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.423252 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d6300e82504666b015290ab0842072" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:27.424083 21717 raft_consensus.cc:2393] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 906a474bd6f14debb41b703776fa62b9 in current term 1: Already voted for candidate 96e9fc7d43934aabaa518215a4c1efc8 in this term.
I20260709 12:25:27.422904 21788 leader_election.cc:290] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.425158 21607 leader_election.cc:304] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9; no voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.426004 21788 raft_consensus.cc:3060] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.427659 21784 consensus_queue.cc:1048] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.433290 21788 raft_consensus.cc:2749] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.433974 21784 consensus_queue.cc:1048] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.438401 21784 raft_consensus.cc:493] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.438927 21784 raft_consensus.cc:515] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.440884 21784 leader_election.cc:290] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.442103 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff9489147c249a7878b3975ba562765" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c23f634234e40679639814fa011067f" is_pre_election: true
I20260709 12:25:27.442467 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff9489147c249a7878b3975ba562765" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.443218 21567 raft_consensus.cc:2393] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 906a474bd6f14debb41b703776fa62b9 in current term 1: Already voted for candidate 1c23f634234e40679639814fa011067f in this term.
I20260709 12:25:27.445003 21609 leader_election.cc:304] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9; no voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.445804 21788 raft_consensus.cc:3060] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.455058 21788 raft_consensus.cc:2749] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.478228 21814 raft_consensus.cc:493] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.478770 21814 raft_consensus.cc:515] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.480566 21814 leader_election.cc:290] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:27.481449 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf407b8eba5840f1bddee67dc6d42092" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.481592 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf407b8eba5840f1bddee67dc6d42092" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:27.481987 21566 raft_consensus.cc:2468] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 0.
I20260709 12:25:27.482128 21643 raft_consensus.cc:2468] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 0.
I20260709 12:25:27.482955 21683 leader_election.cc:304] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:27.483628 21814 raft_consensus.cc:2804] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.484022 21814 raft_consensus.cc:493] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.484297 21814 raft_consensus.cc:3060] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.489248 21814 raft_consensus.cc:515] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.490975 21814 leader_election.cc:290] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:27.491757 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf407b8eba5840f1bddee67dc6d42092" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:27.491946 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf407b8eba5840f1bddee67dc6d42092" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:27.492292 21566 raft_consensus.cc:3060] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.492426 21643 raft_consensus.cc:3060] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.497426 21566 raft_consensus.cc:2468] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 1.
I20260709 12:25:27.498338 21643 raft_consensus.cc:2468] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 1.
I20260709 12:25:27.498461 21683 leader_election.cc:304] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:27.499207 21814 raft_consensus.cc:2804] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.499557 21814 raft_consensus.cc:697] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 1 LEADER]: Becoming Leader. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:27.500289 21814 consensus_queue.cc:237] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.507076 21466 catalog_manager.cc:5697] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c23f634234e40679639814fa011067f (127.20.109.67). New cstate: current_term: 1 leader_uuid: "1c23f634234e40679639814fa011067f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.532667 21788 consensus_queue.cc:1048] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.542727 21783 consensus_queue.cc:1048] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.613024 21643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
mode: GRACEFUL
new_leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:40734
I20260709 12:25:27.613597 21643 raft_consensus.cc:606] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Received request to transfer leadership to TS 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.621667 21792 consensus_queue.cc:1048] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.624837 21643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
mode: GRACEFUL
new_leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:40734
I20260709 12:25:27.625425 21643 raft_consensus.cc:606] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Received request to transfer leadership to TS 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.625921 21642 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.635811 21790 consensus_queue.cc:1048] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.636336 21791 consensus_queue.cc:1048] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.639038 21641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
mode: GRACEFUL
new_leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:40734
I20260709 12:25:27.639856 21641 raft_consensus.cc:606] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Received request to transfer leadership to TS 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.641618 21784 consensus_queue.cc:1048] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.656731 21790 consensus_queue.cc:1048] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.670037 21783 consensus_queue.cc:1048] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.697314 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
mode: GRACEFUL
new_leader_uuid: "906a474bd6f14debb41b703776fa62b9"
 from {username='slave'} at 127.0.0.1:37664
I20260709 12:25:27.697947 21567 raft_consensus.cc:606] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Received request to transfer leadership to TS 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:27.707283 21767 raft_consensus.cc:993] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9: : Instructing follower 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:27.707729 21767 raft_consensus.cc:1081] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Signalling peer 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:27.709713 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:27.710366 21567 raft_consensus.cc:493] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.710779 21567 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.710837 21814 raft_consensus.cc:493] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.711376 21814 raft_consensus.cc:515] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.715481 21814 leader_election.cc:290] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:27.719306 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906a474bd6f14debb41b703776fa62b9" is_pre_election: true
I20260709 12:25:27.719172 21567 raft_consensus.cc:515] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:27.719409 21565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8" is_pre_election: true
I20260709 12:25:27.720397 21565 raft_consensus.cc:2393] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c23f634234e40679639814fa011067f in current term 1: Already voted for candidate 906a474bd6f14debb41b703776fa62b9 in this term.
I20260709 12:25:27.721392 21566 raft_consensus.cc:1240] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Rejecting Update request from peer 906a474bd6f14debb41b703776fa62b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:27.721916 21716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ff9489147c249a7878b3975ba562765"
dest_uuid: "1c23f634234e40679639814fa011067f"
mode: GRACEFUL
new_leader_uuid: "906a474bd6f14debb41b703776fa62b9"
 from {username='slave'} at 127.0.0.1:36784
I20260709 12:25:27.722483 21716 raft_consensus.cc:606] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 1 LEADER]: Received request to transfer leadership to TS 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:27.724234 21683 leader_election.cc:304] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c23f634234e40679639814fa011067f; no voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:27.725055 21567 leader_election.cc:290] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Requested vote from peers 1c23f634234e40679639814fa011067f (127.20.109.67:40621), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:27.724871 21788 consensus_queue.cc:1059] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.725521 21814 raft_consensus.cc:3060] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.725700 21788 raft_consensus.cc:3055] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.726123 21788 raft_consensus.cc:740] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:27.727025 21788 consensus_queue.cc:260] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:27.727499 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.728114 21716 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.728353 21788 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.726977 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:27.729836 21767 consensus_queue.cc:1048] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.736568 21814 raft_consensus.cc:2749] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.737700 21716 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
I20260709 12:25:27.738967 21532 leader_election.cc:304] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:27.740113 21792 raft_consensus.cc:2804] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.740674 21792 raft_consensus.cc:697] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:27.741500 21792 consensus_queue.cc:237] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:27.742779 21642 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
I20260709 12:25:27.745620 21767 raft_consensus.cc:993] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9: : Instructing follower 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:27.746145 21783 raft_consensus.cc:1081] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Signalling peer 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:27.748109 21566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:27.748687 21566 raft_consensus.cc:493] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.749064 21566 raft_consensus.cc:3060] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.752102 21783 consensus_queue.cc:1048] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.753376 21465 catalog_manager.cc:5697] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 1 to 2, leader changed from 906a474bd6f14debb41b703776fa62b9 (127.20.109.66) to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.756132 21566 raft_consensus.cc:515] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.757332 21567 raft_consensus.cc:1240] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Rejecting Update request from peer 906a474bd6f14debb41b703776fa62b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:27.760377 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.765133 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a742b796bf0440e0b043962e3e0fe919" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:27.765949 21566 leader_election.cc:290] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.765735 21783 consensus_queue.cc:1059] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.766932 21642 raft_consensus.cc:3055] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.767210 21642 raft_consensus.cc:740] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:27.768069 21642 consensus_queue.cc:260] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.768988 21642 raft_consensus.cc:3060] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.774113 21642 raft_consensus.cc:2468] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
W20260709 12:25:27.774574 21783 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:25:27.775271 21534 leader_election.cc:304] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 1c23f634234e40679639814fa011067f
I20260709 12:25:27.776031 21792 raft_consensus.cc:2804] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.776476 21792 raft_consensus.cc:697] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:27.777179 21792 consensus_queue.cc:237] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.783640 21465 catalog_manager.cc:5697] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 1 to 2, leader changed from 906a474bd6f14debb41b703776fa62b9 (127.20.109.66) to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.808177 21814 consensus_queue.cc:1048] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.814553 21816 raft_consensus.cc:993] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f: : Instructing follower 906a474bd6f14debb41b703776fa62b9 to start an election
I20260709 12:25:27.815026 21764 raft_consensus.cc:1081] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 1 LEADER]: Signalling peer 906a474bd6f14debb41b703776fa62b9 to start an election
I20260709 12:25:27.818790 21643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ff9489147c249a7878b3975ba562765"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
 from {username='slave'} at 127.0.0.1:40726
I20260709 12:25:27.820281 21643 raft_consensus.cc:493] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.820683 21643 raft_consensus.cc:3060] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.823372 21814 consensus_queue.cc:1048] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.827476 21643 raft_consensus.cc:515] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.833251 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff9489147c249a7878b3975ba562765" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:27.833571 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff9489147c249a7878b3975ba562765" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.833899 21566 raft_consensus.cc:3060] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.834139 21716 raft_consensus.cc:3055] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.834463 21716 raft_consensus.cc:740] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:27.835328 21716 consensus_queue.cc:260] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.836509 21716 raft_consensus.cc:3060] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.839957 21643 leader_election.cc:290] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 2 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.841879 21566 raft_consensus.cc:2468] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 2.
I20260709 12:25:27.843484 21716 raft_consensus.cc:2468] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 2.
I20260709 12:25:27.845006 21607 leader_election.cc:304] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:27.845856 21783 raft_consensus.cc:2804] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.846362 21783 raft_consensus.cc:697] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:27.847179 21783 consensus_queue.cc:237] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.854558 21465 catalog_manager.cc:5697] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 1 to 2, leader changed from 1c23f634234e40679639814fa011067f (127.20.109.67) to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.859419 21783 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.870944 21784 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.879511 21783 raft_consensus.cc:993] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9: : Instructing follower 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:27.879937 21784 raft_consensus.cc:1081] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Signalling peer 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:27.881345 21566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:27.881896 21566 raft_consensus.cc:493] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.882191 21566 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.886994 21566 raft_consensus.cc:515] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.889168 21566 leader_election.cc:290] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:27.889897 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:27.890547 21643 raft_consensus.cc:3055] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.890481 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:27.891006 21643 raft_consensus.cc:740] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:27.891201 21716 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.891865 21643 consensus_queue.cc:260] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.893198 21643 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.898435 21716 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
I20260709 12:25:27.899955 21643 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
I20260709 12:25:27.899899 21532 leader_election.cc:304] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:27.900931 21792 raft_consensus.cc:2804] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.901384 21792 raft_consensus.cc:697] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:27.902141 21792 consensus_queue.cc:237] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:27.908923 21466 catalog_manager.cc:5697] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 1 to 2, leader changed from 906a474bd6f14debb41b703776fa62b9 (127.20.109.66) to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:28.046690 21814 consensus_queue.cc:1048] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:28.056519 21764 consensus_queue.cc:1048] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:28.157377 21643 raft_consensus.cc:1275] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.159030 21792 consensus_queue.cc:1048] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.169577 21716 raft_consensus.cc:1275] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.171209 21790 consensus_queue.cc:1048] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.207365 21848 raft_consensus.cc:993] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8: : Instructing follower 906a474bd6f14debb41b703776fa62b9 to start an election
I20260709 12:25:28.207824 21790 raft_consensus.cc:1081] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Signalling peer 906a474bd6f14debb41b703776fa62b9 to start an election
I20260709 12:25:28.209197 21643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
 from {username='slave'} at 127.0.0.1:40710
I20260709 12:25:28.209659 21643 raft_consensus.cc:493] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:28.209919 21643 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.214568 21643 raft_consensus.cc:515] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:28.216183 21643 leader_election.cc:290] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 2 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:28.217026 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:28.217278 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:28.217598 21566 raft_consensus.cc:3055] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:28.217794 21716 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.217947 21566 raft_consensus.cc:740] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:28.218734 21566 consensus_queue.cc:260] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:28.219662 21566 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.223485 21716 raft_consensus.cc:2468] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 2.
I20260709 12:25:28.224545 21607 leader_election.cc:304] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:28.224772 21566 raft_consensus.cc:2468] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 2.
I20260709 12:25:28.225203 21784 raft_consensus.cc:2804] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:28.225642 21784 raft_consensus.cc:697] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:28.226423 21784 consensus_queue.cc:237] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:28.232928 21465 catalog_manager.cc:5697] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 1 to 2, leader changed from 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65) to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:28.296609 21643 raft_consensus.cc:1275] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.297859 21790 consensus_queue.cc:1048] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.305294 21716 raft_consensus.cc:3060] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.311857 21716 raft_consensus.cc:1275] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.313086 21791 consensus_queue.cc:1048] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.353466 21566 raft_consensus.cc:1275] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Refusing update from remote peer 906a474bd6f14debb41b703776fa62b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.354749 21784 consensus_queue.cc:1048] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.362495 21716 raft_consensus.cc:1275] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Refusing update from remote peer 906a474bd6f14debb41b703776fa62b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.364059 21783 consensus_queue.cc:1048] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.479137 21716 raft_consensus.cc:1275] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.480381 21791 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.487995 21643 raft_consensus.cc:1275] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.489495 21792 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.626068 21566 raft_consensus.cc:1275] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Refusing update from remote peer 906a474bd6f14debb41b703776fa62b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.627384 21783 consensus_queue.cc:1048] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.636076 21716 raft_consensus.cc:1275] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Refusing update from remote peer 906a474bd6f14debb41b703776fa62b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.637647 21767 consensus_queue.cc:1048] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:30.773773 20917 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:25:30.774577 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:30.796463 21566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
mode: GRACEFUL
new_leader_uuid: "1c23f634234e40679639814fa011067f"
 from {username='slave'} at 127.0.0.1:37676
I20260709 12:25:30.797011 21566 raft_consensus.cc:606] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Received request to transfer leadership to TS 1c23f634234e40679639814fa011067f
I20260709 12:25:30.799602 21566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
mode: GRACEFUL
new_leader_uuid: "1c23f634234e40679639814fa011067f"
 from {username='slave'} at 127.0.0.1:37676
I20260709 12:25:30.800099 21566 raft_consensus.cc:606] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Received request to transfer leadership to TS 1c23f634234e40679639814fa011067f
I20260709 12:25:30.801259 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:30.801981 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:30.851402 21855 raft_consensus.cc:993] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8: : Instructing follower 1c23f634234e40679639814fa011067f to start an election
I20260709 12:25:30.851846 21791 raft_consensus.cc:1081] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Signalling peer 1c23f634234e40679639814fa011067f to start an election
I20260709 12:25:30.853806 21717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487"
dest_uuid: "1c23f634234e40679639814fa011067f"
 from {username='slave'} at 127.0.0.1:36770
I20260709 12:25:30.854321 21717 raft_consensus.cc:493] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:30.854637 21717 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:30.859675 21717 raft_consensus.cc:515] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:30.861334 21717 leader_election.cc:290] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 3 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:30.862351 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:30.863096 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:30.863363 21566 raft_consensus.cc:3055] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:30.863711 21643 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:30.863699 21566 raft_consensus.cc:740] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:30.865051 21566 consensus_queue.cc:260] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:30.866554 21566 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:30.871979 21643 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 3.
I20260709 12:25:30.873389 21683 leader_election.cc:304] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:30.873670 21566 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 3.
I20260709 12:25:30.874261 21764 raft_consensus.cc:2804] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:30.875214 21764 raft_consensus.cc:697] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Becoming Leader. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:30.875890 21764 consensus_queue.cc:237] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:30.882442 21466 catalog_manager.cc:5697] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f reported cstate change: term changed from 2 to 3, leader changed from 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65) to 1c23f634234e40679639814fa011067f (127.20.109.67). New cstate: current_term: 3 leader_uuid: "1c23f634234e40679639814fa011067f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.240442 21855 raft_consensus.cc:993] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8: : Instructing follower 1c23f634234e40679639814fa011067f to start an election
I20260709 12:25:31.240890 21791 raft_consensus.cc:1081] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Signalling peer 1c23f634234e40679639814fa011067f to start an election
I20260709 12:25:31.242301 21717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63"
dest_uuid: "1c23f634234e40679639814fa011067f"
 from {username='slave'} at 127.0.0.1:36770
I20260709 12:25:31.242779 21717 raft_consensus.cc:493] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.243077 21717 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.247841 21717 raft_consensus.cc:515] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:31.249390 21717 leader_election.cc:290] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 3 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:31.250317 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:31.250496 21643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:31.250857 21566 raft_consensus.cc:3055] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:31.251024 21643 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.251157 21566 raft_consensus.cc:740] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:31.251891 21566 consensus_queue.cc:260] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:31.252807 21566 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.256660 21643 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 3.
I20260709 12:25:31.256971 21566 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 3.
I20260709 12:25:31.257962 21683 leader_election.cc:304] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:31.258667 21764 raft_consensus.cc:2804] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.259057 21764 raft_consensus.cc:697] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Becoming Leader. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:31.259724 21764 consensus_queue.cc:237] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:31.270331 21466 catalog_manager.cc:5697] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f reported cstate change: term changed from 2 to 3, leader changed from 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65) to 1c23f634234e40679639814fa011067f (127.20.109.67). New cstate: current_term: 3 leader_uuid: "1c23f634234e40679639814fa011067f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.272118 21643 raft_consensus.cc:1275] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Refusing update from remote peer 1c23f634234e40679639814fa011067f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.273476 21764 consensus_queue.cc:1048] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.287356 21566 raft_consensus.cc:1275] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Refusing update from remote peer 1c23f634234e40679639814fa011067f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.289081 21856 consensus_queue.cc:1048] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.708211 21643 raft_consensus.cc:1275] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Refusing update from remote peer 1c23f634234e40679639814fa011067f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.709422 21856 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.720968 21566 raft_consensus.cc:1275] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Refusing update from remote peer 1c23f634234e40679639814fa011067f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.722247 21764 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.803031 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:31.809908 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:31.810423 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:32.811559 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:32.818313 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:32.818779 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:33.819949 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.827021 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:33.827550 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:34.829000 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:34.834584 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:34.835075 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:35.836131 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.842569 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:35.843039 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:36.844362 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.850041 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:36.850461 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:37.851471 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:37.856675 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:37.857095 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:38.858148 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:38.863545 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:38.863955 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:39.864916 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.870626 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:39.871026 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:40.904228 20917 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:25:40.911702 21716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487"
dest_uuid: "1c23f634234e40679639814fa011067f"
mode: GRACEFUL
new_leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:36784
I20260709 12:25:40.912446 21716 raft_consensus.cc:606] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Received request to transfer leadership to TS 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:40.925395 21716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63"
dest_uuid: "1c23f634234e40679639814fa011067f"
mode: GRACEFUL
new_leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:36784
I20260709 12:25:40.925859 21716 raft_consensus.cc:606] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Received request to transfer leadership to TS 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:40.931421 21642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
mode: GRACEFUL
new_leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:40734
I20260709 12:25:40.931887 21642 raft_consensus.cc:606] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Received request to transfer leadership to TS 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:40.937003 21642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc7a380710d94a3bbf84f5d5c1b0106a"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
mode: GRACEFUL
new_leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:40734
I20260709 12:25:40.937601 21642 raft_consensus.cc:606] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Received request to transfer leadership to TS 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:40.942449 21642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
mode: GRACEFUL
new_leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:40734
I20260709 12:25:40.942965 21642 raft_consensus.cc:606] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Received request to transfer leadership to TS 96e9fc7d43934aabaa518215a4c1efc8
I20260709 12:25:41.024593 21764 raft_consensus.cc:993] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f: : Instructing follower 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.024986 21764 raft_consensus.cc:1081] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Signalling peer 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.026506 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:37654
I20260709 12:25:41.027009 21567 raft_consensus.cc:493] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.027334 21567 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.034329 21567 raft_consensus.cc:515] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.036373 21567 leader_election.cc:290] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 4 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:41.037743 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:41.037743 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:41.038650 21642 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.038753 21716 raft_consensus.cc:3055] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:41.039077 21716 raft_consensus.cc:740] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:41.039793 21716 consensus_queue.cc:260] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.040778 21716 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.044214 21642 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 4.
I20260709 12:25:41.045527 21716 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 4.
I20260709 12:25:41.045575 21534 leader_election.cc:304] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:41.046662 21873 raft_consensus.cc:2804] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:41.047991 21873 raft_consensus.cc:697] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:41.048982 21873 consensus_queue.cc:237] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.058108 21466 catalog_manager.cc:5697] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 3 to 4, leader changed from 1c23f634234e40679639814fa011067f (127.20.109.67) to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.088339 21880 raft_consensus.cc:993] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9: : Instructing follower 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.089109 21879 raft_consensus.cc:1081] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Signalling peer 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.091135 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:41.091746 21567 raft_consensus.cc:493] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.092044 21567 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.097290 21567 raft_consensus.cc:515] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.099184 21567 leader_election.cc:290] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:41.099845 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:41.100343 21642 raft_consensus.cc:3055] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:41.100261 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:41.100682 21642 raft_consensus.cc:740] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:41.100870 21717 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.101480 21642 consensus_queue.cc:260] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.102566 21642 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:41.102543 21880 consensus_queue.cc:1175] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c23f634234e40679639814fa011067f" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:25:41.108126 21717 raft_consensus.cc:2468] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
I20260709 12:25:41.109117 21642 raft_consensus.cc:2468] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
I20260709 12:25:41.109426 21532 leader_election.cc:304] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:41.110273 21882 raft_consensus.cc:2804] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:41.110651 21882 raft_consensus.cc:697] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:41.111420 21882 consensus_queue.cc:237] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.117822 21466 catalog_manager.cc:5697] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 1 to 2, leader changed from 906a474bd6f14debb41b703776fa62b9 (127.20.109.66) to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.232952 21879 raft_consensus.cc:993] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9: : Instructing follower 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.233397 21879 raft_consensus.cc:1081] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Signalling peer 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.234890 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:41.235369 21567 raft_consensus.cc:493] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.235651 21567 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.240458 21567 raft_consensus.cc:515] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.242182 21567 leader_election.cc:290] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 3 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:41.243013 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:41.243266 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f1018597147d8a05790228a70bd7b" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:41.243541 21642 raft_consensus.cc:3055] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:41.243721 21717 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.243847 21642 raft_consensus.cc:740] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:41.244649 21642 consensus_queue.cc:260] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.245644 21642 raft_consensus.cc:3060] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.249764 21717 raft_consensus.cc:2468] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 3.
I20260709 12:25:41.251223 21532 leader_election.cc:304] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:41.252089 21882 raft_consensus.cc:2804] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:41.252902 21882 raft_consensus.cc:697] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:41.253599 21642 raft_consensus.cc:2468] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 3.
I20260709 12:25:41.253732 21882 consensus_queue.cc:237] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.255349 21880 raft_consensus.cc:993] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9: : Instructing follower 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.255776 21879 raft_consensus.cc:1081] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Signalling peer 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.257380 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc7a380710d94a3bbf84f5d5c1b0106a"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:41.257889 21567 raft_consensus.cc:493] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.258288 21567 raft_consensus.cc:3060] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.262626 21466 catalog_manager.cc:5697] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 2 to 3, leader changed from 906a474bd6f14debb41b703776fa62b9 (127.20.109.66) to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.265139 21567 raft_consensus.cc:515] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.266856 21567 leader_election.cc:290] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Requested vote from peers 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:41.267889 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a380710d94a3bbf84f5d5c1b0106a" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:41.268319 21717 raft_consensus.cc:3060] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.270385 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7a380710d94a3bbf84f5d5c1b0106a" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:41.270900 21642 raft_consensus.cc:3055] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:41.271257 21642 raft_consensus.cc:740] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:41.272024 21642 consensus_queue.cc:260] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.272951 21642 raft_consensus.cc:3060] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.273381 21717 raft_consensus.cc:2468] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
I20260709 12:25:41.274283 21532 leader_election.cc:304] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:41.275131 21882 raft_consensus.cc:2804] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:41.275506 21882 raft_consensus.cc:697] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:41.276278 21882 consensus_queue.cc:237] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:41.278230 21642 raft_consensus.cc:2468] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 2.
I20260709 12:25:41.283253 21466 catalog_manager.cc:5697] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 1 to 2, leader changed from 906a474bd6f14debb41b703776fa62b9 (127.20.109.66) to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.435983 21881 raft_consensus.cc:993] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f: : Instructing follower 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.436385 21764 raft_consensus.cc:1081] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Signalling peer 96e9fc7d43934aabaa518215a4c1efc8 to start an election
I20260709 12:25:41.437687 21567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
 from {username='slave'} at 127.0.0.1:37654
I20260709 12:25:41.438109 21567 raft_consensus.cc:493] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.438347 21567 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.442481 21567 raft_consensus.cc:515] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:41.444037 21567 leader_election.cc:290] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 4 election: Requested vote from peers 1c23f634234e40679639814fa011067f (127.20.109.67:40621), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:41.444864 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:41.445458 21717 raft_consensus.cc:3055] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:41.445410 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d8fa6ed4874ac9912542daf03d7487" candidate_uuid: "96e9fc7d43934aabaa518215a4c1efc8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:41.445899 21717 raft_consensus.cc:740] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:41.446074 21642 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.446980 21643 raft_consensus.cc:1275] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 4 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:41.446789 21717 consensus_queue.cc:260] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:41.447922 21717 raft_consensus.cc:3060] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.448387 21873 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:41.452690 21642 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 4.
I20260709 12:25:41.453714 21534 leader_election.cc:304] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 906a474bd6f14debb41b703776fa62b9, 96e9fc7d43934aabaa518215a4c1efc8; no voters: 
I20260709 12:25:41.453949 21717 raft_consensus.cc:2468] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e9fc7d43934aabaa518215a4c1efc8 in term 4.
I20260709 12:25:41.454949 21873 raft_consensus.cc:2804] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:41.455686 21873 raft_consensus.cc:697] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 LEADER]: Becoming Leader. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:41.458344 21873 consensus_queue.cc:237] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } }
I20260709 12:25:41.462577 21717 raft_consensus.cc:1275] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 4 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:41.464334 21892 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:41.467613 21466 catalog_manager.cc:5697] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 reported cstate change: term changed from 3 to 4, leader changed from 1c23f634234e40679639814fa011067f (127.20.109.67) to 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "96e9fc7d43934aabaa518215a4c1efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.579353 21717 raft_consensus.cc:1275] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:41.580574 21873 consensus_queue.cc:1048] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:41.594359 21643 raft_consensus.cc:1275] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:41.595808 21873 consensus_queue.cc:1048] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:41.670389 21643 raft_consensus.cc:1275] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:41.671643 21873 consensus_queue.cc:1048] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:41.680282 21717 raft_consensus.cc:1275] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:41.681730 21882 consensus_queue.cc:1048] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:41.865525 21717 raft_consensus.cc:1275] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:41.867268 21882 consensus_queue.cc:1048] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:41.876130 21643 raft_consensus.cc:1275] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:41.877568 21882 consensus_queue.cc:1048] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:41.928860 21643 raft_consensus.cc:1275] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 4 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:41.930130 21882 consensus_queue.cc:1048] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:41.939847 21717 raft_consensus.cc:1275] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 4 FOLLOWER]: Refusing update from remote peer 96e9fc7d43934aabaa518215a4c1efc8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:41.942342 21882 consensus_queue.cc:1048] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:44.009337 20917 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:25:44.010421 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.018944 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
mode: GRACEFUL
new_leader_uuid: "906a474bd6f14debb41b703776fa62b9"
 from {username='slave'} at 127.0.0.1:37676
I20260709 12:25:44.019639 21567 raft_consensus.cc:606] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 LEADER]: Received request to transfer leadership to TS 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:44.022215 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
mode: GRACEFUL
new_leader_uuid: "1c23f634234e40679639814fa011067f"
 from {username='slave'} at 127.0.0.1:37676
I20260709 12:25:44.022646 21567 raft_consensus.cc:606] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Received request to transfer leadership to TS 1c23f634234e40679639814fa011067f
I20260709 12:25:44.024739 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aab95fe744a14df78ee7bebc68962d24"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
mode: GRACEFUL
new_leader_uuid: "906a474bd6f14debb41b703776fa62b9"
 from {username='slave'} at 127.0.0.1:37676
I20260709 12:25:44.025141 21567 raft_consensus.cc:606] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Received request to transfer leadership to TS 906a474bd6f14debb41b703776fa62b9
I20260709 12:25:44.027338 21567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2d6300e82504666b015290ab0842072"
dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
mode: GRACEFUL
new_leader_uuid: "1c23f634234e40679639814fa011067f"
 from {username='slave'} at 127.0.0.1:37676
I20260709 12:25:44.027776 21567 raft_consensus.cc:606] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Received request to transfer leadership to TS 1c23f634234e40679639814fa011067f
I20260709 12:25:44.028816 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:44.029269 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:44.134106 21873 raft_consensus.cc:993] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8: : Instructing follower 906a474bd6f14debb41b703776fa62b9 to start an election
I20260709 12:25:44.134657 21907 raft_consensus.cc:1081] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Signalling peer 906a474bd6f14debb41b703776fa62b9 to start an election
I20260709 12:25:44.136127 21642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aab95fe744a14df78ee7bebc68962d24"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
 from {username='slave'} at 127.0.0.1:40710
I20260709 12:25:44.136541 21642 raft_consensus.cc:493] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.136807 21642 raft_consensus.cc:3060] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.142203 21642 raft_consensus.cc:515] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.144078 21642 leader_election.cc:290] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 2 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:44.145270 21717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab95fe744a14df78ee7bebc68962d24" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:44.145166 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab95fe744a14df78ee7bebc68962d24" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:44.145911 21717 raft_consensus.cc:3060] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.145948 21567 raft_consensus.cc:3055] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:44.146276 21567 raft_consensus.cc:740] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:44.146976 21567 consensus_queue.cc:260] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.148051 21567 raft_consensus.cc:3060] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.151486 21717 raft_consensus.cc:2468] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 2.
I20260709 12:25:44.152630 21607 leader_election.cc:304] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:44.153574 21879 raft_consensus.cc:2804] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.153952 21567 raft_consensus.cc:2468] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 2.
I20260709 12:25:44.154577 21879 raft_consensus.cc:697] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:44.155805 21879 consensus_queue.cc:237] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.162941 21466 catalog_manager.cc:5697] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 1 to 2, leader changed from 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65) to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.430043 21873 raft_consensus.cc:993] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8: : Instructing follower 906a474bd6f14debb41b703776fa62b9 to start an election
I20260709 12:25:44.430490 21907 raft_consensus.cc:1081] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 LEADER]: Signalling peer 906a474bd6f14debb41b703776fa62b9 to start an election
I20260709 12:25:44.431955 21873 raft_consensus.cc:993] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8: : Instructing follower 1c23f634234e40679639814fa011067f to start an election
I20260709 12:25:44.432010 21642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63"
dest_uuid: "906a474bd6f14debb41b703776fa62b9"
 from {username='slave'} at 127.0.0.1:40710
I20260709 12:25:44.432562 21909 raft_consensus.cc:1081] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Signalling peer 1c23f634234e40679639814fa011067f to start an election
I20260709 12:25:44.432598 21642 raft_consensus.cc:493] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.433048 21642 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:44.434788 21717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2d6300e82504666b015290ab0842072"
dest_uuid: "1c23f634234e40679639814fa011067f"
 from {username='slave'} at 127.0.0.1:36770
I20260709 12:25:44.435307 21717 raft_consensus.cc:493] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.435578 21717 raft_consensus.cc:3060] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.440017 21642 raft_consensus.cc:515] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.440368 21717 raft_consensus.cc:515] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.441759 21642 leader_election.cc:290] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 5 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 1c23f634234e40679639814fa011067f (127.20.109.67:40621)
I20260709 12:25:44.442612 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:44.442997 21716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0085164c4b654097aa3dab8ef669ad63" candidate_uuid: "906a474bd6f14debb41b703776fa62b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1c23f634234e40679639814fa011067f"
I20260709 12:25:44.443233 21717 leader_election.cc:290] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 2 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:44.443138 21567 raft_consensus.cc:3055] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:44.443605 21716 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:44.443656 21567 raft_consensus.cc:740] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:44.443809 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d6300e82504666b015290ab0842072" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:44.444352 21642 raft_consensus.cc:3060] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.444622 21567 consensus_queue.cc:260] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.445358 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d6300e82504666b015290ab0842072" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:44.445923 21566 raft_consensus.cc:3055] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:44.446226 21566 raft_consensus.cc:740] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:44.447006 21566 consensus_queue.cc:260] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.448287 21566 raft_consensus.cc:3060] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.445888 21567 raft_consensus.cc:3060] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:44.451447 21716 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 5.
I20260709 12:25:44.451683 21642 raft_consensus.cc:2468] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 2.
I20260709 12:25:44.452669 21607 leader_election.cc:304] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:44.453281 21683 leader_election.cc:304] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:44.454013 21879 raft_consensus.cc:2804] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:44.454413 21764 raft_consensus.cc:2804] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.454532 21879 raft_consensus.cc:697] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 5 LEADER]: Becoming Leader. State: Replica: 906a474bd6f14debb41b703776fa62b9, State: Running, Role: LEADER
I20260709 12:25:44.455735 21566 raft_consensus.cc:2468] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 2.
I20260709 12:25:44.456841 21764 raft_consensus.cc:697] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 2 LEADER]: Becoming Leader. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:44.456596 21879 consensus_queue.cc:237] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.457401 21567 raft_consensus.cc:2468] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 906a474bd6f14debb41b703776fa62b9 in term 5.
I20260709 12:25:44.458417 21764 consensus_queue.cc:237] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.460826 21907 raft_consensus.cc:993] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8: : Instructing follower 1c23f634234e40679639814fa011067f to start an election
I20260709 12:25:44.461297 21907 raft_consensus.cc:1081] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Signalling peer 1c23f634234e40679639814fa011067f to start an election
I20260709 12:25:44.463238 21716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f"
dest_uuid: "1c23f634234e40679639814fa011067f"
 from {username='slave'} at 127.0.0.1:36770
I20260709 12:25:44.463996 21716 raft_consensus.cc:493] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.464416 21716 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:44.469231 21466 catalog_manager.cc:5697] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f reported cstate change: term changed from 1 to 2, leader changed from 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65) to 1c23f634234e40679639814fa011067f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "1c23f634234e40679639814fa011067f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.472846 21716 raft_consensus.cc:515] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.475075 21716 leader_election.cc:290] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 3 election: Requested vote from peers 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989), 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199)
I20260709 12:25:44.475972 21567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96e9fc7d43934aabaa518215a4c1efc8"
I20260709 12:25:44.476600 21567 raft_consensus.cc:3055] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:44.476819 21567 raft_consensus.cc:740] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96e9fc7d43934aabaa518215a4c1efc8, State: Running, Role: LEADER
I20260709 12:25:44.477530 21567 consensus_queue.cc:260] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.478618 21642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c1f869820842158f5181cb76fc0d5f" candidate_uuid: "1c23f634234e40679639814fa011067f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "906a474bd6f14debb41b703776fa62b9"
I20260709 12:25:44.478044 21465 catalog_manager.cc:5697] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 reported cstate change: term changed from 4 to 5, leader changed from 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65) to 906a474bd6f14debb41b703776fa62b9 (127.20.109.66). New cstate: current_term: 5 leader_uuid: "906a474bd6f14debb41b703776fa62b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.479339 21567 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:44.479422 21642 raft_consensus.cc:3060] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:44.487811 21642 raft_consensus.cc:2468] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 3.
I20260709 12:25:44.488451 21567 raft_consensus.cc:2468] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c23f634234e40679639814fa011067f in term 3.
I20260709 12:25:44.488987 21683 leader_election.cc:304] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c23f634234e40679639814fa011067f, 906a474bd6f14debb41b703776fa62b9; no voters: 
I20260709 12:25:44.490123 21764 raft_consensus.cc:2804] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:44.490995 21764 raft_consensus.cc:697] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Becoming Leader. State: Replica: 1c23f634234e40679639814fa011067f, State: Running, Role: LEADER
I20260709 12:25:44.492323 21764 consensus_queue.cc:237] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } }
I20260709 12:25:44.500029 21465 catalog_manager.cc:5697] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f reported cstate change: term changed from 2 to 3, leader changed from 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65) to 1c23f634234e40679639814fa011067f (127.20.109.67). New cstate: current_term: 3 leader_uuid: "1c23f634234e40679639814fa011067f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.542580 21716 raft_consensus.cc:1275] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Refusing update from remote peer 906a474bd6f14debb41b703776fa62b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.543773 21879 consensus_queue.cc:1048] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:44.554407 21567 raft_consensus.cc:1275] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Refusing update from remote peer 906a474bd6f14debb41b703776fa62b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.557161 21910 consensus_queue.cc:1048] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:44.850245 21567 raft_consensus.cc:1275] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Refusing update from remote peer 1c23f634234e40679639814fa011067f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.851398 21764 consensus_queue.cc:1048] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:44.861191 21642 raft_consensus.cc:1275] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Refusing update from remote peer 1c23f634234e40679639814fa011067f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.862787 21764 consensus_queue.cc:1048] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:44.863284 21567 raft_consensus.cc:1275] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 5 FOLLOWER]: Refusing update from remote peer 906a474bd6f14debb41b703776fa62b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:44.864483 21910 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:44.880082 21716 raft_consensus.cc:1275] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 5 FOLLOWER]: Refusing update from remote peer 906a474bd6f14debb41b703776fa62b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:44.883055 21922 consensus_queue.cc:1048] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c23f634234e40679639814fa011067f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:44.964072 21642 raft_consensus.cc:1275] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Refusing update from remote peer 1c23f634234e40679639814fa011067f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:44.965718 21764 consensus_queue.cc:1048] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "906a474bd6f14debb41b703776fa62b9" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:44.975467 21567 raft_consensus.cc:1275] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Refusing update from remote peer 1c23f634234e40679639814fa011067f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:44.976822 21764 consensus_queue.cc:1048] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e9fc7d43934aabaa518215a4c1efc8" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:45.030344 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.035763 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.036198 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:46.037202 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:46.042625 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:46.043087 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:47.044041 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:47.049629 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:47.050079 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:48.051118 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:48.057760 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:48.058122 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:49.059039 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.064605 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:49.065001 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:50.065996 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:50.071646 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:50.072136 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:51.073149 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.078925 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:51.079373 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:52.080394 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.087139 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:52.087610 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:53.088521 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.095168 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:53.095624 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:54.131238 20917 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:25:54.131935 20917 tablet_server.cc:179] TabletServer@127.20.109.65:0 shutting down...
I20260709 12:25:54.161872 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:54.162660 20917 tablet_replica.cc:333] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.163480 20917 raft_consensus.cc:2243] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.164678 20917 raft_consensus.cc:2272] T a53f1018597147d8a05790228a70bd7b P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.167059 20917 tablet_replica.cc:333] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.167814 20917 raft_consensus.cc:2243] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.168641 20917 raft_consensus.cc:2272] T 72c1f869820842158f5181cb76fc0d5f P 96e9fc7d43934aabaa518215a4c1efc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.170569 20917 tablet_replica.cc:333] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.171123 20917 raft_consensus.cc:2243] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.172221 20917 raft_consensus.cc:2272] T 93d8fa6ed4874ac9912542daf03d7487 P 96e9fc7d43934aabaa518215a4c1efc8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.174041 20917 tablet_replica.cc:333] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.174659 20917 raft_consensus.cc:2243] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.175460 20917 raft_consensus.cc:2272] T cc7a380710d94a3bbf84f5d5c1b0106a P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.177392 20917 tablet_replica.cc:333] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.178169 20917 raft_consensus.cc:2243] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.179124 20917 raft_consensus.cc:2272] T a742b796bf0440e0b043962e3e0fe919 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.180949 20917 tablet_replica.cc:333] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.181421 20917 raft_consensus.cc:2243] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.181908 20917 raft_consensus.cc:2272] T 7ff9489147c249a7878b3975ba562765 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.183646 20917 tablet_replica.cc:333] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.184228 20917 raft_consensus.cc:2243] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.184672 20917 raft_consensus.cc:2272] T aab95fe744a14df78ee7bebc68962d24 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.186827 20917 tablet_replica.cc:333] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.187319 20917 raft_consensus.cc:2243] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.187831 20917 raft_consensus.cc:2272] T cf407b8eba5840f1bddee67dc6d42092 P 96e9fc7d43934aabaa518215a4c1efc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.189893 20917 tablet_replica.cc:333] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.190552 20917 raft_consensus.cc:2243] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.191135 20917 raft_consensus.cc:2272] T e2d6300e82504666b015290ab0842072 P 96e9fc7d43934aabaa518215a4c1efc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.193629 20917 tablet_replica.cc:333] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8: stopping tablet replica
I20260709 12:25:54.194309 20917 raft_consensus.cc:2243] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.194991 20917 raft_consensus.cc:2272] T 0085164c4b654097aa3dab8ef669ad63 P 96e9fc7d43934aabaa518215a4c1efc8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.225390 20917 tablet_server.cc:196] TabletServer@127.20.109.65:0 shutdown complete.
I20260709 12:25:54.246371 20917 tablet_server.cc:179] TabletServer@127.20.109.66:0 shutting down...
W20260709 12:25:54.259690 21683 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:41989: connect: Connection refused (error 111)
W20260709 12:25:54.278862 21683 consensus_peers.cc:597] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f -> Peer 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989): Couldn't send request to peer 96e9fc7d43934aabaa518215a4c1efc8. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:41989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.284240 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:54.285363 20917 tablet_replica.cc:333] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.286466 20917 raft_consensus.cc:2243] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.287375 20917 raft_consensus.cc:2272] T cf407b8eba5840f1bddee67dc6d42092 P 906a474bd6f14debb41b703776fa62b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.287276 21683 consensus_peers.cc:597] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f -> Peer 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989): Couldn't send request to peer 96e9fc7d43934aabaa518215a4c1efc8. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:41989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.288632 21683 consensus_peers.cc:597] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f -> Peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Couldn't send request to peer 906a474bd6f14debb41b703776fa62b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.290809 20917 tablet_replica.cc:333] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.291774 20917 raft_consensus.cc:2243] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.292407 20917 raft_consensus.cc:2272] T e2d6300e82504666b015290ab0842072 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.294827 21609 consensus_peers.cc:597] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 -> Peer 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989): Couldn't send request to peer 96e9fc7d43934aabaa518215a4c1efc8. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:41989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.296060 20917 tablet_replica.cc:333] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.296748 20917 raft_consensus.cc:2243] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.297341 20917 raft_consensus.cc:2272] T a53f1018597147d8a05790228a70bd7b P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.299695 20917 tablet_replica.cc:333] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.300369 20917 raft_consensus.cc:2243] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.301451 20917 raft_consensus.cc:2272] T 0085164c4b654097aa3dab8ef669ad63 P 906a474bd6f14debb41b703776fa62b9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.303423 20917 tablet_replica.cc:333] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.303951 20917 raft_consensus.cc:2243] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.304898 20917 raft_consensus.cc:2272] T 7ff9489147c249a7878b3975ba562765 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.307389 20917 tablet_replica.cc:333] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.308012 20917 raft_consensus.cc:2243] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.308903 20917 raft_consensus.cc:2272] T aab95fe744a14df78ee7bebc68962d24 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.311060 20917 tablet_replica.cc:333] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.311610 20917 raft_consensus.cc:2243] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.312085 20917 raft_consensus.cc:2272] T a742b796bf0440e0b043962e3e0fe919 P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.313916 20917 tablet_replica.cc:333] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.314414 20917 raft_consensus.cc:2243] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.314877 20917 raft_consensus.cc:2272] T cc7a380710d94a3bbf84f5d5c1b0106a P 906a474bd6f14debb41b703776fa62b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.316696 20917 tablet_replica.cc:333] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.317191 20917 raft_consensus.cc:2243] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.317646 20917 raft_consensus.cc:2272] T 72c1f869820842158f5181cb76fc0d5f P 906a474bd6f14debb41b703776fa62b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.319479 20917 tablet_replica.cc:333] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9: stopping tablet replica
I20260709 12:25:54.319938 20917 raft_consensus.cc:2243] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.320504 20917 raft_consensus.cc:2272] T 93d8fa6ed4874ac9912542daf03d7487 P 906a474bd6f14debb41b703776fa62b9 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.345242 21683 consensus_peers.cc:597] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f -> Peer 96e9fc7d43934aabaa518215a4c1efc8 (127.20.109.65:41989): Couldn't send request to peer 96e9fc7d43934aabaa518215a4c1efc8. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:41989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.351199 20917 tablet_server.cc:196] TabletServer@127.20.109.66:0 shutdown complete.
I20260709 12:25:54.373504 20917 tablet_server.cc:179] TabletServer@127.20.109.67:0 shutting down...
W20260709 12:25:54.398689 21683 consensus_peers.cc:597] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f -> Peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Couldn't send request to peer 906a474bd6f14debb41b703776fa62b9. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.399456 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:54.400242 20917 tablet_replica.cc:333] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.400959 20917 raft_consensus.cc:2243] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.401548 20917 raft_consensus.cc:2272] T 0085164c4b654097aa3dab8ef669ad63 P 1c23f634234e40679639814fa011067f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.403555 20917 tablet_replica.cc:333] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.404122 20917 raft_consensus.cc:2243] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.404975 20917 raft_consensus.cc:2272] T cf407b8eba5840f1bddee67dc6d42092 P 1c23f634234e40679639814fa011067f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.407004 20917 tablet_replica.cc:333] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.407526 20917 raft_consensus.cc:2243] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.408252 20917 raft_consensus.cc:2272] T e2d6300e82504666b015290ab0842072 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.410050 20917 tablet_replica.cc:333] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.410527 20917 raft_consensus.cc:2243] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.411041 20917 raft_consensus.cc:2272] T a53f1018597147d8a05790228a70bd7b P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.413518 20917 tablet_replica.cc:333] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.414058 20917 raft_consensus.cc:2243] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.414634 20917 raft_consensus.cc:2272] T a742b796bf0440e0b043962e3e0fe919 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.416707 20917 tablet_replica.cc:333] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f: stopping tablet replica
W20260709 12:25:54.417007 21683 consensus_peers.cc:597] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f -> Peer 906a474bd6f14debb41b703776fa62b9 (127.20.109.66:33199): Couldn't send request to peer 906a474bd6f14debb41b703776fa62b9. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.417223 20917 raft_consensus.cc:2243] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.417738 20917 raft_consensus.cc:2272] T cc7a380710d94a3bbf84f5d5c1b0106a P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.419656 20917 tablet_replica.cc:333] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.420202 20917 raft_consensus.cc:2243] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.420673 20917 raft_consensus.cc:2272] T 93d8fa6ed4874ac9912542daf03d7487 P 1c23f634234e40679639814fa011067f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.422501 20917 tablet_replica.cc:333] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.423003 20917 raft_consensus.cc:2243] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.423804 20917 raft_consensus.cc:2272] T 72c1f869820842158f5181cb76fc0d5f P 1c23f634234e40679639814fa011067f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.425540 20917 tablet_replica.cc:333] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.426002 20917 raft_consensus.cc:2243] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.426487 20917 raft_consensus.cc:2272] T 7ff9489147c249a7878b3975ba562765 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.428213 20917 tablet_replica.cc:333] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f: stopping tablet replica
I20260709 12:25:54.428766 20917 raft_consensus.cc:2243] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.429239 20917 raft_consensus.cc:2272] T aab95fe744a14df78ee7bebc68962d24 P 1c23f634234e40679639814fa011067f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.460049 20917 tablet_server.cc:196] TabletServer@127.20.109.67:0 shutdown complete.
I20260709 12:25:54.480078 20917 master.cc:562] Master@127.20.109.126:40691 shutting down...
I20260709 12:25:54.502205 20917 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.503105 20917 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.503497 20917 tablet_replica.cc:333] T 00000000000000000000000000000000 P f0ca385a1c6a4ed486c853189692ff52: stopping tablet replica
I20260709 12:25:54.522326 20917 master.cc:584] Master@127.20.109.126:40691 shutdown complete.
1c23f634234e40679639814fa011067f  1
906a474bd6f14debb41b703776fa62b9  4
96e9fc7d43934aabaa518215a4c1efc8  5
1c23f634234e40679639814fa011067f  3
906a474bd6f14debb41b703776fa62b9  4
96e9fc7d43934aabaa518215a4c1efc8  3
1c23f634234e40679639814fa011067f  1
906a474bd6f14debb41b703776fa62b9  1
96e9fc7d43934aabaa518215a4c1efc8  8
1c23f634234e40679639814fa011067f  3
906a474bd6f14debb41b703776fa62b9  3
96e9fc7d43934aabaa518215a4c1efc8  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28794 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:25:54.564397 20917 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.109.126:41439
I20260709 12:25:54.565662 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:54.571713 21946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:54.571986 21947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:54.573786 20917 server_base.cc:1061] running on GCE node
W20260709 12:25:54.573804 21949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:54.575273 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:54.575490 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:54.575615 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599954575603 us; error 0 us; skew 500 ppm
I20260709 12:25:54.576141 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:54.579005 20917 webserver.cc:533] Webserver started at http://127.20.109.126:34837/ using document root <none> and password file <none>
I20260709 12:25:54.579519 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:54.579689 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:54.579942 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:54.581187 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/master-0-root/instance:
uuid: "338e7fd7f8b642b4a2b24f544ca70832"
format_stamp: "Formatted at 2026-07-09 12:25:54 on dist-test-slave-sc4p"
I20260709 12:25:54.586889 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:25:54.591243 21954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:54.592303 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:25:54.592777 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/master-0-root
uuid: "338e7fd7f8b642b4a2b24f544ca70832"
format_stamp: "Formatted at 2026-07-09 12:25:54 on dist-test-slave-sc4p"
I20260709 12:25:54.593140 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:54.606339 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:54.607646 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:54.649428 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.126:41439
I20260709 12:25:54.649537 22005 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.126:41439 every 8 connection(s)
I20260709 12:25:54.653802 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.664364 22006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: Bootstrap starting.
I20260709 12:25:54.669303 22006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.674134 22006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: No bootstrap required, opened a new log
I20260709 12:25:54.676728 22006 raft_consensus.cc:359] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338e7fd7f8b642b4a2b24f544ca70832" member_type: VOTER }
I20260709 12:25:54.677325 22006 raft_consensus.cc:385] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.677520 22006 raft_consensus.cc:740] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338e7fd7f8b642b4a2b24f544ca70832, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.678272 22006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338e7fd7f8b642b4a2b24f544ca70832" member_type: VOTER }
I20260709 12:25:54.678812 22006 raft_consensus.cc:399] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:54.679021 22006 raft_consensus.cc:493] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:54.679339 22006 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.683797 22006 raft_consensus.cc:515] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338e7fd7f8b642b4a2b24f544ca70832" member_type: VOTER }
I20260709 12:25:54.684340 22006 leader_election.cc:304] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 338e7fd7f8b642b4a2b24f544ca70832; no voters: 
I20260709 12:25:54.685539 22006 leader_election.cc:290] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:54.685972 22009 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.687258 22009 raft_consensus.cc:697] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 1 LEADER]: Becoming Leader. State: Replica: 338e7fd7f8b642b4a2b24f544ca70832, State: Running, Role: LEADER
I20260709 12:25:54.687929 22009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338e7fd7f8b642b4a2b24f544ca70832" member_type: VOTER }
I20260709 12:25:54.688607 22006 sys_catalog.cc:565] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:54.692921 22010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "338e7fd7f8b642b4a2b24f544ca70832" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338e7fd7f8b642b4a2b24f544ca70832" member_type: VOTER } }
I20260709 12:25:54.693414 22011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 338e7fd7f8b642b4a2b24f544ca70832. Latest consensus state: current_term: 1 leader_uuid: "338e7fd7f8b642b4a2b24f544ca70832" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338e7fd7f8b642b4a2b24f544ca70832" member_type: VOTER } }
I20260709 12:25:54.693717 22010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:54.694113 22011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:54.697672 22017 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:54.702649 22017 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:54.705420 20917 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:54.712508 22017 catalog_manager.cc:1383] Generated new cluster ID: 5f5dba5539a24a06a4d90e45e2609670
I20260709 12:25:54.712751 22017 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:54.737844 22017 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:54.739270 22017 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:54.765383 22017 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: Generated new TSK 0
I20260709 12:25:54.766316 22017 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:54.775180 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:54.780704 22027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:54.781659 22028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:54.783390 20917 server_base.cc:1061] running on GCE node
W20260709 12:25:54.784437 22030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:54.785301 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:54.785567 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:54.785748 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599954785733 us; error 0 us; skew 500 ppm
I20260709 12:25:54.786248 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:54.788605 20917 webserver.cc:533] Webserver started at http://127.20.109.65:46109/ using document root <none> and password file <none>
I20260709 12:25:54.789045 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:54.789198 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:54.789422 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:54.790480 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/instance:
uuid: "d465f3cb42174eb89615dcd747f9e682"
format_stamp: "Formatted at 2026-07-09 12:25:54 on dist-test-slave-sc4p"
I20260709 12:25:54.795197 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:25:54.798620 22035 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:54.799468 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:25:54.799762 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "d465f3cb42174eb89615dcd747f9e682"
format_stamp: "Formatted at 2026-07-09 12:25:54 on dist-test-slave-sc4p"
I20260709 12:25:54.800120 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:54.816563 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:54.817832 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:54.819368 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:54.821748 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:54.821960 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:54.822194 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:54.822362 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:54.866957 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:38979
I20260709 12:25:54.867085 22097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:38979 every 8 connection(s)
I20260709 12:25:54.872159 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:54.879925 22102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:54.880894 22103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:54.884281 22105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:54.885967 20917 server_base.cc:1061] running on GCE node
I20260709 12:25:54.886950 22098 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41439
I20260709 12:25:54.887466 22098 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:54.887738 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:54.888151 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:54.888391 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599954888355 us; error 0 us; skew 500 ppm
I20260709 12:25:54.888589 22098 heartbeater.cc:507] Master 127.20.109.126:41439 requested a full tablet report, sending...
I20260709 12:25:54.889106 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:54.891438 21971 ts_manager.cc:194] Registered new tserver with Master: d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:25:54.893044 20917 webserver.cc:533] Webserver started at http://127.20.109.66:33817/ using document root <none> and password file <none>
I20260709 12:25:54.893749 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:54.893963 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:54.894079 21971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46372
I20260709 12:25:54.894260 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:54.895900 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/instance:
uuid: "67742f291ab04f8b8335d3919cf2d1f7"
format_stamp: "Formatted at 2026-07-09 12:25:54 on dist-test-slave-sc4p"
I20260709 12:25:54.900956 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:54.905484 22110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:54.906556 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:54.907013 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root
uuid: "67742f291ab04f8b8335d3919cf2d1f7"
format_stamp: "Formatted at 2026-07-09 12:25:54 on dist-test-slave-sc4p"
I20260709 12:25:54.907310 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:54.925086 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:54.926470 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:54.928016 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:54.930457 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:54.930735 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:25:54.930954 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:54.931084 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:54.975353 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.66:46283
I20260709 12:25:54.975488 22172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.66:46283 every 8 connection(s)
I20260709 12:25:54.980165 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:54.987016 22176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:54.988809 22177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:54.990945 22180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:54.994084 20917 server_base.cc:1061] running on GCE node
I20260709 12:25:54.994439 22173 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41439
I20260709 12:25:54.994920 22173 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:54.995195 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:54.995411 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:54.995630 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599954995610 us; error 0 us; skew 500 ppm
I20260709 12:25:54.995759 22173 heartbeater.cc:507] Master 127.20.109.126:41439 requested a full tablet report, sending...
I20260709 12:25:54.996206 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:54.998699 21971 ts_manager.cc:194] Registered new tserver with Master: 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:54.999176 20917 webserver.cc:533] Webserver started at http://127.20.109.67:35105/ using document root <none> and password file <none>
I20260709 12:25:54.999773 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:55.000026 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:55.000334 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:55.000550 21971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46388
I20260709 12:25:55.001752 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/instance:
uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
format_stamp: "Formatted at 2026-07-09 12:25:54 on dist-test-slave-sc4p"
I20260709 12:25:55.006153 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:25:55.009579 22184 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:55.010322 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:55.010635 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root
uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
format_stamp: "Formatted at 2026-07-09 12:25:54 on dist-test-slave-sc4p"
I20260709 12:25:55.010903 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:55.029729 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:55.031682 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:55.033597 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:55.036438 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:55.036679 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:55.036917 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:55.037079 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:55.079843 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.67:37787
I20260709 12:25:55.080263 22246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.67:37787 every 8 connection(s)
I20260709 12:25:55.094897 22247 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41439
I20260709 12:25:55.095463 22247 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:55.096508 22247 heartbeater.cc:507] Master 127.20.109.126:41439 requested a full tablet report, sending...
I20260709 12:25:55.098804 21971 ts_manager.cc:194] Registered new tserver with Master: ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:55.099614 20917 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016683189s
I20260709 12:25:55.100286 21971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46396
I20260709 12:25:55.128327 21971 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46400:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:55.134497 21971 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:55.334743 22138 tablet_service.cc:1511] Processing CreateTablet for tablet 66ebd42ef0064f2489bbc02ec3e9500b (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:55.336329 22138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ebd42ef0064f2489bbc02ec3e9500b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.339732 22137 tablet_service.cc:1511] Processing CreateTablet for tablet 9360ea2e8bd04bd899235529e921b05d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:55.341250 22137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9360ea2e8bd04bd899235529e921b05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.343909 22136 tablet_service.cc:1511] Processing CreateTablet for tablet ec5b05d9a0b94a05a3cdb04bbe7113b2 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:55.345355 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5b05d9a0b94a05a3cdb04bbe7113b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.348362 22135 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8326670393490f9fabe3827cd6d958 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:55.349941 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8326670393490f9fabe3827cd6d958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.351426 22133 tablet_service.cc:1511] Processing CreateTablet for tablet 5dae45fb2bfa401ab5a87bc3a8672e60 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:55.352396 22210 tablet_service.cc:1511] Processing CreateTablet for tablet ec5b05d9a0b94a05a3cdb04bbe7113b2 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:55.354099 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5b05d9a0b94a05a3cdb04bbe7113b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.353821 22134 tablet_service.cc:1511] Processing CreateTablet for tablet 5e537942a08e4c8fbf26a1a0084997c4 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:55.355791 22131 tablet_service.cc:1511] Processing CreateTablet for tablet e92d357da9e844b2ae270e73b28170db (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:55.356233 22212 tablet_service.cc:1511] Processing CreateTablet for tablet 66ebd42ef0064f2489bbc02ec3e9500b (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:55.357548 22212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ebd42ef0064f2489bbc02ec3e9500b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.359519 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8326670393490f9fabe3827cd6d958 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:55.360884 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8326670393490f9fabe3827cd6d958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.363305 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4753dcc01343d1b0ac9cef09e22af4 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:55.363665 22211 tablet_service.cc:1511] Processing CreateTablet for tablet 9360ea2e8bd04bd899235529e921b05d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:55.364866 22211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9360ea2e8bd04bd899235529e921b05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.367777 22132 tablet_service.cc:1511] Processing CreateTablet for tablet a71d215daee640dc8183aa5bb0a69a18 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:55.369985 22130 tablet_service.cc:1511] Processing CreateTablet for tablet ce0cbcda6ab94ef68d36321d19671059 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:55.373009 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 5e537942a08e4c8fbf26a1a0084997c4 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:55.374377 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e537942a08e4c8fbf26a1a0084997c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.375759 22207 tablet_service.cc:1511] Processing CreateTablet for tablet 5dae45fb2bfa401ab5a87bc3a8672e60 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:55.378751 22206 tablet_service.cc:1511] Processing CreateTablet for tablet a71d215daee640dc8183aa5bb0a69a18 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:55.381156 22205 tablet_service.cc:1511] Processing CreateTablet for tablet e92d357da9e844b2ae270e73b28170db (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:55.383749 22204 tablet_service.cc:1511] Processing CreateTablet for tablet ce0cbcda6ab94ef68d36321d19671059 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:55.385155 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e92d357da9e844b2ae270e73b28170db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.385825 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71d215daee640dc8183aa5bb0a69a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.385775 22203 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4753dcc01343d1b0ac9cef09e22af4 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:55.386533 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e537942a08e4c8fbf26a1a0084997c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.387228 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0cbcda6ab94ef68d36321d19671059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.389829 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71d215daee640dc8183aa5bb0a69a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.389874 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4753dcc01343d1b0ac9cef09e22af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.390869 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dae45fb2bfa401ab5a87bc3a8672e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.392584 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e92d357da9e844b2ae270e73b28170db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.393782 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dae45fb2bfa401ab5a87bc3a8672e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.394909 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0cbcda6ab94ef68d36321d19671059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.398981 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4753dcc01343d1b0ac9cef09e22af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.415830 22130 tablet_service.cc:1511] Processing CreateTablet for tablet 48a34f9ae8654955bc6eda7229323ca3 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:55.417330 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a34f9ae8654955bc6eda7229323ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.448187 22262 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:55.449288 22132 tablet_service.cc:1511] Processing CreateTablet for tablet f3c7f71fea4a4a6d815758ecce7a83cd (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:55.450661 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c7f71fea4a4a6d815758ecce7a83cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.444325 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 9bbdc6920d6f481f9edabac1f94774ff (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:55.451659 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bbdc6920d6f481f9edabac1f94774ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.444325 22210 tablet_service.cc:1511] Processing CreateTablet for tablet 48a34f9ae8654955bc6eda7229323ca3 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:55.454741 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a34f9ae8654955bc6eda7229323ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.461571 22263 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:55.455533 22204 tablet_service.cc:1511] Processing CreateTablet for tablet 9bbdc6920d6f481f9edabac1f94774ff (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:55.475082 22132 tablet_service.cc:1511] Processing CreateTablet for tablet cf2d9646522845819383a8daea185649 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:55.483419 22136 tablet_service.cc:1511] Processing CreateTablet for tablet f14db25b634d44dda22c20f58ac81a55 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:55.495889 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bbdc6920d6f481f9edabac1f94774ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.497350 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14db25b634d44dda22c20f58ac81a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.470530 22262 tablet_bootstrap.cc:654] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.488095 22211 tablet_service.cc:1511] Processing CreateTablet for tablet cf2d9646522845819383a8daea185649 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:55.499832 22211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2d9646522845819383a8daea185649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.501076 22130 tablet_service.cc:1511] Processing CreateTablet for tablet 68d18246b3984c719bedcfe7da84c5c5 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:55.499715 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2d9646522845819383a8daea185649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.506526 22263 tablet_bootstrap.cc:654] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.511567 22131 tablet_service.cc:1511] Processing CreateTablet for tablet 03eee184731a4ec1bf7ba98505a56567 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:55.514441 22138 tablet_service.cc:1511] Processing CreateTablet for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:55.518056 22208 tablet_service.cc:1511] Processing CreateTablet for tablet f14db25b634d44dda22c20f58ac81a55 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:55.523805 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14db25b634d44dda22c20f58ac81a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.477828 22210 tablet_service.cc:1511] Processing CreateTablet for tablet f3c7f71fea4a4a6d815758ecce7a83cd (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:55.531761 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c7f71fea4a4a6d815758ecce7a83cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.551445 22063 tablet_service.cc:1511] Processing CreateTablet for tablet 66ebd42ef0064f2489bbc02ec3e9500b (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:55.553351 22063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ebd42ef0064f2489bbc02ec3e9500b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.553978 22056 tablet_service.cc:1511] Processing CreateTablet for tablet e92d357da9e844b2ae270e73b28170db (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:55.554457 22062 tablet_service.cc:1511] Processing CreateTablet for tablet 9360ea2e8bd04bd899235529e921b05d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:55.555732 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e92d357da9e844b2ae270e73b28170db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.557173 22061 tablet_service.cc:1511] Processing CreateTablet for tablet ec5b05d9a0b94a05a3cdb04bbe7113b2 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:55.559696 22059 tablet_service.cc:1511] Processing CreateTablet for tablet 5e537942a08e4c8fbf26a1a0084997c4 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:55.551391 22137 tablet_service.cc:1511] Processing CreateTablet for tablet 953fcacc5a2943eeb23356e2f1c2cc5f (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:55.560796 22212 tablet_service.cc:1511] Processing CreateTablet for tablet 03eee184731a4ec1bf7ba98505a56567 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:55.562150 22212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03eee184731a4ec1bf7ba98505a56567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.562036 22058 tablet_service.cc:1511] Processing CreateTablet for tablet 5dae45fb2bfa401ab5a87bc3a8672e60 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:55.563678 22133 tablet_service.cc:1511] Processing CreateTablet for tablet 0007b92daafb42eda8843693014ea1d1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:55.564303 22057 tablet_service.cc:1511] Processing CreateTablet for tablet a71d215daee640dc8183aa5bb0a69a18 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:55.567132 22262 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:55.567631 22262 ts_tablet_manager.cc:1403] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.000s
I20260709 12:25:55.568042 22207 tablet_service.cc:1511] Processing CreateTablet for tablet 68d18246b3984c719bedcfe7da84c5c5 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:55.569381 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d18246b3984c719bedcfe7da84c5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.540541 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d18246b3984c719bedcfe7da84c5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.570922 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5b05d9a0b94a05a3cdb04bbe7113b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.571787 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8326670393490f9fabe3827cd6d958 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:55.575232 22055 tablet_service.cc:1511] Processing CreateTablet for tablet ce0cbcda6ab94ef68d36321d19671059 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:55.577960 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dae45fb2bfa401ab5a87bc3a8672e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.579303 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71d215daee640dc8183aa5bb0a69a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.580525 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e537942a08e4c8fbf26a1a0084997c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.581734 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8326670393490f9fabe3827cd6d958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.584276 22062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9360ea2e8bd04bd899235529e921b05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.586925 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0cbcda6ab94ef68d36321d19671059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.572781 22137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953fcacc5a2943eeb23356e2f1c2cc5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.586249 22129 tablet_service.cc:1511] Processing CreateTablet for tablet de6d6e7c5d4c484487206e2d8b43cebf (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:55.594981 22262 raft_consensus.cc:359] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:55.596432 22262 raft_consensus.cc:385] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.596743 22262 raft_consensus.cc:740] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.597467 22262 consensus_queue.cc:260] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:55.602317 22138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.611430 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6d6e7c5d4c484487206e2d8b43cebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.613438 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 953fcacc5a2943eeb23356e2f1c2cc5f (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:55.614460 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03eee184731a4ec1bf7ba98505a56567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.614835 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953fcacc5a2943eeb23356e2f1c2cc5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.615795 22054 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4753dcc01343d1b0ac9cef09e22af4 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:55.619010 22262 ts_tablet_manager.cc:1434] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.005s
I20260709 12:25:55.623446 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0007b92daafb42eda8843693014ea1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.626842 22263 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:55.627372 22263 ts_tablet_manager.cc:1403] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.166s	user 0.028s	sys 0.019s
I20260709 12:25:55.636440 22173 heartbeater.cc:499] Master 127.20.109.126:41439 was elected leader, sending a full tablet report...
I20260709 12:25:55.639009 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4753dcc01343d1b0ac9cef09e22af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.636616 22262 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:55.644644 22263 raft_consensus.cc:359] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:55.660543 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 48a34f9ae8654955bc6eda7229323ca3 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:55.613945 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:55.670849 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.670851 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a34f9ae8654955bc6eda7229323ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.678580 22267 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:55.686082 22063 tablet_service.cc:1511] Processing CreateTablet for tablet 9bbdc6920d6f481f9edabac1f94774ff (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:55.687486 22063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bbdc6920d6f481f9edabac1f94774ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.703648 22134 tablet_service.cc:1511] Processing CreateTablet for tablet f775ac681f8f42d3a3a16bf664e0bee7 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:55.707650 22267 tablet_bootstrap.cc:654] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.708274 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f775ac681f8f42d3a3a16bf664e0bee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.715013 22204 tablet_service.cc:1511] Processing CreateTablet for tablet de6d6e7c5d4c484487206e2d8b43cebf (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:55.716434 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6d6e7c5d4c484487206e2d8b43cebf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:55.717446 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:55.721185 22203 tablet_service.cc:1511] Processing CreateTablet for tablet f775ac681f8f42d3a3a16bf664e0bee7 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:55.724723 22136 tablet_service.cc:1511] Processing CreateTablet for tablet b155a7c146564fdbb5330057eca55fd8 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:55.726100 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b155a7c146564fdbb5330057eca55fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.727521 22062 tablet_service.cc:1511] Processing CreateTablet for tablet f3c7f71fea4a4a6d815758ecce7a83cd (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:55.728843 22062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c7f71fea4a4a6d815758ecce7a83cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.728793 22212 tablet_service.cc:1511] Processing CreateTablet for tablet b155a7c146564fdbb5330057eca55fd8 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:55.729733 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 57757a075ae444bf9e3ae62e6892f42a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:55.731020 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57757a075ae444bf9e3ae62e6892f42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.737048 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 0a00dfd4bb864cbe94033b53b925fd76 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:55.669637 22263 raft_consensus.cc:385] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.738166 22263 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.684254 22205 tablet_service.cc:1511] Processing CreateTablet for tablet 0007b92daafb42eda8843693014ea1d1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:55.739511 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a00dfd4bb864cbe94033b53b925fd76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.746784 22058 tablet_service.cc:1511] Processing CreateTablet for tablet 03eee184731a4ec1bf7ba98505a56567 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:55.739228 22263 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:55.748104 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03eee184731a4ec1bf7ba98505a56567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.745273 22054 tablet_service.cc:1511] Processing CreateTablet for tablet cf2d9646522845819383a8daea185649 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:55.745498 22056 tablet_service.cc:1511] Processing CreateTablet for tablet f14db25b634d44dda22c20f58ac81a55 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:55.755425 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14db25b634d44dda22c20f58ac81a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.769215 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 0a00dfd4bb864cbe94033b53b925fd76 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:55.771504 22130 tablet_service.cc:1511] Processing CreateTablet for tablet 52ee10bae8ef4b668f33b9ef12e13a6a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:55.772831 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ee10bae8ef4b668f33b9ef12e13a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.752981 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f775ac681f8f42d3a3a16bf664e0bee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.786073 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0007b92daafb42eda8843693014ea1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.786923 22212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b155a7c146564fdbb5330057eca55fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.791766 22262 tablet_bootstrap.cc:654] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.796110 22263 ts_tablet_manager.cc:1434] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.167s	user 0.013s	sys 0.011s
I20260709 12:25:55.797298 22135 tablet_service.cc:1511] Processing CreateTablet for tablet 754c2d759050420898a081f3dfa0a18c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:55.796110 22207 tablet_service.cc:1511] Processing CreateTablet for tablet 52ee10bae8ef4b668f33b9ef12e13a6a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:55.804688 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754c2d759050420898a081f3dfa0a18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.806883 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2d9646522845819383a8daea185649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.814466 22267 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:55.815001 22267 ts_tablet_manager.cc:1403] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.137s	user 0.008s	sys 0.004s
I20260709 12:25:55.815318 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 754c2d759050420898a081f3dfa0a18c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:55.811290 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a00dfd4bb864cbe94033b53b925fd76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.821429 22247 heartbeater.cc:499] Master 127.20.109.126:41439 was elected leader, sending a full tablet report...
I20260709 12:25:55.824420 22138 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3632e739cf449a83c07dcdbce1528c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:55.825852 22138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3632e739cf449a83c07dcdbce1528c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.826939 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754c2d759050420898a081f3dfa0a18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.827201 22061 tablet_service.cc:1511] Processing CreateTablet for tablet 68d18246b3984c719bedcfe7da84c5c5 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:55.828528 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d18246b3984c719bedcfe7da84c5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.831175 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:55.832567 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 953fcacc5a2943eeb23356e2f1c2cc5f (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:55.840636 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953fcacc5a2943eeb23356e2f1c2cc5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.844807 22137 tablet_service.cc:1511] Processing CreateTablet for tablet b35bc73fc9544276942bc2c3ee41e639 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:55.846321 22137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35bc73fc9544276942bc2c3ee41e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.837397 22210 tablet_service.cc:1511] Processing CreateTablet for tablet 57757a075ae444bf9e3ae62e6892f42a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:55.818077 22267 raft_consensus.cc:359] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:55.857625 22211 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3632e739cf449a83c07dcdbce1528c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:55.857625 22056 tablet_service.cc:1511] Processing CreateTablet for tablet 0007b92daafb42eda8843693014ea1d1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:55.850657 22267 raft_consensus.cc:385] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.864480 22267 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.868434 22267 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:55.897152 22098 heartbeater.cc:499] Master 127.20.109.126:41439 was elected leader, sending a full tablet report...
I20260709 12:25:55.901623 22131 tablet_service.cc:1511] Processing CreateTablet for tablet a2d181824b34483d8653c405c650ec94 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:55.903394 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d181824b34483d8653c405c650ec94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.905175 22134 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9cf5f021f44b55831f1ed964025c7e (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:55.907002 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9cf5f021f44b55831f1ed964025c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.907454 22133 tablet_service.cc:1511] Processing CreateTablet for tablet cecfaeb2287f4f7db4bee651c8bc4a36 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:55.908794 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecfaeb2287f4f7db4bee651c8bc4a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.915902 22136 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae34788927d43db8e0aa62c5dae8dd9 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:55.917270 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae34788927d43db8e0aa62c5dae8dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.923730 22059 tablet_service.cc:1511] Processing CreateTablet for tablet de6d6e7c5d4c484487206e2d8b43cebf (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:55.927773 22208 tablet_service.cc:1511] Processing CreateTablet for tablet a2d181824b34483d8653c405c650ec94 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:55.930687 22057 tablet_service.cc:1511] Processing CreateTablet for tablet f775ac681f8f42d3a3a16bf664e0bee7 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:55.938942 22206 tablet_service.cc:1511] Processing CreateTablet for tablet b35bc73fc9544276942bc2c3ee41e639 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:55.945870 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7ac68dfb384745935240b56803f52c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:55.946748 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ee10bae8ef4b668f33b9ef12e13a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.947276 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7ac68dfb384745935240b56803f52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.865383 22263 tablet_bootstrap.cc:492] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:55.952255 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0007b92daafb42eda8843693014ea1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.970114 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.971575 22054 tablet_service.cc:1511] Processing CreateTablet for tablet b155a7c146564fdbb5330057eca55fd8 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:55.973150 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b155a7c146564fdbb5330057eca55fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.983791 22211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3632e739cf449a83c07dcdbce1528c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.983956 22063 tablet_service.cc:1511] Processing CreateTablet for tablet 57757a075ae444bf9e3ae62e6892f42a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:55.984613 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57757a075ae444bf9e3ae62e6892f42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.987291 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d181824b34483d8653c405c650ec94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.999457 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6d6e7c5d4c484487206e2d8b43cebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.999825 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 0a00dfd4bb864cbe94033b53b925fd76 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:56.000185 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35bc73fc9544276942bc2c3ee41e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.014830 22262 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:56.015398 22263 tablet_bootstrap.cc:654] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.015586 22262 ts_tablet_manager.cc:1403] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.379s	user 0.046s	sys 0.054s
I20260709 12:25:56.018718 22262 raft_consensus.cc:359] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.019447 22262 raft_consensus.cc:385] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.019734 22262 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.021378 22262 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.028319 22269 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.030262 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a00dfd4bb864cbe94033b53b925fd76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.030400 22269 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.035934 22262 ts_tablet_manager.cc:1434] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:25:56.037031 22262 tablet_bootstrap.cc:492] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:56.038183 22269 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:56.052857 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 2601e033c5b34310a9d1582b3d94c3aa (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:56.054273 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2601e033c5b34310a9d1582b3d94c3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.055218 22271 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.055706 22271 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.076122 22267 ts_tablet_manager.cc:1434] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.261s	user 0.043s	sys 0.026s
I20260709 12:25:56.077179 22062 tablet_service.cc:1511] Processing CreateTablet for tablet 52ee10bae8ef4b668f33b9ef12e13a6a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:56.077723 22267 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:56.069075 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f775ac681f8f42d3a3a16bf664e0bee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.098446 22263 tablet_bootstrap.cc:492] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:56.085896 22271 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:56.099264 22263 ts_tablet_manager.cc:1403] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.250s	user 0.024s	sys 0.011s
I20260709 12:25:56.114293 22063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57757a075ae444bf9e3ae62e6892f42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.123750 22266 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.124310 22266 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.125466 22130 tablet_service.cc:1511] Processing CreateTablet for tablet 4321547cceb341b9babe64debb9fb125 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:56.119418 22262 tablet_bootstrap.cc:654] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.138803 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4321547cceb341b9babe64debb9fb125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.140115 22062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ee10bae8ef4b668f33b9ef12e13a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.149039 22203 tablet_service.cc:1511] Processing CreateTablet for tablet cecfaeb2287f4f7db4bee651c8bc4a36 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:56.151021 22266 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:56.151611 22204 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9cf5f021f44b55831f1ed964025c7e (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:56.154016 22212 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae34788927d43db8e0aa62c5dae8dd9 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:56.168879 22058 tablet_service.cc:1511] Processing CreateTablet for tablet 754c2d759050420898a081f3dfa0a18c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:56.190810 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecfaeb2287f4f7db4bee651c8bc4a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.198635 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:25:56.213534 22036 leader_election.cc:343] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.214169 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754c2d759050420898a081f3dfa0a18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.233434 22207 tablet_service.cc:1511] Processing CreateTablet for tablet 4321547cceb341b9babe64debb9fb125 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:56.235741 22131 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd4242f251b46f1a7e47490973fd53c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:56.237258 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd4242f251b46f1a7e47490973fd53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.239151 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9cf5f021f44b55831f1ed964025c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.241153 22267 tablet_bootstrap.cc:654] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.205978 22263 raft_consensus.cc:359] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.246174 22263 raft_consensus.cc:385] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.253705 22263 raft_consensus.cc:740] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.254670 22263 consensus_queue.cc:260] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.256831 22263 ts_tablet_manager.cc:1434] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.148s	user 0.003s	sys 0.003s
I20260709 12:25:56.257813 22212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae34788927d43db8e0aa62c5dae8dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.256474 22063 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3632e739cf449a83c07dcdbce1528c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:56.259084 22063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3632e739cf449a83c07dcdbce1528c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.246222 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7ac68dfb384745935240b56803f52c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:56.272951 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7ac68dfb384745935240b56803f52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.273520 22130 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:56.274868 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.275943 22059 tablet_service.cc:1511] Processing CreateTablet for tablet a2d181824b34483d8653c405c650ec94 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:56.277189 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d181824b34483d8653c405c650ec94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.277567 22054 tablet_service.cc:1511] Processing CreateTablet for tablet cecfaeb2287f4f7db4bee651c8bc4a36 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:56.273648 22061 tablet_service.cc:1511] Processing CreateTablet for tablet b35bc73fc9544276942bc2c3ee41e639 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:56.283461 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecfaeb2287f4f7db4bee651c8bc4a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.279100 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 2601e033c5b34310a9d1582b3d94c3aa (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:56.280253 22138 tablet_service.cc:1511] Processing CreateTablet for tablet e7199ba25bca48e89b961cf6ef78ab28 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:56.283306 22135 tablet_service.cc:1511] Processing CreateTablet for tablet 161e19d23ae64fb1919e4e43e3e26bd3 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:56.291123 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161e19d23ae64fb1919e4e43e3e26bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.278661 22263 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:56.289686 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2601e033c5b34310a9d1582b3d94c3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.296088 22138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7199ba25bca48e89b961cf6ef78ab28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.307581 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35bc73fc9544276942bc2c3ee41e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.312105 22205 tablet_service.cc:1511] Processing CreateTablet for tablet e7199ba25bca48e89b961cf6ef78ab28 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:56.318337 22062 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7ac68dfb384745935240b56803f52c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:56.312708 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:56.319583 22148 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:25:56.321084 22185 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:25:56.322053 22269 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.322402 22269 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.322734 22269 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.315812 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 161e19d23ae64fb1919e4e43e3e26bd3 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:56.331214 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7199ba25bca48e89b961cf6ef78ab28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.335363 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161e19d23ae64fb1919e4e43e3e26bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.335630 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:56.315809 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9cf5f021f44b55831f1ed964025c7e (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:56.339174 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:56.341014 22114 leader_election.cc:343] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:56.342260 22038 leader_election.cc:343] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.342779 22038 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:56.343966 22271 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.344560 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 9f20d90a634149ef85ae0b05adb8a34a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:56.345252 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4321547cceb341b9babe64debb9fb125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.345983 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f20d90a634149ef85ae0b05adb8a34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.347656 22062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7ac68dfb384745935240b56803f52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.348577 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9cf5f021f44b55831f1ed964025c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.363140 22262 tablet_bootstrap.cc:492] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:56.363723 22262 ts_tablet_manager.cc:1403] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.327s	user 0.013s	sys 0.014s
I20260709 12:25:56.363929 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:56.367242 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae34788927d43db8e0aa62c5dae8dd9 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:56.368113 22262 raft_consensus.cc:359] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:56.366310 22188 leader_election.cc:343] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.368808 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae34788927d43db8e0aa62c5dae8dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.369100 22262 raft_consensus.cc:385] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.372928 22262 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.373937 22262 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.379370 22211 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd4242f251b46f1a7e47490973fd53c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:56.380980 22211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd4242f251b46f1a7e47490973fd53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.384593 22262 ts_tablet_manager.cc:1434] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:25:56.387460 22137 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec6cbbf70dc43daa892eda3ef90f702 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:56.388867 22137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec6cbbf70dc43daa892eda3ef90f702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.390744 22057 tablet_service.cc:1511] Processing CreateTablet for tablet 2601e033c5b34310a9d1582b3d94c3aa (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:56.392127 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2601e033c5b34310a9d1582b3d94c3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.398100 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:56.399887 22113 leader_election.cc:343] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.400384 22113 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:56.401345 22266 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.400619 22263 tablet_bootstrap.cc:654] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.407296 22058 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd4242f251b46f1a7e47490973fd53c (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:56.412319 22269 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.414395 22262 tablet_bootstrap.cc:492] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:56.418835 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:56.419569 22148 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.408339 22210 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:56.428015 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:56.427809 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 9f20d90a634149ef85ae0b05adb8a34a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 12:25:56.429553 22188 leader_election.cc:343] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.430477 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd4242f251b46f1a7e47490973fd53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.432783 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 4321547cceb341b9babe64debb9fb125 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:56.436012 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4321547cceb341b9babe64debb9fb125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.439896 22204 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec6cbbf70dc43daa892eda3ef90f702 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:56.445786 22056 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:56.448019 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.452195 22262 tablet_bootstrap.cc:654] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.453810 22061 tablet_service.cc:1511] Processing CreateTablet for tablet e7199ba25bca48e89b961cf6ef78ab28 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:56.454909 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f20d90a634149ef85ae0b05adb8a34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.454180 22148 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:25:56.475867 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 39f024f1dc1c4aaaa8094ad37822a6e1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:56.451339 22269 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:56.479887 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.481769 22263 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:56.482309 22263 ts_tablet_manager.cc:1403] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.204s	user 0.010s	sys 0.008s
I20260709 12:25:56.482616 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 9f20d90a634149ef85ae0b05adb8a34a (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:56.483924 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f20d90a634149ef85ae0b05adb8a34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.486953 22263 raft_consensus.cc:359] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.487707 22263 raft_consensus.cc:385] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.487999 22263 raft_consensus.cc:740] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.488575 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec6cbbf70dc43daa892eda3ef90f702 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:56.488766 22263 consensus_queue.cc:260] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.489936 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec6cbbf70dc43daa892eda3ef90f702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.491001 22185 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:25:56.495451 22063 tablet_service.cc:1511] Processing CreateTablet for tablet 161e19d23ae64fb1919e4e43e3e26bd3 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:56.516906 22063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161e19d23ae64fb1919e4e43e3e26bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.495407 22212 tablet_service.cc:1511] Processing CreateTablet for tablet f3726200783e487b9963f5fc73170d31 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:56.517859 22203 tablet_service.cc:1511] Processing CreateTablet for tablet 12cca886b64e4c138e59114be95a8549 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:56.496089 22133 tablet_service.cc:1511] Processing CreateTablet for tablet ee09151218d04cb69512d91f7b843c32 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:56.519925 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee09151218d04cb69512d91f7b843c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.497455 22266 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.521704 22266 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.522713 22054 tablet_service.cc:1511] Processing CreateTablet for tablet 39f024f1dc1c4aaaa8094ad37822a6e1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:56.523871 22266 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:56.499593 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 7befabab572c4ed8832b542ff35c0ee1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:56.524497 22057 tablet_service.cc:1511] Processing CreateTablet for tablet f3726200783e487b9963f5fc73170d31 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:56.525897 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befabab572c4ed8832b542ff35c0ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.527954 22137 tablet_service.cc:1511] Processing CreateTablet for tablet 26519f93f2144612acf259d481dc4485 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:56.529235 22137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26519f93f2144612acf259d481dc4485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.504168 22136 tablet_service.cc:1511] Processing CreateTablet for tablet 451d96b5461b4c21aa4930657c835b50 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:56.530763 22130 tablet_service.cc:1511] Processing CreateTablet for tablet b9f4ba2e44d142d4810d14babd35c984 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:56.531903 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451d96b5461b4c21aa4930657c835b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.533756 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f4ba2e44d142d4810d14babd35c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.507797 22134 tablet_service.cc:1511] Processing CreateTablet for tablet 12cca886b64e4c138e59114be95a8549 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:56.514168 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec6cbbf70dc43daa892eda3ef90f702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.534999 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:56.535770 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cca886b64e4c138e59114be95a8549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.507603 22267 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:56.536394 22267 ts_tablet_manager.cc:1403] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.459s	user 0.030s	sys 0.016s
I20260709 12:25:56.537912 22212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3726200783e487b9963f5fc73170d31. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:56.539911 22114 leader_election.cc:343] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.541404 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:56.543040 22113 leader_election.cc:343] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.543488 22113 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:56.546013 22266 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.548974 22267 raft_consensus.cc:359] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.549774 22267 raft_consensus.cc:385] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.550125 22267 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.499369 22209 tablet_service.cc:1511] Processing CreateTablet for tablet ee09151218d04cb69512d91f7b843c32 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:56.501397 22138 tablet_service.cc:1511] Processing CreateTablet for tablet f3726200783e487b9963f5fc73170d31 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:56.562207 22138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3726200783e487b9963f5fc73170d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.518481 22269 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.496318 22131 tablet_service.cc:1511] Processing CreateTablet for tablet 39f024f1dc1c4aaaa8094ad37822a6e1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:56.524022 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f024f1dc1c4aaaa8094ad37822a6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.533464 22059 tablet_service.cc:1511] Processing CreateTablet for tablet ee09151218d04cb69512d91f7b843c32 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:56.508992 22205 tablet_service.cc:1511] Processing CreateTablet for tablet 7befabab572c4ed8832b542ff35c0ee1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:56.510831 22207 tablet_service.cc:1511] Processing CreateTablet for tablet 451d96b5461b4c21aa4930657c835b50 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:56.558772 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee09151218d04cb69512d91f7b843c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.570869 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 26519f93f2144612acf259d481dc4485 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:56.571305 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f024f1dc1c4aaaa8094ad37822a6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.576180 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 12cca886b64e4c138e59114be95a8549 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:56.577442 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cca886b64e4c138e59114be95a8549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.578090 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 369b15e6e4254982a559940734df1656 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:56.579296 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451d96b5461b4c21aa4930657c835b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.579377 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369b15e6e4254982a559940734df1656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.580715 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befabab572c4ed8832b542ff35c0ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.588485 22267 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.605347 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7199ba25bca48e89b961cf6ef78ab28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.614287 22211 tablet_service.cc:1511] Processing CreateTablet for tablet b9f4ba2e44d142d4810d14babd35c984 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:56.619693 22135 tablet_service.cc:1511] Processing CreateTablet for tablet 2772ed1f79a846e3852654dad2c86235 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:56.606865 22267 ts_tablet_manager.cc:1434] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.002s
I20260709 12:25:56.622690 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f024f1dc1c4aaaa8094ad37822a6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.624739 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 26519f93f2144612acf259d481dc4485 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:56.634002 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee09151218d04cb69512d91f7b843c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.635408 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3726200783e487b9963f5fc73170d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.641420 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26519f93f2144612acf259d481dc4485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.643206 22210 tablet_service.cc:1511] Processing CreateTablet for tablet 369b15e6e4254982a559940734df1656 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:56.645871 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2772ed1f79a846e3852654dad2c86235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.646071 22262 tablet_bootstrap.cc:492] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:56.640882 22058 tablet_service.cc:1511] Processing CreateTablet for tablet 7befabab572c4ed8832b542ff35c0ee1 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:56.666754 22267 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:56.629299 22269 raft_consensus.cc:697] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:25:56.653343 22290 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.657923 22263 ts_tablet_manager.cc:1434] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.175s	user 0.021s	sys 0.023s
I20260709 12:25:56.660707 22262 ts_tablet_manager.cc:1403] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.247s	user 0.008s	sys 0.008s
I20260709 12:25:56.661082 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cca886b64e4c138e59114be95a8549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.671059 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befabab572c4ed8832b542ff35c0ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.670634 22062 tablet_service.cc:1511] Processing CreateTablet for tablet 451d96b5461b4c21aa4930657c835b50 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:56.695333 22263 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:56.681145 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26519f93f2144612acf259d481dc4485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.705705 22136 tablet_service.cc:1511] Processing CreateTablet for tablet ca62bb8242354d418721b86a9b704e37 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:56.707087 22063 tablet_service.cc:1511] Processing CreateTablet for tablet b9f4ba2e44d142d4810d14babd35c984 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:56.713178 22056 tablet_service.cc:1511] Processing CreateTablet for tablet 369b15e6e4254982a559940734df1656 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:56.718767 22134 tablet_service.cc:1511] Processing CreateTablet for tablet 838948750f334b409ad4d7798a822e6d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:56.669340 22290 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:56.720749 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:56.721392 22290 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:56.722572 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:56.723140 22212 tablet_service.cc:1511] Processing CreateTablet for tablet 2772ed1f79a846e3852654dad2c86235 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 12:25:56.724151 22188 leader_election.cc:343] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.714725 22054 tablet_service.cc:1511] Processing CreateTablet for tablet 2772ed1f79a846e3852654dad2c86235 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:56.725205 22263 tablet_bootstrap.cc:654] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.725534 22212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2772ed1f79a846e3852654dad2c86235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.731705 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369b15e6e4254982a559940734df1656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.734107 22209 tablet_service.cc:1511] Processing CreateTablet for tablet ca62bb8242354d418721b86a9b704e37 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:56.735695 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca62bb8242354d418721b86a9b704e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.747573 22211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f4ba2e44d142d4810d14babd35c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.751096 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca62bb8242354d418721b86a9b704e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.750809 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:25:56.752707 22185 leader_election.cc:343] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.753505 22185 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:25:56.757225 22290 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.781855 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838948750f334b409ad4d7798a822e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.782519 22204 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd1d178990d44f78512d81cdacd6b1d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:56.783962 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd1d178990d44f78512d81cdacd6b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.785955 22203 tablet_service.cc:1511] Processing CreateTablet for tablet 838948750f334b409ad4d7798a822e6d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:56.787514 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838948750f334b409ad4d7798a822e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.788787 22271 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.789294 22271 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.791776 22271 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:56.793457 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfcc23bf9854a5e8cf97a83c188f631 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:56.793851 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:56.794687 22148 raft_consensus.cc:2393] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:25:56.793409 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:56.731000 22062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451d96b5461b4c21aa4930657c835b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.706161 22262 raft_consensus.cc:359] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.797544 22038 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:56.803608 22061 tablet_service.cc:1511] Processing CreateTablet for tablet 838948750f334b409ad4d7798a822e6d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:56.814779 22262 raft_consensus.cc:385] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.815158 22262 raft_consensus.cc:740] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.816200 22271 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.804420 22137 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfcc23bf9854a5e8cf97a83c188f631 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:56.810961 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369b15e6e4254982a559940734df1656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.816087 22262 consensus_queue.cc:260] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.822705 22207 tablet_service.cc:1511] Processing CreateTablet for tablet 79fd945ff0ce4fa4a9967036f06d82f7 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:56.813176 22059 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd1d178990d44f78512d81cdacd6b1d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:56.818312 22138 tablet_service.cc:1511] Processing CreateTablet for tablet 147ee46d74a94d69bbe00644cd192cc2 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:56.827778 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 79fd945ff0ce4fa4a9967036f06d82f7 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:56.828212 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfcc23bf9854a5e8cf97a83c188f631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.829519 22130 tablet_service.cc:1511] Processing CreateTablet for tablet 980127ed884f4554a2daf41b92732061 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:56.824373 22269 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.835005 22133 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd1d178990d44f78512d81cdacd6b1d (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:56.809281 22057 tablet_service.cc:1511] Processing CreateTablet for tablet ca62bb8242354d418721b86a9b704e37 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:56.841809 22138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147ee46d74a94d69bbe00644cd192cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.829463 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2772ed1f79a846e3852654dad2c86235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.815110 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfcc23bf9854a5e8cf97a83c188f631 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:56.851318 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fd945ff0ce4fa4a9967036f06d82f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:56.855509 22248 tablet.cc:2406] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:56.860085 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838948750f334b409ad4d7798a822e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.858938 22058 tablet_service.cc:1511] Processing CreateTablet for tablet 79fd945ff0ce4fa4a9967036f06d82f7 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:56.873667 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd1d178990d44f78512d81cdacd6b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.875136 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980127ed884f4554a2daf41b92732061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.876438 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca62bb8242354d418721b86a9b704e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.878041 22137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfcc23bf9854a5e8cf97a83c188f631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.878896 22291 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.879467 22291 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:56.882119 22291 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:56.882344 22267 tablet_bootstrap.cc:654] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.882647 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:25:56.887341 22185 leader_election.cc:343] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.888047 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:56.888829 22205 tablet_service.cc:1511] Processing CreateTablet for tablet 147ee46d74a94d69bbe00644cd192cc2 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:56.890276 22263 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:56.892886 22263 ts_tablet_manager.cc:1403] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.198s	user 0.033s	sys 0.044s
I20260709 12:25:56.894083 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd1d178990d44f78512d81cdacd6b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.894824 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fd945ff0ce4fa4a9967036f06d82f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.890218 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147ee46d74a94d69bbe00644cd192cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.906668 22063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f4ba2e44d142d4810d14babd35c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.894114 22271 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.873543 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 980127ed884f4554a2daf41b92732061 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:56.909929 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980127ed884f4554a2daf41b92732061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.918978 22262 ts_tablet_manager.cc:1434] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.242s	user 0.008s	sys 0.000s
I20260709 12:25:56.926730 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fd945ff0ce4fa4a9967036f06d82f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:56.928375 22188 leader_election.cc:343] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.937362 22188 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:25:56.938191 22291 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.943214 21969 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:56.943082 22262 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:56.960736 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfcc23bf9854a5e8cf97a83c188f631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.967157 22263 raft_consensus.cc:359] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.009627 22263 raft_consensus.cc:385] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.021090 22267 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.024335 22263 raft_consensus.cc:740] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.025251 22263 consensus_queue.cc:260] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.027674 22263 ts_tablet_manager.cc:1434] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.000s
I20260709 12:25:57.028595 22263 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.030912 22267 ts_tablet_manager.cc:1403] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.364s	user 0.015s	sys 0.013s
I20260709 12:25:57.031790 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 147ee46d74a94d69bbe00644cd192cc2 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:57.033660 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147ee46d74a94d69bbe00644cd192cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.034582 22267 raft_consensus.cc:359] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.035369 22267 raft_consensus.cc:385] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.035661 22267 raft_consensus.cc:740] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.040616 22262 tablet_bootstrap.cc:654] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.044065 22267 consensus_queue.cc:260] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.050699 22267 ts_tablet_manager.cc:1434] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:25:57.051745 22267 tablet_bootstrap.cc:492] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.053750 22056 tablet_service.cc:1511] Processing CreateTablet for tablet 980127ed884f4554a2daf41b92732061 (DEFAULT_TABLE table=test-workload [id=f1d199587aa4493fb71a378ad45a97a4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:57.055086 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980127ed884f4554a2daf41b92732061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.066288 22267 tablet_bootstrap.cc:654] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.115605 22262 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.117194 22262 ts_tablet_manager.cc:1403] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.174s	user 0.020s	sys 0.012s
I20260709 12:25:57.121511 22267 tablet_bootstrap.cc:492] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.122061 22267 ts_tablet_manager.cc:1403] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.012s
I20260709 12:25:57.122586 22263 tablet_bootstrap.cc:654] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.124809 22267 raft_consensus.cc:359] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.125540 22267 raft_consensus.cc:385] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.125865 22267 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.124140 22262 raft_consensus.cc:359] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.126968 22262 raft_consensus.cc:385] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.127233 22262 raft_consensus.cc:740] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.127583 22267 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.128288 22262 consensus_queue.cc:260] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.129524 22263 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.129994 22263 ts_tablet_manager.cc:1403] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.000s
I20260709 12:25:57.130669 22262 ts_tablet_manager.cc:1434] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 12:25:57.131618 22262 tablet_bootstrap.cc:492] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.133685 22267 ts_tablet_manager.cc:1434] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:25:57.134743 22267 tablet_bootstrap.cc:492] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.136086 22263 raft_consensus.cc:359] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.138679 22263 raft_consensus.cc:385] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.139073 22263 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.139861 22263 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.137707 22262 tablet_bootstrap.cc:654] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.141746 22267 tablet_bootstrap.cc:654] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.142331 22263 ts_tablet_manager.cc:1434] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:25:57.143471 22263 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.150779 22263 tablet_bootstrap.cc:654] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.153780 22267 tablet_bootstrap.cc:492] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.154312 22267 ts_tablet_manager.cc:1403] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:25:57.157949 22267 raft_consensus.cc:359] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.158958 22267 raft_consensus.cc:385] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.159269 22267 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.160130 22267 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.162626 22267 ts_tablet_manager.cc:1434] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:57.163723 22267 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.170392 22267 tablet_bootstrap.cc:654] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.174233 22263 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.177409 22263 ts_tablet_manager.cc:1403] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.017s
I20260709 12:25:57.178684 22262 tablet_bootstrap.cc:492] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.179190 22262 ts_tablet_manager.cc:1403] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.020s
I20260709 12:25:57.180114 22263 raft_consensus.cc:359] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.180934 22263 raft_consensus.cc:385] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.181232 22263 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.182040 22263 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.182335 22262 raft_consensus.cc:359] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.184116 22262 raft_consensus.cc:385] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.184571 22262 raft_consensus.cc:740] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.185148 22263 ts_tablet_manager.cc:1434] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:57.185688 22262 consensus_queue.cc:260] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.186506 22263 tablet_bootstrap.cc:492] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.186800 22267 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.187397 22267 ts_tablet_manager.cc:1403] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.010s
I20260709 12:25:57.189321 22262 ts_tablet_manager.cc:1434] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:25:57.190490 22267 raft_consensus.cc:359] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.191357 22267 raft_consensus.cc:385] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.191743 22267 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.192682 22267 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.195125 22267 ts_tablet_manager.cc:1434] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:57.195861 22263 tablet_bootstrap.cc:654] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.195892 22271 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.196542 22271 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.198807 22271 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.199801 22267 tablet_bootstrap.cc:492] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.203241 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:57.205083 22038 leader_election.cc:343] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.206182 22262 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.207072 22267 tablet_bootstrap.cc:654] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.208742 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.209458 22148 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.211606 22036 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.210963 22266 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.213006 22266 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.213559 22306 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.213948 22306 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.214273 22306 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.215252 22266 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.213001 22262 tablet_bootstrap.cc:654] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.216738 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:25:57.218497 22114 leader_election.cc:343] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.220403 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:57.222087 22113 leader_election.cc:343] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.222654 22113 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.223071 22306 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.224016 22266 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.226285 22306 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.226298 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:57.226521 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.227049 22148 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.227702 22269 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.228268 22269 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:57.232095 22038 leader_election.cc:343] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.233853 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:25:57.235606 22185 leader_election.cc:343] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.238230 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.238942 22148 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
W20260709 12:25:57.240504 22188 leader_election.cc:343] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.240893 22036 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.241056 22188 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:25:57.242030 22290 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.242502 22306 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.243148 22306 raft_consensus.cc:697] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:57.243728 22290 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.244145 22306 consensus_queue.cc:237] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.247210 22269 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:57.255522 22263 tablet_bootstrap.cc:492] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.256193 22263 ts_tablet_manager.cc:1403] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.002s
I20260709 12:25:57.260330 22263 raft_consensus.cc:359] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.261124 22263 raft_consensus.cc:385] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.261416 22263 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.262727 22263 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.268967 22267 tablet_bootstrap.cc:492] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.269599 22267 ts_tablet_manager.cc:1403] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.035s
I20260709 12:25:57.270959 22262 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.271871 22262 ts_tablet_manager.cc:1403] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.024s
I20260709 12:25:57.273259 22267 raft_consensus.cc:359] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.274063 22267 raft_consensus.cc:385] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.274434 22267 raft_consensus.cc:740] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.275439 22267 consensus_queue.cc:260] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.277853 22267 ts_tablet_manager.cc:1434] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:57.278585 21971 catalog_manager.cc:5697] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.274811 22262 raft_consensus.cc:359] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.280421 22263 ts_tablet_manager.cc:1434] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:25:57.280628 22267 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.280468 22262 raft_consensus.cc:385] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.281234 22262 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.284847 22262 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.285777 22269 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.295230 22262 ts_tablet_manager.cc:1434] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:25:57.296490 22262 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.304153 22290 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.304728 22290 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.305727 22262 tablet_bootstrap.cc:654] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.308929 22267 tablet_bootstrap.cc:654] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.311717 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.312595 22073 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:25:57.311699 22263 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.313293 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.315747 22188 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:25:57.317149 22269 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.317754 22269 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.318238 22269 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.319859 22185 leader_election.cc:343] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.320338 22262 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.320309 22267 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.321267 22266 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.322391 22267 ts_tablet_manager.cc:1403] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.006s
I20260709 12:25:57.322108 22266 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.324355 22266 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.324698 22267 raft_consensus.cc:359] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.325187 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.325387 22267 raft_consensus.cc:385] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.322080 22262 ts_tablet_manager.cc:1403] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.012s
I20260709 12:25:57.325743 22267 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.321461 22263 tablet_bootstrap.cc:654] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.326483 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:57.327941 22113 leader_election.cc:343] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.329605 22262 raft_consensus.cc:359] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.330313 22262 raft_consensus.cc:385] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.330579 22262 raft_consensus.cc:740] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.320636 22290 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:25:57.331605 22266 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:57.331833 22114 leader_election.cc:343] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.332108 22266 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.332415 22114 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.335855 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.336490 22269 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:57.337724 22113 leader_election.cc:343] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.326509 22267 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.342188 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:57.342633 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:57.343230 22072 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.344460 22185 leader_election.cc:343] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.344631 22267 ts_tablet_manager.cc:1434] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:57.346045 22267 tablet_bootstrap.cc:492] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.347191 22306 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.347734 22306 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.350143 22306 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.353320 22267 tablet_bootstrap.cc:654] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.355082 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.356014 22147 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.357703 22036 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:57.366146 22267 tablet_bootstrap.cc:492] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.366938 22267 ts_tablet_manager.cc:1403] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:25:57.367659 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.368484 22222 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.371611 22310 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.372437 22310 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.372787 22310 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.373452 22267 raft_consensus.cc:359] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.374325 22267 raft_consensus.cc:385] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.374701 22267 raft_consensus.cc:740] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.375582 22267 consensus_queue.cc:260] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.381007 22267 ts_tablet_manager.cc:1434] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 12:25:57.382228 22267 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.388754 22267 tablet_bootstrap.cc:654] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.389698 22306 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.390336 22306 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.395135 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:25:57.397876 22036 leader_election.cc:343] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.400453 22306 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.401230 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.402038 22222 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.403692 22038 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:57.405702 22310 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.406807 22306 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.407240 22306 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.407604 22306 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.408021 22267 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.408633 22267 ts_tablet_manager.cc:1403] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.007s
I20260709 12:25:57.412904 22267 raft_consensus.cc:359] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.413909 22267 raft_consensus.cc:385] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.414281 22267 raft_consensus.cc:740] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.415608 22267 consensus_queue.cc:260] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.418354 22267 ts_tablet_manager.cc:1434] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:25:57.419672 22267 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.331404 22262 consensus_queue.cc:260] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.341864 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.421250 22073 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:57.334465 22266 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.422380 22266 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.422878 22266 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.425009 22266 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.425972 22114 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.426522 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.427214 22073 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:57.427361 22266 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.427965 22266 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.428403 22266 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.428588 22114 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:57.430018 22269 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:25:57.339963 22320 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.431191 22320 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.431581 22320 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.431919 22320 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.382510 22072 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:25:57.438266 22188 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:57.439582 22269 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.439843 22267 tablet_bootstrap.cc:654] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.440320 22269 raft_consensus.cc:697] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:25:57.441233 22269 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.444262 22266 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.448369 22266 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.448277 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.449079 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:57.449227 22222 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:57.449704 22072 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.449572 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:57.450239 22148 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.453922 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.454574 22222 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.456012 22267 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.456630 22267 ts_tablet_manager.cc:1403] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.005s
I20260709 12:25:57.461122 22267 raft_consensus.cc:359] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.462037 22267 raft_consensus.cc:385] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.462327 22222 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:57.462522 22266 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.463150 22266 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.463792 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.466765 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.467520 22266 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.468158 22267 raft_consensus.cc:740] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.468560 22038 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:25:57.468848 22262 ts_tablet_manager.cc:1434] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.143s	user 0.010s	sys 0.006s
I20260709 12:25:57.469475 22271 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.470185 22262 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
W20260709 12:25:57.473732 22113 leader_election.cc:343] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.469252 22267 consensus_queue.cc:260] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.475469 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.478680 22222 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:57.478711 22073 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:57.480173 22263 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.480654 22263 ts_tablet_manager.cc:1403] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.169s	user 0.065s	sys 0.088s
I20260709 12:25:57.482290 22114 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:57.483282 22266 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.483757 22266 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.484220 22266 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.482900 21970 catalog_manager.cc:5697] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:57.487924 22262 tablet_bootstrap.cc:654] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.466724 22310 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.477152 22148 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:57.492106 22263 raft_consensus.cc:359] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.492821 22263 raft_consensus.cc:385] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.493099 22263 raft_consensus.cc:740] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.493163 22072 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:57.493865 22263 consensus_queue.cc:260] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.494432 22114 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.494784 22306 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.495643 22325 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.496189 22325 raft_consensus.cc:697] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:25:57.496367 22267 ts_tablet_manager.cc:1434] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 12:25:57.497294 22267 tablet_bootstrap.cc:492] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.497020 22325 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.497818 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:57.498099 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.498654 22222 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.499325 22036 leader_election.cc:343] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.500849 22266 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.503961 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:57.504433 22271 raft_consensus.cc:697] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:57.504678 22072 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.505471 22271 consensus_queue.cc:237] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.508858 22222 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:57.509359 22266 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.510481 22038 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:57.511595 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.511953 22306 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.512198 22221 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.512778 22306 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.514365 22320 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.517053 22320 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.517948 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:57.518498 22073 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.518953 22306 raft_consensus.cc:697] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:57.523232 22267 tablet_bootstrap.cc:654] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.526580 21970 catalog_manager.cc:5697] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.530275 22310 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.530828 22310 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.534057 22329 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.534667 22329 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.535418 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.536827 22329 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.538642 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:25:57.540099 22036 leader_election.cc:343] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:57.541181 22038 leader_election.cc:343] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.542371 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.543009 22220 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.544234 22038 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:57.545001 22329 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.545315 22310 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.545446 22329 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.545861 22329 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.546105 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.546721 22148 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.528537 22263 ts_tablet_manager.cc:1434] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260709 12:25:57.547945 22036 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.550840 22263 tablet_bootstrap.cc:492] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.550894 22328 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.551298 22328 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.551625 22328 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.551633 22310 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.552316 22329 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.529817 22306 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.552217 22310 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.554991 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:57.555223 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.555841 22220 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.556308 22036 leader_election.cc:343] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.557114 22073 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:57.558298 22310 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.558539 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.559067 22329 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.559299 22114 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:57.559192 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:57.561404 22036 leader_election.cc:343] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.560640 22325 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.563187 22219 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.563333 22325 raft_consensus.cc:697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:25:57.564378 22072 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:57.564179 22325 consensus_queue.cc:237] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.565514 22114 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:57.566666 22266 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.550382 22221 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:57.568351 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.567124 22266 raft_consensus.cc:697] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:25:57.569571 22266 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.570165 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:57.574703 22222 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.575243 22271 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.575618 22271 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.575911 22271 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.580734 21970 catalog_manager.cc:5697] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.582042 22222 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:57.582870 22328 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.586833 22328 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.587330 22262 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.587796 22262 ts_tablet_manager.cc:1403] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.014s
I20260709 12:25:57.588559 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.588610 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:25:57.590354 22038 leader_election.cc:343] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.593928 22147 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.594973 22262 raft_consensus.cc:359] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.595775 22262 raft_consensus.cc:385] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.596052 22262 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.596733 22262 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.599051 22262 ts_tablet_manager.cc:1434] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:25:57.600407 22262 tablet_bootstrap.cc:492] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.610033 21969 catalog_manager.cc:5697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.611979 22271 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.613418 22267 tablet_bootstrap.cc:492] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.613827 22267 ts_tablet_manager.cc:1403] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.009s
I20260709 12:25:57.616679 22263 tablet_bootstrap.cc:654] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.617616 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.618184 22222 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.619719 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:57.619282 22271 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.625234 22147 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:57.626330 22222 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:57.627475 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:25:57.627660 22220 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:57.629197 22271 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.629990 22271 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:57.630865 22271 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.635102 22267 raft_consensus.cc:359] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.635874 22267 raft_consensus.cc:385] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.636154 22267 raft_consensus.cc:740] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.636829 22267 consensus_queue.cc:260] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:57.628602 22036 leader_election.cc:343] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.639698 22038 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:57.640646 22328 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.640441 22036 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.641117 22328 raft_consensus.cc:697] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:57.641868 22328 consensus_queue.cc:237] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.643185 22306 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.643534 22267 ts_tablet_manager.cc:1434] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:25:57.647619 22267 tablet_bootstrap.cc:492] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.643934 22306 raft_consensus.cc:697] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:57.649235 22306 consensus_queue.cc:237] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.653776 22262 tablet_bootstrap.cc:654] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.654918 22263 tablet_bootstrap.cc:492] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.655272 22263 ts_tablet_manager.cc:1403] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.000s
I20260709 12:25:57.656641 21970 catalog_manager.cc:5697] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.657891 22263 raft_consensus.cc:359] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.658524 22263 raft_consensus.cc:385] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.658797 22263 raft_consensus.cc:740] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.666922 22263 consensus_queue.cc:260] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.679243 22263 ts_tablet_manager.cc:1434] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:25:57.680572 22263 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.693848 22262 tablet_bootstrap.cc:492] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.695128 22262 ts_tablet_manager.cc:1403] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.009s
I20260709 12:25:57.697599 22267 tablet_bootstrap.cc:654] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.699046 21969 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.703373 22262 raft_consensus.cc:359] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.704048 22263 tablet_bootstrap.cc:654] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.704191 22262 raft_consensus.cc:385] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.704581 22262 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.705360 22262 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.707582 22266 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.708143 22262 ts_tablet_manager.cc:1434] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:25:57.708050 22266 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.709280 22262 tablet_bootstrap.cc:492] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.710204 22266 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.711882 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.714145 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.715015 22220 raft_consensus.cc:2393] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:25:57.717555 22113 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.719599 22266 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.722150 22038 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.725293 22263 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.725862 22263 ts_tablet_manager.cc:1403] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.008s
I20260709 12:25:57.728660 22263 raft_consensus.cc:359] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.729337 22263 raft_consensus.cc:385] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.729614 22263 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.730338 22263 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.729664 22271 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:57.732352 22263 ts_tablet_manager.cc:1434] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:57.733261 22262 tablet_bootstrap.cc:654] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.734256 22266 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:57.739794 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:57.740675 21970 catalog_manager.cc:5697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.737649 22263 tablet_bootstrap.cc:492] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.746558 21970 catalog_manager.cc:5697] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.748735 21970 catalog_manager.cc:5697] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.757375 22263 tablet_bootstrap.cc:654] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.760075 22262 tablet_bootstrap.cc:492] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.760592 22267 tablet_bootstrap.cc:492] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.760644 22262 ts_tablet_manager.cc:1403] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.001s
I20260709 12:25:57.761032 22267 ts_tablet_manager.cc:1403] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.044s
I20260709 12:25:57.763986 22262 raft_consensus.cc:359] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.764755 22262 raft_consensus.cc:385] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.765025 22262 raft_consensus.cc:740] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.767241 22267 raft_consensus.cc:359] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.768528 22267 raft_consensus.cc:385] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.768751 22267 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.771271 22263 tablet_bootstrap.cc:492] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.765973 22262 consensus_queue.cc:260] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.771713 22263 ts_tablet_manager.cc:1403] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.006s
I20260709 12:25:57.773137 22262 ts_tablet_manager.cc:1434] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:57.774071 22262 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.773936 22263 raft_consensus.cc:359] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.774580 22263 raft_consensus.cc:385] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.774858 22263 raft_consensus.cc:740] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.775653 22267 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.777577 22267 ts_tablet_manager.cc:1434] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:25:57.778440 22267 tablet_bootstrap.cc:492] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.781458 22262 tablet_bootstrap.cc:654] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.784379 22267 tablet_bootstrap.cc:654] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.787014 22263 consensus_queue.cc:260] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.789177 22263 ts_tablet_manager.cc:1434] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 12:25:57.799384 22263 tablet_bootstrap.cc:492] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.800364 22267 tablet_bootstrap.cc:492] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.800897 22267 ts_tablet_manager.cc:1403] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 12:25:57.803531 22267 raft_consensus.cc:359] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.809185 22267 raft_consensus.cc:385] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.809401 22262 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.809468 22267 raft_consensus.cc:740] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.809955 22262 ts_tablet_manager.cc:1403] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.016s
I20260709 12:25:57.810410 22267 consensus_queue.cc:260] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.805357 22263 tablet_bootstrap.cc:654] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.812608 22262 raft_consensus.cc:359] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.813280 22262 raft_consensus.cc:385] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.813577 22262 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.814229 22262 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.816676 22262 ts_tablet_manager.cc:1434] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:25:57.816808 22267 ts_tablet_manager.cc:1434] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:25:57.817821 22267 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.818571 22262 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.819391 22328 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.819839 22328 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.821961 22328 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.823519 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.824955 22262 tablet_bootstrap.cc:654] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:57.825429 22036 leader_election.cc:343] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.825533 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:57.826929 22038 leader_election.cc:343] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.827344 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.828763 22328 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.831894 22267 tablet_bootstrap.cc:654] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.835773 22262 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.836241 22262 ts_tablet_manager.cc:1403] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:25:57.836594 22263 tablet_bootstrap.cc:492] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.836963 22263 ts_tablet_manager.cc:1403] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.006s
I20260709 12:25:57.838810 22262 raft_consensus.cc:359] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.839095 22263 raft_consensus.cc:359] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.839488 22262 raft_consensus.cc:385] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.839699 22263 raft_consensus.cc:385] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.839792 22262 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.839987 22263 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.840512 22262 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.840670 22263 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.842645 22262 ts_tablet_manager.cc:1434] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:57.845484 22262 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.845937 22290 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.846405 22290 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.847846 22263 ts_tablet_manager.cc:1434] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 12:25:57.848508 22290 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:57.848773 22263 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.850087 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.851025 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.851953 22262 tablet_bootstrap.cc:654] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.854743 22263 tablet_bootstrap.cc:654] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.842533 22267 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.857822 22267 ts_tablet_manager.cc:1403] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 12:25:57.850996 22147 raft_consensus.cc:2393] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 1: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:25:57.860005 22185 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:25:57.860915 22291 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.861663 22262 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.861367 22267 raft_consensus.cc:359] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.862030 22267 raft_consensus.cc:385] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.862100 22262 ts_tablet_manager.cc:1403] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.009s
I20260709 12:25:57.864928 22262 raft_consensus.cc:359] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.865137 22263 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.865427 22262 raft_consensus.cc:385] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.865729 22262 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.865749 22263 ts_tablet_manager.cc:1403] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.005s
I20260709 12:25:57.866367 22262 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.866696 22267 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.867504 22267 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.868288 22291 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.868384 22262 ts_tablet_manager.cc:1434] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:57.869004 22263 raft_consensus.cc:359] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.870976 22263 raft_consensus.cc:385] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.871248 22263 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.871346 22262 tablet_bootstrap.cc:492] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.871934 22263 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.873890 22263 ts_tablet_manager.cc:1434] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:25:57.874773 22263 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.869577 22267 ts_tablet_manager.cc:1434] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:57.881556 22263 tablet_bootstrap.cc:654] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.881561 22262 tablet_bootstrap.cc:654] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.894395 22267 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.901531 22263 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.902117 22267 tablet_bootstrap.cc:654] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.902202 22263 ts_tablet_manager.cc:1403] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.015s
I20260709 12:25:57.902293 22262 tablet_bootstrap.cc:492] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.902799 22262 ts_tablet_manager.cc:1403] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.010s
I20260709 12:25:57.904680 22262 raft_consensus.cc:359] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.905253 22262 raft_consensus.cc:385] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.905539 22262 raft_consensus.cc:740] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.906392 22262 consensus_queue.cc:260] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.907586 22263 raft_consensus.cc:359] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.908118 22267 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.908236 22263 raft_consensus.cc:385] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.908990 22262 ts_tablet_manager.cc:1434] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:57.909289 22263 raft_consensus.cc:740] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.909696 22267 ts_tablet_manager.cc:1403] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:25:57.909933 22262 tablet_bootstrap.cc:492] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.910558 22263 consensus_queue.cc:260] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.910884 22328 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.914690 22328 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.915578 22263 ts_tablet_manager.cc:1434] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:25:57.916797 22328 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.915880 22267 raft_consensus.cc:359] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.917339 22267 raft_consensus.cc:385] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.917949 22267 raft_consensus.cc:740] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.917701 22263 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.919917 22262 tablet_bootstrap.cc:654] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.920324 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:57.921707 22038 leader_election.cc:343] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.919859 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.922881 22147 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.920284 22267 consensus_queue.cc:260] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.924228 22036 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.925606 22267 ts_tablet_manager.cc:1434] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:57.926908 22267 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.925670 22271 raft_consensus.cc:2804] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.929567 22263 tablet_bootstrap.cc:654] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.939816 22267 tablet_bootstrap.cc:654] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.934679 22271 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.942420 22271 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.950644 22271 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.951053 22263 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:57.951673 22267 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.951645 22262 tablet_bootstrap.cc:492] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.951649 22263 ts_tablet_manager.cc:1403] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.008s
I20260709 12:25:57.952509 22267 ts_tablet_manager.cc:1403] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 12:25:57.952591 22262 ts_tablet_manager.cc:1403] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.017s
I20260709 12:25:57.953759 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:57.954340 22147 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.955078 22267 raft_consensus.cc:359] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.955349 22263 raft_consensus.cc:359] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.955753 22267 raft_consensus.cc:385] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.955588 22262 raft_consensus.cc:359] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.956127 22267 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.956139 22263 raft_consensus.cc:385] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.956686 22263 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.957087 22267 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.956313 22262 raft_consensus.cc:385] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.957647 22271 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.957458 22263 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.958873 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:57.959553 22267 ts_tablet_manager.cc:1434] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:25:57.960098 22263 ts_tablet_manager.cc:1434] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
W20260709 12:25:57.960286 22038 leader_election.cc:343] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.960685 22262 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.961431 22262 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.963476 22262 ts_tablet_manager.cc:1434] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.006s
I20260709 12:25:57.963585 22267 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.964663 22262 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:57.964885 22147 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:57.965332 22263 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:57.970501 22267 tablet_bootstrap.cc:654] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.971452 22262 tablet_bootstrap.cc:654] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.975920 22036 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:57.977308 22328 raft_consensus.cc:2804] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.977849 22328 raft_consensus.cc:697] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:57.978897 22328 consensus_queue.cc:237] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.979792 22263 tablet_bootstrap.cc:654] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.986001 22271 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.989605 22262 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:57.990067 22271 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.990254 22262 ts_tablet_manager.cc:1403] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 12:25:57.990310 22291 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.990576 22271 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.991225 22291 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.993130 22262 raft_consensus.cc:359] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:57.993795 22262 raft_consensus.cc:385] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.994063 22262 raft_consensus.cc:740] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.994648 22267 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:57.994935 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.995018 22262 consensus_queue.cc:260] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:57.996454 22036 leader_election.cc:343] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.996718 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:57.997243 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:57.998001 22267 ts_tablet_manager.cc:1403] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.009s
I20260709 12:25:57.998202 22271 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:57.998560 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:57.999236 22072 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:25:58.000950 22267 raft_consensus.cc:359] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.000980 22188 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:25:58.001698 22267 raft_consensus.cc:385] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.002113 22267 raft_consensus.cc:740] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
W20260709 12:25:58.001965 22185 leader_election.cc:343] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.002270 22290 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.002681 22290 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.003067 22290 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.002884 22267 consensus_queue.cc:260] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.004860 22267 ts_tablet_manager.cc:1434] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:58.005895 22267 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:57.997318 22220 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:57.997488 22262 ts_tablet_manager.cc:1434] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:25:58.008008 22262 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:58.008133 22038 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:58.009372 22306 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.009735 22306 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.010063 22306 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.010812 22291 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:58.011929 22267 tablet_bootstrap.cc:654] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.018415 22290 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.020540 22290 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:58.020231 22329 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.020280 22220 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.021749 22262 tablet_bootstrap.cc:654] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.023377 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:58.023702 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:58.024262 22072 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:58.029057 22185 leader_election.cc:343] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.034993 22266 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.035979 22266 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.038614 22263 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:58.039227 22263 ts_tablet_manager.cc:1403] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.001s
I20260709 12:25:58.039572 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.040383 22073 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:58.042156 22114 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:58.043179 22325 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.043567 22325 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.042320 22263 raft_consensus.cc:359] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.043928 22325 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.046188 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:58.046701 22266 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.046880 22221 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:58.053344 22263 raft_consensus.cc:385] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.053442 22328 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.053910 22263 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.054271 22325 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.055270 22266 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.055372 22263 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.058966 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:58.059428 22290 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.058969 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:58.060830 22221 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.057644 22306 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.062534 22320 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.062371 22290 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.065241 22290 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:58.055871 22266 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.059855 22073 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.068146 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:58.069599 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:58.068257 22266 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.062311 22263 ts_tablet_manager.cc:1434] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
W20260709 12:25:58.069979 22036 leader_election.cc:343] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.075729 22320 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.077872 22263 tablet_bootstrap.cc:492] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:58.076318 22320 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.080091 22266 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.084928 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:58.075826 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.085342 22148 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:58.085659 22113 leader_election.cc:343] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.086412 22147 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:25:58.085227 22320 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:25:58.096926 22114 leader_election.cc:343] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.097615 22114 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:58.098114 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.098837 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:58.099057 22320 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.099154 22069 raft_consensus.cc:2393] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:25:58.097615 22147 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.088759 21969 catalog_manager.cc:5697] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.059106 22325 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.102306 22306 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.107300 22113 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:58.113758 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.114475 22069 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:25:58.144387 22072 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:25:58.173273 22073 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:58.187744 22322 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.188475 22322 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.191819 22114 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:58.194247 22320 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.110885 22185 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:25:58.229113 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 119558us
I20260709 12:25:58.231586 22269 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.231983 22269 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.232304 22269 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.198287 22328 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.227943 22320 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.192076 22266 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.236510 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:58.239204 22329 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.242640 22218 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.242748 22329 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.250938 22266 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.186237 22221 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:58.308815 22262 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:58.309322 22262 ts_tablet_manager.cc:1403] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.301s	user 0.043s	sys 0.028s
I20260709 12:25:58.303134 22320 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.317277 22322 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.304952 22266 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.313063 22291 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.322742 22266 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.323334 22266 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.324963 22262 raft_consensus.cc:359] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.325513 22266 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.326659 22328 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.327378 22291 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:58.328263 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 132590us
I20260709 12:25:58.329106 22188 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:58.329408 22291 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:58.329965 22291 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.332087 22329 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.332695 22263 tablet_bootstrap.cc:654] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.330416 22291 raft_consensus.cc:697] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:25:58.322252 22320 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.363651 22262 raft_consensus.cc:385] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.379309 22267 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:58.379976 22267 ts_tablet_manager.cc:1403] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.374s	user 0.047s	sys 0.061s
I20260709 12:25:58.371448 22262 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.358122 22219 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.381579 22262 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.371770 22290 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.375944 22320 raft_consensus.cc:697] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:25:58.376595 22269 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.409981 22262 ts_tablet_manager.cc:1434] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.004s
I20260709 12:25:58.399509 22290 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.415416 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:58.417511 22267 raft_consensus.cc:359] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.420289 22267 raft_consensus.cc:385] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.420564 22267 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.405576 22291 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.419713 22262 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
W20260709 12:25:58.399718 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 82810.8us
I20260709 12:25:58.433074 22325 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.458756 22373 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.459535 22373 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.449335 22320 consensus_queue.cc:237] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.491392 22375 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:25:58.518848 22373 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:58.519997 22373 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:58.478837 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 81025.6us
I20260709 12:25:58.607209 22218 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:58.608973 22267 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.502148 22269 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:58.546705 22148 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.619983 22329 consensus_queue.cc:1048] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.622265 22267 ts_tablet_manager.cc:1434] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.242s	user 0.005s	sys 0.003s
I20260709 12:25:58.520982 22290 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:25:58.539204 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 168950us
I20260709 12:25:58.625186 22267 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
W20260709 12:25:58.613608 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 66590.7us
W20260709 12:25:58.635218 22372 log.cc:927] Time spent T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:25:58.635324 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:58.638540 22145 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.646252 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:58.647023 22146 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:25:58.675717 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:58.676266 22325 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.640980 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:58.683555 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:58.690902 22329 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:58.691546 22382 log.cc:927] Time spent T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:25:58.686496 22325 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.696689 22379 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:58.701376 22325 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.701417 22185 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:25:58.781286 22263 tablet_bootstrap.cc:492] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:58.782277 22263 ts_tablet_manager.cc:1403] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.706s	user 0.024s	sys 0.038s
I20260709 12:25:58.789834 22262 tablet_bootstrap.cc:654] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:58.708330 22036 leader_election.cc:343] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.790468 22263 raft_consensus.cc:359] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.791602 22263 raft_consensus.cc:385] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.791909 22263 raft_consensus.cc:740] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.788285 22379 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.792585 22263 consensus_queue.cc:260] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:58.787640 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 91560.5us
I20260709 12:25:58.793321 22379 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.797823 22379 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.806434 22038 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:25:58.809772 22329 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:58.810211 22038 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:58.810274 22329 raft_consensus.cc:697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:25:58.810693 22114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.042s	sys 0.025s
I20260709 12:25:58.812673 22263 ts_tablet_manager.cc:1434] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
W20260709 12:25:58.792730 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 85367.2us
I20260709 12:25:58.816804 22263 tablet_bootstrap.cc:492] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:58.814081 21969 catalog_manager.cc:5697] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.820976 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:58.816552 22114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.042s	sys 0.025s
W20260709 12:25:58.822186 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 630465us
I20260709 12:25:58.834842 22375 consensus_queue.cc:1048] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:58.820981 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:58.842203 22267 tablet_bootstrap.cc:654] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.841642 22329 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.837272 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:58.842821 22038 leader_election.cc:343] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.842885 22370 consensus_queue.cc:1048] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.848250 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.849252 22320 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.846782 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.852435 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.856093 22038 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:58.866032 22375 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:58.866300 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:58.867193 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:58.853294 22072 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:58.853317 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.875538 22325 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:58.854286 22379 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:58.875586 22073 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:25:58.895570 22218 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:25:58.881645 22370 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:25:58.889511 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.901899 22145 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:25:58.937824 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:58.956542 22378 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.935573 22114 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:58.978031 22267 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:58.963485 22069 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.978720 22267 ts_tablet_manager.cc:1403] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.354s	user 0.014s	sys 0.013s
I20260709 12:25:58.981925 21971 catalog_manager.cc:5697] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.970363 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:58.995837 22377 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.992444 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:59.005772 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:59.001261 22379 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:59.000473 22072 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:25:59.042882 22262 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:59.043422 22262 ts_tablet_manager.cc:1403] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.629s	user 0.030s	sys 0.024s
I20260709 12:25:59.046422 22399 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.047371 22399 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.047784 22399 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.048257 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:59.036116 22188 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:25:59.060396 22072 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.062296 22263 tablet_bootstrap.cc:654] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.064811 22114 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:59.087332 22267 raft_consensus.cc:359] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.087832 22267 raft_consensus.cc:385] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.087998 22267 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.088397 22267 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.077400 22291 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:59.085951 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 60991.1us
I20260709 12:25:59.094507 22188 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:25:59.099720 22401 log.cc:927] Time spent T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:25:59.105263 22267 ts_tablet_manager.cc:1434] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.126s	user 0.006s	sys 0.001s
I20260709 12:25:59.106578 22267 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:59.159824 22262 raft_consensus.cc:359] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.160663 22262 raft_consensus.cc:385] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.160962 22262 raft_consensus.cc:740] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.161850 22262 consensus_queue.cc:260] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.100993 22291 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:59.159509 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 65113.8us
I20260709 12:25:59.197338 22262 ts_tablet_manager.cc:1434] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.154s	user 0.027s	sys 0.007s
W20260709 12:25:59.097206 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 121821us
I20260709 12:25:59.119630 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:59.159480 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:59.150121 22185 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:25:59.199021 22306 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.208114 22407 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:59.236495 22408 log.cc:927] Time spent T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 12:25:59.232373 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 116032us
I20260709 12:25:59.234738 22291 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.213968 22113 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.231334 22306 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:59.239101 22114 leader_election.cc:343] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.243484 22407 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.258616 22072 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:25:59.251114 22373 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.249078 22291 raft_consensus.cc:697] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:25:59.260776 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 53408.4us
I20260709 12:25:59.278905 22113 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.282007 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:59.282730 22144 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:59.256009 22407 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.298159 22411 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.300513 22320 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.301183 22320 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.303387 22320 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.317373 22036 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:59.329336 22329 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.329819 22329 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.330154 22329 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.330617 22410 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:59.284070 22373 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.342701 22291 consensus_queue.cc:237] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.344395 22262 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
W20260709 12:25:59.324841 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 75665.9us
I20260709 12:25:59.299177 22188 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:25:59.347251 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 62961.6us
W20260709 12:25:59.347245 22413 log.cc:927] Time spent T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.193s	user 0.004s	sys 0.000s
W20260709 12:25:59.356386 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 77568.3us
I20260709 12:25:59.356977 22379 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:59.357288 22113 leader_election.cc:343] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.359972 22306 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.363605 22373 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:25:59.364249 22262 tablet_bootstrap.cc:654] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.358273 22113 leader_election.cc:343] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.358486 22407 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.372540 22407 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.368170 22113 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.373448 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:59.373945 22410 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.379367 22069 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:25:59.394110 22329 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.407572 22379 raft_consensus.cc:697] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:25:59.371793 22399 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.424862 22263 tablet_bootstrap.cc:492] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:59.426524 22263 ts_tablet_manager.cc:1403] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.611s	user 0.024s	sys 0.012s
I20260709 12:25:59.419652 22329 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.426753 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:25:59.428814 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 73739us
I20260709 12:25:59.434790 22145 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:25:59.423969 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 65732.9us
I20260709 12:25:59.438446 22267 tablet_bootstrap.cc:654] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.431272 22379 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:59.443480 22185 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.469767 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:59.471045 22069 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.474404 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:59.475713 22142 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.493788 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:25:59.494207 22114 leader_election.cc:343] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.500097 22221 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.516955 22263 raft_consensus.cc:359] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.517642 22263 raft_consensus.cc:385] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.517915 22263 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.518795 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:59.518527 22263 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.535332 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:25:59.538568 22036 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.539419 22399 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.540823 22263 ts_tablet_manager.cc:1434] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.000s
I20260709 12:25:59.541968 22263 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:59.554678 22262 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:59.555621 22262 ts_tablet_manager.cc:1403] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.211s	user 0.030s	sys 0.018s
I20260709 12:25:59.558228 22425 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:25:59.566216 22069 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:59.566380 22399 consensus_queue.cc:1048] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:59.572216 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:25:59.573483 22070 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:25:59.556743 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:59.588703 22113 leader_election.cc:343] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.589198 22113 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.589613 22114 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:25:59.591001 22407 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.591418 22325 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.591907 22325 raft_consensus.cc:697] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:25:59.585510 22185 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:25:59.592612 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:59.606503 22290 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.607730 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:59.608054 22399 consensus_queue.cc:1048] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.608422 22219 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.592753 22325 consensus_queue.cc:237] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:59.622390 22038 leader_election.cc:343] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:59.624205 22038 leader_election.cc:343] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.626168 22263 tablet_bootstrap.cc:654] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.631788 22262 raft_consensus.cc:359] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.633765 22262 raft_consensus.cc:385] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.634002 22262 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.632501 22371 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:59.615538 22113 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.638887 22410 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.644743 22219 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:25:59.634552 22262 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.663846 22410 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.664417 22410 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.669308 22262 ts_tablet_manager.cc:1434] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 12:25:59.671696 22142 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:59.695355 22262 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:59.726914 22410 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.688925 22036 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.727612 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:59.727840 22329 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:59.727978 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 44984.3us
I20260709 12:25:59.728350 22329 raft_consensus.cc:697] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:59.729166 22329 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.735695 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:59.732120 22114 leader_election.cc:343] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:59.738080 22113 leader_election.cc:343] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.738531 22113 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.739882 22410 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.749343 22267 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:59.759573 22267 ts_tablet_manager.cc:1403] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.653s	user 0.026s	sys 0.016s
I20260709 12:25:59.760402 22263 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:59.761071 22263 ts_tablet_manager.cc:1403] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.010s
I20260709 12:25:59.766453 22267 raft_consensus.cc:359] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.768599 22267 raft_consensus.cc:385] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.768970 22267 raft_consensus.cc:740] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.769840 22267 consensus_queue.cc:260] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.772274 22267 ts_tablet_manager.cc:1434] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:59.772966 22306 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.774091 22306 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.776612 22306 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.777590 22262 tablet_bootstrap.cc:654] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.774650 22267 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:59.779332 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:59.779527 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:25:59.781492 22038 leader_election.cc:343] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.782191 22142 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:25:59.782568 22263 raft_consensus.cc:359] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.783274 22263 raft_consensus.cc:385] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.783548 22263 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.788201 22036 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.789171 22329 raft_consensus.cc:2804] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.789659 22329 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.790143 22329 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.784963 22263 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.827411 22267 tablet_bootstrap.cc:654] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.818212 22329 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.832999 22263 ts_tablet_manager.cc:1434] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.002s
I20260709 12:25:59.835306 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:25:59.836015 22142 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.848875 22263 tablet_bootstrap.cc:492] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:59.854348 22329 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.850401 22142 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:25:59.842512 21968 catalog_manager.cc:5697] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.863023 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:25:59.865392 22036 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:25:59.867601 22038 leader_election.cc:343] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.867995 22375 raft_consensus.cc:2804] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.868818 22375 raft_consensus.cc:697] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:25:59.870384 22375 consensus_queue.cc:237] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.871867 22379 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.872656 22262 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:25:59.873104 22262 ts_tablet_manager.cc:1403] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.178s	user 0.009s	sys 0.004s
I20260709 12:25:59.886332 22267 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:59.886885 22267 ts_tablet_manager.cc:1403] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.003s
I20260709 12:25:59.897603 21969 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.902107 22263 tablet_bootstrap.cc:654] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.907003 21969 catalog_manager.cc:5697] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.913204 22267 raft_consensus.cc:359] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:59.914470 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:59.918874 22267 raft_consensus.cc:385] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.918658 22425 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.919193 22267 raft_consensus.cc:740] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.919912 22267 consensus_queue.cc:260] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.911664 22262 raft_consensus.cc:359] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.921128 22262 raft_consensus.cc:385] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.921414 22262 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.922048 22262 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.924315 22262 ts_tablet_manager.cc:1434] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:25:59.925426 22262 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:25:59.935282 22267 ts_tablet_manager.cc:1434] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 12:25:59.936812 22267 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:25:59.943650 22267 tablet_bootstrap.cc:654] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.947002 21971 catalog_manager.cc:5697] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.949213 21971 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.954514 22262 tablet_bootstrap.cc:654] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.962695 22267 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:25:59.963250 22267 ts_tablet_manager.cc:1403] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 12:25:59.964248 22263 tablet_bootstrap.cc:492] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:25:59.964787 22263 ts_tablet_manager.cc:1403] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.018s
I20260709 12:25:59.966321 22267 raft_consensus.cc:359] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.968562 22267 raft_consensus.cc:385] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.967763 22263 raft_consensus.cc:359] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.969091 22263 raft_consensus.cc:385] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.969412 22263 raft_consensus.cc:740] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.970094 22263 consensus_queue.cc:260] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.972334 22263 ts_tablet_manager.cc:1434] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:59.973637 22263 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:25:59.977448 22371 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.972641 22267 raft_consensus.cc:740] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.977999 22371 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.978472 22267 consensus_queue.cc:260] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:25:59.980202 22371 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:25:59.980796 22267 ts_tablet_manager.cc:1434] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:59.982169 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:25:59.982791 22263 tablet_bootstrap.cc:654] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.983721 22036 leader_election.cc:343] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.986207 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:25:59.987843 22425 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.988451 22425 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:25:59.994030 22038 leader_election.cc:343] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.995254 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:25:59.994619 22038 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:25:59.997958 22375 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:59.998253 22188 leader_election.cc:343] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.003172 22425 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:00.005213 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:00.007499 22185 leader_election.cc:343] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.008065 22185 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:00.009522 22425 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.011611 22425 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.017977 22263 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.018491 22263 ts_tablet_manager.cc:1403] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.020s
I20260709 12:26:00.018898 22267 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:00.029493 22410 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:00.031916 22263 raft_consensus.cc:359] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.032819 22263 raft_consensus.cc:385] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.033564 22263 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.034466 22263 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.036728 22263 ts_tablet_manager.cc:1434] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:26:00.037672 22263 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.043757 22263 tablet_bootstrap.cc:654] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.047133 22267 tablet_bootstrap.cc:654] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.055960 22426 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:00.071978 22263 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.072606 22263 ts_tablet_manager.cc:1403] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.011s
I20260709 12:26:00.075575 22375 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.075580 22263 raft_consensus.cc:359] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.076249 22375 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.076591 22263 raft_consensus.cc:385] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.077126 22263 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.076982 22325 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.077932 22263 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.078486 22375 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.080509 22263 ts_tablet_manager.cc:1434] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:00.080407 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.081413 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:00.082233 22038 leader_election.cc:343] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.082818 22263 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
W20260709 12:26:00.082927 22036 leader_election.cc:343] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.083592 22036 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:00.084872 22375 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.089732 22263 tablet_bootstrap.cc:654] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.119640 22262 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.120242 22262 ts_tablet_manager.cc:1403] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.195s	user 0.045s	sys 0.067s
I20260709 12:26:00.123337 22262 raft_consensus.cc:359] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.124119 22262 raft_consensus.cc:385] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.124384 22262 raft_consensus.cc:740] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.125078 22262 consensus_queue.cc:260] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.127022 22263 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.127302 22262 ts_tablet_manager.cc:1434] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:00.127555 22263 ts_tablet_manager.cc:1403] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.045s	user 0.032s	sys 0.010s
I20260709 12:26:00.128266 22262 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.130256 22263 raft_consensus.cc:359] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.131023 22263 raft_consensus.cc:385] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.131289 22263 raft_consensus.cc:740] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.132059 22263 consensus_queue.cc:260] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.135047 22267 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:00.135637 22267 ts_tablet_manager.cc:1403] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.002s
I20260709 12:26:00.138381 22267 raft_consensus.cc:359] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.139339 22267 raft_consensus.cc:385] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.139504 22263 ts_tablet_manager.cc:1434] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:26:00.139699 22267 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.141008 22263 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.140671 22267 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.142976 22267 ts_tablet_manager.cc:1434] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:00.143923 22267 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:00.143443 21969 catalog_manager.cc:5697] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.148474 22263 tablet_bootstrap.cc:654] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.150215 22267 tablet_bootstrap.cc:654] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.161181 22263 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.161782 22263 ts_tablet_manager.cc:1403] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:26:00.162169 22371 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.162832 22371 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.165083 22371 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.165565 22263 raft_consensus.cc:359] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.166571 22263 raft_consensus.cc:385] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.166952 22263 raft_consensus.cc:740] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.167172 22262 tablet_bootstrap.cc:654] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.168289 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.168937 22142 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:00.169927 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.167737 22263 consensus_queue.cc:260] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.170570 22218 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:00.172654 22263 ts_tablet_manager.cc:1434] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:26:00.172600 22036 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:00.172961 22425 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.180397 22375 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.180855 22375 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.180317 22425 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.181233 22375 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.182348 22263 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.186875 22262 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.189196 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.190917 22410 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.191433 22410 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.193603 22410 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.195909 22262 ts_tablet_manager.cc:1403] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.007s
I20260709 12:26:00.196372 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.197420 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.198221 22142 raft_consensus.cc:2393] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 1: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:26:00.198055 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.198835 22262 raft_consensus.cc:359] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.199564 22262 raft_consensus.cc:385] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.199615 22185 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:00.200026 22262 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.200546 22426 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.200685 22262 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.205188 22114 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:00.206354 22262 ts_tablet_manager.cc:1434] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:26:00.207392 22262 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.207762 22399 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.208232 22426 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.208987 22425 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:00.211447 22263 tablet_bootstrap.cc:654] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.190934 22375 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.221136 22329 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.223517 22262 tablet_bootstrap.cc:654] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.226824 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:00.227257 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:00.227526 22145 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.227821 22218 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.228221 22263 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.228780 22263 ts_tablet_manager.cc:1403] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.012s
I20260709 12:26:00.239095 22262 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.243753 22218 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:00.237067 22263 raft_consensus.cc:359] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.236631 22145 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:00.246918 22263 raft_consensus.cc:385] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.246580 22262 ts_tablet_manager.cc:1403] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.001s
I20260709 12:26:00.247463 22038 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:00.248380 22371 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.250320 22262 raft_consensus.cc:359] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.251509 22262 raft_consensus.cc:385] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.251798 22262 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.252492 22262 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.254573 22262 ts_tablet_manager.cc:1434] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:26:00.234624 22375 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.255656 22262 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.247305 22263 raft_consensus.cc:740] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.258390 22329 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:00.259593 22263 consensus_queue.cc:260] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.263324 22371 raft_consensus.cc:697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:00.264362 22371 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.270553 22267 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:00.270568 22263 ts_tablet_manager.cc:1434] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.004s
I20260709 12:26:00.270982 22262 tablet_bootstrap.cc:654] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.271186 22267 ts_tablet_manager.cc:1403] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.127s	user 0.018s	sys 0.031s
I20260709 12:26:00.271708 22263 tablet_bootstrap.cc:492] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.273739 22267 raft_consensus.cc:359] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.277858 22263 tablet_bootstrap.cc:654] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.274470 22267 raft_consensus.cc:385] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.278472 22267 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.280546 22267 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.282888 22142 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.284821 22267 ts_tablet_manager.cc:1434] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:26:00.286042 22267 tablet_bootstrap.cc:492] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:00.289763 22410 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.290423 22410 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.294126 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:26:00.295903 22113 leader_election.cc:343] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.296475 22410 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.297749 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.298516 22069 raft_consensus.cc:2468] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:00.299548 22263 tablet_bootstrap.cc:492] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.299711 22214 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.300020 22263 ts_tablet_manager.cc:1403] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.012s
I20260709 12:26:00.300141 22114 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:00.301710 22410 raft_consensus.cc:2804] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.302273 22410 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.302706 22410 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.303083 22263 raft_consensus.cc:359] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.303809 22263 raft_consensus.cc:385] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.304150 22263 raft_consensus.cc:740] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.305131 22263 consensus_queue.cc:260] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.308502 22470 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.311164 22410 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.312070 22263 ts_tablet_manager.cc:1434] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:26:00.325143 22263 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.325348 22375 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.326870 22425 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.327838 22262 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.327775 22425 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.328333 22262 ts_tablet_manager.cc:1403] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.073s	user 0.033s	sys 0.021s
I20260709 12:26:00.329885 22410 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.331635 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.330629 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:00.333096 22068 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:00.333213 22069 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.331707 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:00.335212 22188 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:00.336589 22425 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:00.336688 22426 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:00.337054 22113 leader_election.cc:343] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.337327 22426 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.337961 22426 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.339684 22262 raft_consensus.cc:359] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.340391 22262 raft_consensus.cc:385] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.340651 22262 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.341274 22262 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.342199 22069 raft_consensus.cc:2468] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:00.343400 22262 ts_tablet_manager.cc:1434] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:00.344336 22262 tablet_bootstrap.cc:492] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.344213 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.344826 22145 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:00.346133 22263 tablet_bootstrap.cc:654] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.343426 22114 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:00.351222 22262 tablet_bootstrap.cc:654] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.351905 22267 tablet_bootstrap.cc:654] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.355502 22399 raft_consensus.cc:2804] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.356058 22399 raft_consensus.cc:697] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:00.356905 22399 consensus_queue.cc:237] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.360634 22263 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.361212 22263 ts_tablet_manager.cc:1403] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.005s
I20260709 12:26:00.363698 22263 raft_consensus.cc:359] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.364387 22263 raft_consensus.cc:385] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.364648 22263 raft_consensus.cc:740] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.365279 22263 consensus_queue.cc:260] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.369043 22267 tablet_bootstrap.cc:492] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:00.368986 22262 tablet_bootstrap.cc:492] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.368366 21970 catalog_manager.cc:5697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.369577 22267 ts_tablet_manager.cc:1403] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.003s
I20260709 12:26:00.369674 22262 ts_tablet_manager.cc:1403] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.005s
I20260709 12:26:00.370498 22263 ts_tablet_manager.cc:1434] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:00.372033 22263 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.380602 22426 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.381152 22262 raft_consensus.cc:359] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.381418 22267 raft_consensus.cc:359] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.381839 22262 raft_consensus.cc:385] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.382536 22267 raft_consensus.cc:385] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.382838 22262 raft_consensus.cc:740] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.383044 22267 raft_consensus.cc:740] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.383780 22262 consensus_queue.cc:260] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.384131 22267 consensus_queue.cc:260] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.389503 22267 ts_tablet_manager.cc:1434] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:26:00.390270 22262 ts_tablet_manager.cc:1434] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:26:00.390441 22267 tablet_bootstrap.cc:492] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:00.391369 22262 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.399652 22426 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:00.400185 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:00.400970 22068 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.402808 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:00.404575 22145 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.410847 22262 tablet_bootstrap.cc:654] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.415166 22068 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:00.419178 22145 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:00.421054 22263 tablet_bootstrap.cc:654] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.420480 22185 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:00.422748 22426 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.423854 22426 raft_consensus.cc:697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:00.424669 22426 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.429611 22267 tablet_bootstrap.cc:654] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.434020 21969 catalog_manager.cc:5697] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.441094 22263 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.441296 22262 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.441805 22262 ts_tablet_manager.cc:1403] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.009s
I20260709 12:26:00.442165 22263 ts_tablet_manager.cc:1403] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.014s
I20260709 12:26:00.444528 22262 raft_consensus.cc:359] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.445909 22262 raft_consensus.cc:385] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.446195 22262 raft_consensus.cc:740] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.447054 22262 consensus_queue.cc:260] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.448972 22267 tablet_bootstrap.cc:492] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:00.449209 22262 ts_tablet_manager.cc:1434] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:00.449704 22267 ts_tablet_manager.cc:1403] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.006s
I20260709 12:26:00.450170 22262 tablet_bootstrap.cc:492] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.452659 22267 raft_consensus.cc:359] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.453455 22267 raft_consensus.cc:385] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.453801 22267 raft_consensus.cc:740] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.444832 22263 raft_consensus.cc:359] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.455854 22263 raft_consensus.cc:385] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.456173 22263 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.456911 22263 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.458456 22262 tablet_bootstrap.cc:654] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.457578 21970 catalog_manager.cc:5697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.459486 22263 ts_tablet_manager.cc:1434] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.004s
I20260709 12:26:00.460539 22263 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.467432 22263 tablet_bootstrap.cc:654] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.454500 22267 consensus_queue.cc:260] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.469832 22262 tablet_bootstrap.cc:492] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.470336 22262 ts_tablet_manager.cc:1403] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 12:26:00.471453 22267 ts_tablet_manager.cc:1434] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:00.472425 22267 tablet_bootstrap.cc:492] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:00.472959 22262 raft_consensus.cc:359] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.473659 22262 raft_consensus.cc:385] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.473919 22262 raft_consensus.cc:740] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.474822 22262 consensus_queue.cc:260] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.475812 22410 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.476295 22410 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.478423 22410 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.478811 22267 tablet_bootstrap.cc:654] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.480336 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.480999 22213 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:00.481223 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.481978 22068 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:00.483414 22426 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.483711 22113 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:00.483920 22426 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.484894 22399 raft_consensus.cc:2804] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.485262 22399 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.485661 22399 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.486197 22426 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:00.487243 22262 ts_tablet_manager.cc:1434] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:26:00.489264 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.490120 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.490818 22145 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:00.491390 22267 tablet_bootstrap.cc:492] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:00.491873 22267 ts_tablet_manager.cc:1403] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
W20260709 12:26:00.492451 22188 leader_election.cc:343] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.493327 22185 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:00.494445 22426 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.494838 22426 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.495177 22426 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.495285 22267 raft_consensus.cc:359] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.495968 22267 raft_consensus.cc:385] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.496243 22262 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.496227 22267 raft_consensus.cc:740] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.497426 22267 consensus_queue.cc:260] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.499840 22267 ts_tablet_manager.cc:1434] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:00.500710 22267 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:00.502169 22263 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.502668 22263 ts_tablet_manager.cc:1403] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.003s
I20260709 12:26:00.503758 22262 tablet_bootstrap.cc:654] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.509037 22267 tablet_bootstrap.cc:654] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.512892 22371 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.513491 22371 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.516227 22371 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.518918 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.521176 22213 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:00.522642 22038 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:00.519194 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.523917 22375 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.523496 22426 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.524351 22375 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:00.524223 22036 leader_election.cc:343] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.524713 22375 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.528112 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:00.528748 22145 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.528987 22263 raft_consensus.cc:359] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.529740 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:00.530835 22426 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:00.529891 22263 raft_consensus.cc:385] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.531466 22263 raft_consensus.cc:740] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
W20260709 12:26:00.532418 22188 leader_election.cc:343] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.532152 22263 consensus_queue.cc:260] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.533257 22410 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.533798 22410 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.536258 22410 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.538376 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.539124 22069 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:00.540437 22114 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:00.541492 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.542570 22410 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.543042 22410 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.543447 22410 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:00.545300 22113 leader_election.cc:343] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.549963 22375 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.553390 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:00.554742 22263 ts_tablet_manager.cc:1434] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.003s
I20260709 12:26:00.555985 22263 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.550339 22410 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:00.556681 22036 leader_election.cc:343] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.559926 22325 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.560930 22325 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.560125 22262 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.559899 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:00.562351 22069 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.563498 22267 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:00.564000 22267 ts_tablet_manager.cc:1403] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.027s
I20260709 12:26:00.563905 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.564873 22325 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.562352 22262 ts_tablet_manager.cc:1403] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.007s
I20260709 12:26:00.574332 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:00.575053 22263 tablet_bootstrap.cc:654] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.575098 22214 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.575546 22262 raft_consensus.cc:359] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.576198 22262 raft_consensus.cc:385] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.576469 22262 raft_consensus.cc:740] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.577015 22399 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.577142 22262 consensus_queue.cc:260] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.567456 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.579761 22113 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:00.580016 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:00.580605 22068 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.581986 22325 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.585363 22399 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.568558 22267 raft_consensus.cc:359] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.569377 22069 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:00.587110 22267 raft_consensus.cc:385] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.570289 22410 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.571872 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:00.587451 22267 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.588533 22114 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:00.589426 22410 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.589969 22410 raft_consensus.cc:697] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:00.590878 22410 consensus_queue.cc:237] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.591473 22214 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:00.592507 22068 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:00.594317 22375 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.594256 22038 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:00.595362 22371 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.595463 22114 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:00.595955 22371 raft_consensus.cc:697] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:00.596900 22371 consensus_queue.cc:237] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.589105 22267 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.596777 22491 raft_consensus.cc:2804] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.600417 22267 ts_tablet_manager.cc:1434] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:26:00.601051 22426 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.601075 22491 raft_consensus.cc:697] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:00.601604 22426 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.603209 22267 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:00.603734 22426 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:00.604549 22113 leader_election.cc:343] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.604776 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.605705 22068 raft_consensus.cc:2393] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:00.606673 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.604471 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:00.602643 22491 consensus_queue.cc:237] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.609465 22185 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:00.604084 22145 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:00.608404 22218 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.611549 22267 tablet_bootstrap.cc:654] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.611568 22262 ts_tablet_manager.cc:1434] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.006s
I20260709 12:26:00.615541 22426 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.616012 22262 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.618839 22185 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:00.620401 22291 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.620890 22291 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:00.621709 22291 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.637300 22262 tablet_bootstrap.cc:654] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.630370 22218 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:00.645668 22145 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.646770 22263 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.648306 22263 ts_tablet_manager.cc:1403] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.015s
I20260709 12:26:00.649477 22262 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.649955 22262 ts_tablet_manager.cc:1403] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.007s
I20260709 12:26:00.652925 22262 raft_consensus.cc:359] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.653481 22263 raft_consensus.cc:359] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.656894 22263 raft_consensus.cc:385] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.657608 22263 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.658695 21969 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.659126 22263 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.648484 22426 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.664710 22263 ts_tablet_manager.cc:1434] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:26:00.665776 22263 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.653631 22262 raft_consensus.cc:385] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.666656 22262 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.667491 22262 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.669705 22262 ts_tablet_manager.cc:1434] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.005s
I20260709 12:26:00.671134 22267 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:00.671638 22267 ts_tablet_manager.cc:1403] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.069s	user 0.030s	sys 0.014s
I20260709 12:26:00.672027 22263 tablet_bootstrap.cc:654] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.674198 22267 raft_consensus.cc:359] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.674935 22267 raft_consensus.cc:385] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.675259 22267 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.674862 21970 catalog_manager.cc:5697] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.676602 21970 catalog_manager.cc:5697] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.678882 22267 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.682381 22267 ts_tablet_manager.cc:1434] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:00.682978 22262 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.683400 22267 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:00.690822 22375 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.694456 22263 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.694972 22263 ts_tablet_manager.cc:1403] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.011s
I20260709 12:26:00.695395 22493 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.695863 22267 tablet_bootstrap.cc:654] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.695928 22493 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.697685 22263 raft_consensus.cc:359] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.698221 22493 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.698369 22263 raft_consensus.cc:385] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.698704 22263 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.699630 22263 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.699841 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.701943 22263 ts_tablet_manager.cc:1434] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
W20260709 12:26:00.702396 22114 leader_election.cc:343] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.703066 22263 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.704535 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.709892 22379 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.710456 22379 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.712682 22379 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:00.714541 22113 leader_election.cc:343] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.715096 22113 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:00.714376 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.715817 22491 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:00.717074 22185 leader_election.cc:343] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.717234 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:00.718712 22188 leader_election.cc:343] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.719146 22188 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:00.719563 22262 tablet_bootstrap.cc:654] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.720713 22263 tablet_bootstrap.cc:654] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.723148 21968 catalog_manager.cc:5697] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.725610 22379 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.738277 22375 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.740767 22263 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.741348 22263 ts_tablet_manager.cc:1403] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.008s
I20260709 12:26:00.742894 22262 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.743386 22262 ts_tablet_manager.cc:1403] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.004s
I20260709 12:26:00.744987 22263 raft_consensus.cc:359] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.748564 22263 raft_consensus.cc:385] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.749332 22263 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.749624 22262 raft_consensus.cc:359] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.750841 22263 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.750376 22262 raft_consensus.cc:385] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.751818 22262 raft_consensus.cc:740] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.752480 22263 ts_tablet_manager.cc:1434] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:26:00.752480 22262 consensus_queue.cc:260] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.753723 22263 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:00.754928 22262 ts_tablet_manager.cc:1434] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:26:00.755875 22262 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:00.760428 22263 tablet_bootstrap.cc:654] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.761441 22262 tablet_bootstrap.cc:654] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.774981 22493 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.775630 22493 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.778018 22493 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.779922 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:00.787485 22114 leader_election.cc:343] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.793716 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.794742 22218 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:00.796464 22113 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:00.798089 22493 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.798523 22493 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.798899 22493 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.818686 22493 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.822420 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:00.822866 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:00.823302 22218 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:00.827126 22114 leader_election.cc:343] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.828691 22375 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.829348 22375 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.830838 22218 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:00.832456 22375 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.833853 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.834522 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.835265 22145 raft_consensus.cc:2393] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:00.832022 22113 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:00.836155 22491 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.836671 22491 raft_consensus.cc:697] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:00.836715 22036 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:00.837678 22491 consensus_queue.cc:237] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.839352 22329 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.846357 22426 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.847040 22426 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.849414 22426 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:00.851076 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.851979 22148 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:00.853503 22185 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:00.855494 22379 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.855872 22379 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.856194 22379 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.862669 22306 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.863306 22306 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.868765 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:00.870729 22145 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:00.875765 22036 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:00.876631 22306 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.877283 22306 raft_consensus.cc:2804] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.877665 22306 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.878014 22306 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.879897 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:00.880728 22214 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:00.881878 22379 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.883651 21970 catalog_manager.cc:5697] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.885340 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:00.885634 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:00.886011 22145 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.886165 22070 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.887705 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:00.889779 22291 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.892831 22379 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:00.903566 22329 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.906737 22491 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.873612 22493 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:00.937376 22325 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:00.923218 22070 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:00.945600 22267 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:00.947605 22267 ts_tablet_manager.cc:1403] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.264s	user 0.113s	sys 0.089s
I20260709 12:26:00.947603 22262 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:00.948989 22262 ts_tablet_manager.cc:1403] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.193s	user 0.022s	sys 0.021s
I20260709 12:26:00.960929 22188 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:00.962872 22426 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.963805 22145 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:00.967711 22291 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:00.985239 22306 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:00.994776 22263 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:00.995304 22263 ts_tablet_manager.cc:1403] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.242s	user 0.044s	sys 0.099s
I20260709 12:26:01.002359 22263 raft_consensus.cc:359] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.003225 22263 raft_consensus.cc:385] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.003618 22263 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.004621 22267 raft_consensus.cc:359] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.005172 22267 raft_consensus.cc:385] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.005347 22267 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.006475 22263 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.006867 22267 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.009893 22262 raft_consensus.cc:359] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.010627 22262 raft_consensus.cc:385] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.010897 22262 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.012235 22263 ts_tablet_manager.cc:1434] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:26:01.013288 22263 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.011855 22426 raft_consensus.cc:697] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:01.017525 22306 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.018873 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:01.019073 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:01.019524 22148 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.019659 22214 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.019884 22262 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.039866 22148 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:01.041805 22262 ts_tablet_manager.cc:1434] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.001s
I20260709 12:26:01.045301 22262 tablet_bootstrap.cc:492] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.042454 22267 ts_tablet_manager.cc:1434] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.002s
I20260709 12:26:01.048491 22267 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:01.044070 22214 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:01.050974 22038 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:01.052620 22470 raft_consensus.cc:2804] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.053167 22426 consensus_queue.cc:237] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.054796 22491 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:01.056260 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:01.059351 22262 tablet_bootstrap.cc:654] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.053109 22470 raft_consensus.cc:697] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:01.067160 22470 consensus_queue.cc:237] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.070245 22263 tablet_bootstrap.cc:654] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.075354 22513 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.077931 22291 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.078480 22291 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.081043 22291 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:01.083194 22267 tablet_bootstrap.cc:654] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.084113 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:01.087882 22185 leader_election.cc:343] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:01.088900 22036 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:01.090467 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:01.092569 22188 leader_election.cc:343] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.093041 22188 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:01.094637 22514 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.096249 22263 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:01.096685 22263 ts_tablet_manager.cc:1403] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.000s
I20260709 12:26:01.105460 22379 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.105845 22493 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.110476 22262 tablet_bootstrap.cc:492] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:01.111096 22262 ts_tablet_manager.cc:1403] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.000s
I20260709 12:26:01.111222 22267 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:01.111708 22267 ts_tablet_manager.cc:1403] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.006s
W20260709 12:26:01.112531 22113 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:01.121986 22493 consensus_queue.cc:1048] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.133551 21971 catalog_manager.cc:5697] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.140456 22513 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.141068 22513 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.148881 22513 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:01.150166 22325 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.150856 22325 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.152908 22325 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.154989 22263 raft_consensus.cc:359] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.155704 22263 raft_consensus.cc:385] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.156180 22263 raft_consensus.cc:740] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.155570 22262 raft_consensus.cc:359] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.156450 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.156721 22262 raft_consensus.cc:385] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.157099 22068 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:01.156936 22263 consensus_queue.cc:260] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.157173 22262 raft_consensus.cc:740] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.158840 22267 raft_consensus.cc:359] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.160209 22114 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:01.160425 22267 raft_consensus.cc:385] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.161031 22267 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.161257 22491 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.161958 22491 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.162333 22491 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.162796 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.162452 22267 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.164638 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.165294 22213 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:01.167382 22306 consensus_queue.cc:1048] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.168290 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.168980 22069 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:01.172050 22267 ts_tablet_manager.cc:1434] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.060s	user 0.018s	sys 0.000s
I20260709 12:26:01.172987 22267 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:01.173331 22491 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.174975 22148 raft_consensus.cc:2393] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:01.160207 22262 consensus_queue.cc:260] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.160249 22263 ts_tablet_manager.cc:1434] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.003s
I20260709 12:26:01.177868 22263 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.178767 22267 tablet_bootstrap.cc:654] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.180557 22426 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.181114 22426 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.183374 22263 tablet_bootstrap.cc:654] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.183539 22188 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:01.184861 22513 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.185248 22513 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.185621 22513 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.188591 22262 ts_tablet_manager.cc:1434] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:26:01.190299 21971 catalog_manager.cc:5697] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.191730 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:01.192413 22068 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.195066 22267 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:01.195567 22267 ts_tablet_manager.cc:1403] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.001s
I20260709 12:26:01.198141 22262 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.200397 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:01.203228 22494 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.203876 22494 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.207077 22267 raft_consensus.cc:359] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.207782 22267 raft_consensus.cc:385] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.207943 22068 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:01.208077 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.208953 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.208108 22267 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.209642 22069 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:01.210460 22513 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.210626 22267 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:01.211215 22113 leader_election.cc:343] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.211665 22218 raft_consensus.cc:2393] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:01.212026 22114 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:01.212811 22399 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.212971 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:01.213327 22399 raft_consensus.cc:697] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:01.213939 22493 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.214314 22493 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.214241 22399 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.215236 22493 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.217525 22426 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:01.206514 22494 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.218891 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.219355 22491 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:01.220579 22185 leader_election.cc:343] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.224486 22493 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.225134 22262 tablet_bootstrap.cc:654] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.224998 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:01.227816 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:01.229723 22068 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.212965 22267 ts_tablet_manager.cc:1434] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:26:01.230656 22263 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:01.231132 22263 ts_tablet_manager.cc:1403] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 12:26:01.231221 22426 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.231520 22267 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:01.231719 22426 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.233776 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:01.234519 22070 raft_consensus.cc:2393] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:01.234979 22263 raft_consensus.cc:359] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.228575 22493 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.229058 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.229192 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:01.238137 22263 raft_consensus.cc:385] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.237286 22262 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:01.238193 22267 tablet_bootstrap.cc:654] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.238969 22262 ts_tablet_manager.cc:1403] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.002s
I20260709 12:26:01.238473 22263 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.228241 22513 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:01.239403 22113 leader_election.cc:343] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.239952 22263 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.241688 22426 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:01.242846 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.243551 22148 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:01.244971 22185 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:01.245726 22263 ts_tablet_manager.cc:1434] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 12:26:01.243629 22262 raft_consensus.cc:359] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.245918 22513 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.246202 22262 raft_consensus.cc:385] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.246395 22513 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.246651 22262 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.247246 22188 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:01.247107 22068 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:01.248168 22262 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.248626 22426 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.246774 22263 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.248785 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:01.247529 22513 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:01.250239 22188 leader_election.cc:343] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.250808 22188 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:01.251879 22426 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.257673 22262 ts_tablet_manager.cc:1434] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:26:01.258812 22262 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.259609 22493 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.260116 22493 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:01.260933 22493 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.263137 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.263863 22068 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:01.268072 22267 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:01.268280 22513 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.270162 22267 ts_tablet_manager.cc:1403] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.010s
I20260709 12:26:01.272275 22263 tablet_bootstrap.cc:654] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.272027 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:01.272773 22148 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.274169 22267 raft_consensus.cc:359] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.275017 22267 raft_consensus.cc:385] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.272032 22262 tablet_bootstrap.cc:654] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.275425 22267 raft_consensus.cc:740] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.276346 22267 consensus_queue.cc:260] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.278772 22267 ts_tablet_manager.cc:1434] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:01.279800 22267 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:01.280624 22148 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:01.282079 22185 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:01.283077 22426 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.283834 22426 raft_consensus.cc:697] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:01.284746 22426 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.289316 22262 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:01.290210 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:01.291987 22267 tablet_bootstrap.cc:654] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.292215 22068 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.294994 22513 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:01.296114 21970 catalog_manager.cc:5697] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.291215 22263 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:01.299032 22263 ts_tablet_manager.cc:1403] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.001s
I20260709 12:26:01.301921 22263 raft_consensus.cc:359] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.302564 22263 raft_consensus.cc:385] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.302857 22263 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.303514 22263 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.304988 22262 ts_tablet_manager.cc:1403] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.000s
I20260709 12:26:01.307211 22068 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:01.313549 22263 ts_tablet_manager.cc:1434] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 12:26:01.315739 22263 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.320130 22267 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:01.320586 22267 ts_tablet_manager.cc:1403] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.011s
I20260709 12:26:01.327610 21971 catalog_manager.cc:5697] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.323064 22493 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.329737 22493 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.330868 22262 raft_consensus.cc:359] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.331586 22262 raft_consensus.cc:385] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.331792 22262 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.332335 22262 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.333648 22493 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.334904 22426 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.335378 22426 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.336418 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.337476 22426 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:01.337971 22114 leader_election.cc:343] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.339793 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.340518 22068 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:01.340631 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.341748 22188 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:26:01.343191 22185 leader_election.cc:343] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.344862 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.343811 22426 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.345712 22218 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:01.349005 22426 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.349435 22426 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.349963 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:01.351541 22399 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.351859 22399 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.352042 22263 tablet_bootstrap.cc:654] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.352137 22399 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.346693 22262 ts_tablet_manager.cc:1434] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:26:01.353724 22262 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.357426 22267 raft_consensus.cc:359] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.369089 22267 raft_consensus.cc:385] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.369961 22267 raft_consensus.cc:740] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.371369 22262 tablet_bootstrap.cc:654] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.373031 22267 consensus_queue.cc:260] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.349858 21968 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:01.375866 22114 consensus_peers.cc:597] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:01.379372 22426 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.388461 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:01.389292 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:01.390111 22068 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.377278 22399 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:01.391898 22185 leader_election.cc:343] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.380682 22267 ts_tablet_manager.cc:1434] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.005s
I20260709 12:26:01.395010 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:01.397073 22399 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.391970 22426 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:01.398486 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:01.407687 22217 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.400018 22263 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:01.412740 22263 ts_tablet_manager.cc:1403] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.009s
I20260709 12:26:01.414672 22263 raft_consensus.cc:359] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.415338 22263 raft_consensus.cc:385] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.415593 22263 raft_consensus.cc:740] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.416327 22263 consensus_queue.cc:260] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.417474 22217 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:01.400347 22262 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
W20260709 12:26:01.401055 22114 leader_election.cc:343] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.418771 22262 ts_tablet_manager.cc:1403] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.065s	user 0.031s	sys 0.011s
I20260709 12:26:01.419193 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:01.406786 22267 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:01.416993 22068 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:01.424460 22188 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:01.425684 22263 ts_tablet_manager.cc:1434] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:01.423985 22399 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.425603 22426 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.426791 22263 tablet_bootstrap.cc:492] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.426661 22426 raft_consensus.cc:697] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:01.428916 22399 raft_consensus.cc:697] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:01.429177 22426 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.431342 22267 tablet_bootstrap.cc:654] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.429184 22262 raft_consensus.cc:359] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.432829 22262 raft_consensus.cc:385] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.433104 22262 raft_consensus.cc:740] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.433758 22493 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.433728 22262 consensus_queue.cc:260] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.436147 22262 ts_tablet_manager.cc:1434] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:26:01.437070 22262 tablet_bootstrap.cc:492] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.437872 22263 tablet_bootstrap.cc:654] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.449791 22262 tablet_bootstrap.cc:654] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.458729 22262 tablet_bootstrap.cc:492] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:01.459205 22262 ts_tablet_manager.cc:1403] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:26:01.460256 22513 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.460848 22513 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.464421 22262 raft_consensus.cc:359] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.465297 22262 raft_consensus.cc:385] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.465619 22262 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.470211 22262 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.471756 22375 consensus_queue.cc:1048] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.473546 22262 ts_tablet_manager.cc:1434] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:26:01.474459 22262 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.482649 22494 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.483250 22494 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.485422 22494 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.485801 22513 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:01.487154 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.489785 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:01.491665 22114 leader_election.cc:343] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.492862 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.493954 22069 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:01.498667 22262 tablet_bootstrap.cc:654] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.502315 22188 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:01.506807 22514 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.513178 22375 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.513862 22375 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.514103 22329 consensus_queue.cc:1048] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.515924 22375 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.519073 22514 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.522447 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.523141 22213 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:01.524924 22038 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:01.526023 22493 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.526821 22493 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.529078 22470 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.529492 22470 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.529811 22470 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.530200 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.536823 22262 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:01.537348 22262 ts_tablet_manager.cc:1403] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 12:26:01.541280 22493 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.444048 22399 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.549263 22262 raft_consensus.cc:359] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.549995 22262 raft_consensus.cc:385] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.550274 22262 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.551005 22262 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.551321 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.551940 22145 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:01.543666 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.558295 22262 ts_tablet_manager.cc:1434] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:26:01.559379 22262 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.562079 22470 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.564116 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:26:01.565620 22113 leader_election.cc:343] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.566162 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:01.575367 22263 tablet_bootstrap.cc:492] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:01.576066 22263 ts_tablet_manager.cc:1403] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.150s	user 0.030s	sys 0.052s
I20260709 12:26:01.566170 22470 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.578703 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:01.579283 22148 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.579206 22426 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.577761 22493 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.582121 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:01.583788 22491 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.585963 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:01.586653 22218 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.587026 22375 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.587553 22375 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.589908 22375 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.590376 22267 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:01.590884 22267 ts_tablet_manager.cc:1403] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.196s	user 0.074s	sys 0.074s
I20260709 12:26:01.591764 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.592020 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.593508 22267 raft_consensus.cc:359] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.594254 22267 raft_consensus.cc:385] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.594074 22036 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:01.594569 22267 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.594079 22218 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:01.598837 22267 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.600643 22148 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:01.603536 22038 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:01.606067 22470 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.607434 22470 raft_consensus.cc:697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:01.608384 22470 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.599140 22375 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.610241 22267 ts_tablet_manager.cc:1434] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:26:01.617383 22267 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:01.623591 22426 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:01.629881 22262 tablet_bootstrap.cc:654] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.651356 21971 catalog_manager.cc:5697] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.650315 21970 catalog_manager.cc:5697] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.658365 22263 raft_consensus.cc:359] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.661177 22263 raft_consensus.cc:385] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.661577 22263 raft_consensus.cc:740] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.662297 22263 consensus_queue.cc:260] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.664034 22263 ts_tablet_manager.cc:1434] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 12:26:01.664974 22263 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.667848 22267 tablet_bootstrap.cc:654] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.673081 22399 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.699056 22263 tablet_bootstrap.cc:654] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.698495 21968 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.704855 22145 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.723073 22399 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.723601 22399 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.725106 22262 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:01.725637 22262 ts_tablet_manager.cc:1403] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.004s
I20260709 12:26:01.727018 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.727924 22069 raft_consensus.cc:2393] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:01.728209 22262 raft_consensus.cc:359] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.728849 22262 raft_consensus.cc:385] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.729102 22262 raft_consensus.cc:740] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.730381 22262 consensus_queue.cc:260] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.730818 22399 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.731025 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.732245 22262 ts_tablet_manager.cc:1434] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:01.732599 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:01.733628 22262 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.733827 22399 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.736531 22263 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:01.737125 22263 ts_tablet_manager.cc:1403] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.005s
I20260709 12:26:01.742137 22399 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.743966 22263 raft_consensus.cc:359] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.757087 22263 raft_consensus.cc:385] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.757488 22263 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.759176 22263 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.761891 22263 ts_tablet_manager.cc:1434] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:26:01.749962 22262 tablet_bootstrap.cc:654] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.763582 22494 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.765498 22514 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.766070 22514 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.766476 22263 tablet_bootstrap.cc:492] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.770269 22514 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:01.771112 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.772975 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.775074 22267 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:01.785058 22267 ts_tablet_manager.cc:1403] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.168s	user 0.026s	sys 0.025s
W20260709 12:26:01.785924 22185 leader_election.cc:343] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:01.786865 22188 leader_election.cc:343] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.787277 22188 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:01.788232 22267 raft_consensus.cc:359] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.789081 22267 raft_consensus.cc:385] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.789377 22267 raft_consensus.cc:740] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.790095 22267 consensus_queue.cc:260] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.791368 22514 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.792888 22267 ts_tablet_manager.cc:1434] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:01.793949 22267 tablet_bootstrap.cc:492] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:01.800299 22072 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.779253 22263 tablet_bootstrap.cc:654] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.808449 22267 tablet_bootstrap.cc:654] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.779789 22493 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.813055 22493 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.814007 22263 tablet_bootstrap.cc:492] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:01.815058 22263 ts_tablet_manager.cc:1403] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 12:26:01.816376 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.817122 22069 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:01.818225 22114 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:01.818403 22263 raft_consensus.cc:359] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.819142 22263 raft_consensus.cc:385] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.814543 22491 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:26:01.819736 22263 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.820665 22263 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.823486 22263 ts_tablet_manager.cc:1434] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:01.824427 22263 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.819077 22494 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.827615 22494 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.828029 22494 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.838985 22263 tablet_bootstrap.cc:654] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.840260 22262 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:01.840945 22262 ts_tablet_manager.cc:1403] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.108s	user 0.020s	sys 0.016s
I20260709 12:26:01.843544 22267 tablet_bootstrap.cc:492] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:01.844023 22267 ts_tablet_manager.cc:1403] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.006s
I20260709 12:26:01.843683 22262 raft_consensus.cc:359] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.844492 22262 raft_consensus.cc:385] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.844784 22262 raft_consensus.cc:740] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.845613 22262 consensus_queue.cc:260] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.846869 22267 raft_consensus.cc:359] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.847553 22267 raft_consensus.cc:385] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.847833 22267 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.848799 22267 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.851042 22267 ts_tablet_manager.cc:1434] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:01.851989 22267 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:01.860173 22426 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.862581 22267 tablet_bootstrap.cc:654] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.863826 22564 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.870271 22564 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.866348 22263 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:01.872447 22263 ts_tablet_manager.cc:1403] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 12:26:01.873783 22491 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.875556 22263 raft_consensus.cc:359] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.874630 22493 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.864945 22291 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.876246 22263 raft_consensus.cc:385] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.876605 22291 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.878113 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.878892 22291 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:01.879340 22114 leader_election.cc:343] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.880532 22564 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.876559 22263 raft_consensus.cc:740] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.881605 22263 consensus_queue.cc:260] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.883684 22263 ts_tablet_manager.cc:1434] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:01.885164 22263 tablet_bootstrap.cc:492] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:01.885943 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:01.887048 22494 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.894394 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:01.897836 22188 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:01.896787 22514 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:26:01.901209 22267 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:01.901691 22267 ts_tablet_manager.cc:1403] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.002s
I20260709 12:26:01.902181 22291 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.905766 22262 ts_tablet_manager.cc:1434] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.009s
I20260709 12:26:01.907006 22262 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:01.907574 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:01.908277 22068 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.923877 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.924777 22218 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:01.918468 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:01.935284 22113 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:26:01.943984 22113 leader_election.cc:343] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.945928 22493 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.946341 22493 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.946729 22493 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.967522 22564 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.975078 22564 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:01.977602 22564 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.984165 22470 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.984483 22494 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:01.993584 22379 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.994771 22470 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.003365 22263 tablet_bootstrap.cc:700] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent opening tablet: real 0.102s	user 0.002s	sys 0.000s
I20260709 12:26:02.004055 22263 tablet_bootstrap.cc:654] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.010453 22267 raft_consensus.cc:359] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.011876 22267 raft_consensus.cc:385] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.014240 22267 raft_consensus.cc:740] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.004103 22470 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.015218 22267 consensus_queue.cc:260] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.009045 22068 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
W20260709 12:26:02.004417 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 60491.4us
I20260709 12:26:02.019861 22267 ts_tablet_manager.cc:1434] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.118s	user 0.011s	sys 0.011s
I20260709 12:26:02.021328 22267 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:02.018054 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:02.025378 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:02.020426 22514 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.027886 22514 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.028528 22493 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.028457 22214 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.029912 22514 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:02.036243 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:02.041841 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:02.043206 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:02.036968 22426 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 12:26:02.046890 22188 leader_election.cc:343] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.045907 22217 raft_consensus.cc:2393] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:02.047878 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:02.055946 22218 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:02.054857 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:02.061205 22038 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:02.062690 22329 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:02.062934 22185 leader_election.cc:343] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.063433 22185 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:02.049679 22114 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:02.064628 22263 tablet_bootstrap.cc:492] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:02.072721 22262 tablet_bootstrap.cc:654] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.109270 22263 ts_tablet_manager.cc:1403] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.224s	user 0.011s	sys 0.017s
I20260709 12:26:02.091387 22375 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.119562 22569 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.120121 22569 raft_consensus.cc:697] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:02.120925 22569 consensus_queue.cc:237] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.113971 22375 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.074446 22291 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.104928 22493 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:02.113859 22113 leader_election.cc:343] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.134810 22267 tablet_bootstrap.cc:654] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:02.118877 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 71789.8us
I20260709 12:26:02.159617 22573 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:26:02.155658 22114 leader_election.cc:343] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.162286 22329 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.168154 22263 raft_consensus.cc:359] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.168879 22263 raft_consensus.cc:385] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.169164 22263 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.169906 22263 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.170735 22514 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.171104 22375 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.171953 22263 ts_tablet_manager.cc:1434] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.003s
I20260709 12:26:02.171166 22514 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.175457 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:02.176280 22218 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:02.178524 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:02.219373 22263 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
W20260709 12:26:02.243294 22578 log.cc:927] Time spent T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:26:02.358698 22267 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:02.359453 22267 ts_tablet_manager.cc:1403] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.339s	user 0.027s	sys 0.039s
I20260709 12:26:02.361039 22038 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:02.366456 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:02.355979 22514 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:02.369675 22188 leader_election.cc:343] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.362957 22574 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.378759 22574 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.383195 22574 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.427790 22263 tablet_bootstrap.cc:654] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:02.427879 22114 leader_election.cc:343] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.430966 22574 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:02.455047 22581 log.cc:927] Time spent T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:26:02.455427 22575 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.462210 22574 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.471140 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:02.471648 22267 raft_consensus.cc:359] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.472389 22267 raft_consensus.cc:385] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.472683 22267 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.459547 22470 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.484246 22267 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.485548 22470 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.488879 22470 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.490061 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:02.490896 22217 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
W20260709 12:26:02.491773 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 436024us
I20260709 12:26:02.492426 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:02.493083 22218 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:02.493283 22185 leader_election.cc:343] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.493754 22185 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:02.494452 22577 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:02.510288 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:02.510514 22218 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:02.512007 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:02.512868 22585 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.513267 22585 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.513597 22585 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.517091 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:02.517706 22219 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.528476 22267 ts_tablet_manager.cc:1434] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.169s	user 0.008s	sys 0.006s
I20260709 12:26:02.533833 22219 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:02.534374 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:02.535027 22143 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:02.535882 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:02.536675 22038 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:02.535058 22113 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:02.530786 22589 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:26:02.541608 22262 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:02.542052 22262 ts_tablet_manager.cc:1403] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.635s	user 0.056s	sys 0.079s
I20260709 12:26:02.547399 22267 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:02.541492 22329 raft_consensus.cc:2804] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.541399 22470 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.543774 22399 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.551764 22589 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:26:02.555320 22329 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.565281 22329 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.560036 22470 raft_consensus.cc:697] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:02.567462 22470 consensus_queue.cc:237] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.560707 22399 raft_consensus.cc:697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:02.571343 22399 consensus_queue.cc:237] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.582827 21971 catalog_manager.cc:5697] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.574258 22585 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.585170 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:02.586167 22146 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.602924 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:02.604594 22585 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.610867 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:02.611570 22221 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.650811 22262 raft_consensus.cc:359] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.656011 22262 raft_consensus.cc:385] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.653360 22329 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.656355 22262 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.667176 22267 tablet_bootstrap.cc:654] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.670794 22262 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.672227 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:02.675015 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:02.675638 22219 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.680294 22329 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.690163 22262 ts_tablet_manager.cc:1434] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.148s	user 0.008s	sys 0.000s
W20260709 12:26:02.687426 22036 leader_election.cc:343] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.695684 22219 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:02.683247 22221 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:02.700260 22594 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.688738 22146 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:02.707350 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:02.710381 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:02.707721 22594 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.714686 22569 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.715312 22594 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.718257 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:02.719003 22213 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:02.710199 22593 raft_consensus.cc:2804] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.720203 22038 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:02.721143 22470 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.721490 22470 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.721803 22470 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.720273 22593 raft_consensus.cc:697] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:26:02.725205 22597 log.cc:927] Time spent T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:26:02.728701 22262 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:02.734177 22263 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:02.734858 22263 ts_tablet_manager.cc:1403] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.516s	user 0.033s	sys 0.041s
I20260709 12:26:02.723099 22569 raft_consensus.cc:697] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:02.742524 22267 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:02.743202 22267 ts_tablet_manager.cc:1403] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.198s	user 0.021s	sys 0.013s
I20260709 12:26:02.736301 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:02.748802 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:02.745164 22593 consensus_queue.cc:237] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.749488 22145 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
W20260709 12:26:02.750427 22596 log.cc:927] Time spent T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:26:02.743175 22114 leader_election.cc:343] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.759977 22267 raft_consensus.cc:359] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.762214 22267 raft_consensus.cc:385] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.762542 22267 raft_consensus.cc:740] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.761500 22569 consensus_queue.cc:237] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:02.766434 22036 leader_election.cc:343] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.771275 22263 raft_consensus.cc:359] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.772347 22263 raft_consensus.cc:385] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.772677 22263 raft_consensus.cc:740] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.773460 22263 consensus_queue.cc:260] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.776618 22267 consensus_queue.cc:260] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:02.779894 22113 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.782482 22267 ts_tablet_manager.cc:1434] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 12:26:02.778863 22263 ts_tablet_manager.cc:1434] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:26:02.784618 22263 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:02.784637 22267 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:02.782900 22494 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:26:02.782042 22470 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.798847 22262 tablet_bootstrap.cc:654] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.800040 22575 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.800595 22575 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.801843 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:02.804746 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:02.803164 22146 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.806533 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:02.807273 22219 raft_consensus.cc:2393] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:02.808418 22038 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:02.804349 22575 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.812691 22593 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.816608 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:02.817476 22219 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.817721 22146 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:02.819432 22036 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:02.820290 22267 tablet_bootstrap.cc:654] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.815454 22470 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:02.821049 22575 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.824759 22575 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:02.825577 22575 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.832857 22593 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.840700 22219 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:02.845207 22263 tablet_bootstrap.cc:654] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.860103 22263 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:02.860682 22263 ts_tablet_manager.cc:1403] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.000s
I20260709 12:26:02.871752 22262 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:02.872386 22262 ts_tablet_manager.cc:1403] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.013s
I20260709 12:26:02.875166 22262 raft_consensus.cc:359] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.880411 22267 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:02.880966 22267 ts_tablet_manager.cc:1403] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.012s
I20260709 12:26:02.882994 22262 raft_consensus.cc:385] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.883457 22262 raft_consensus.cc:740] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.883575 22267 raft_consensus.cc:359] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.884279 22267 raft_consensus.cc:385] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.884625 22267 raft_consensus.cc:740] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.884299 22262 consensus_queue.cc:260] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.885320 22267 consensus_queue.cc:260] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.887543 22267 ts_tablet_manager.cc:1434] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:26:02.888568 22267 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:02.887509 22262 ts_tablet_manager.cc:1434] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:02.890848 22262 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:02.893455 22263 raft_consensus.cc:359] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.894038 21969 catalog_manager.cc:5697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.894183 22263 raft_consensus.cc:385] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.943106 22263 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.943325 22262 tablet_bootstrap.cc:654] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.943818 22267 tablet_bootstrap.cc:654] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.943953 22263 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.942061 21969 catalog_manager.cc:5697] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.948876 22263 ts_tablet_manager.cc:1434] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.007s
I20260709 12:26:02.949950 22263 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:02.956696 22263 tablet_bootstrap.cc:654] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.957629 22577 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.958127 22577 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.960348 22577 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:02.962049 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:02.963562 22185 leader_election.cc:343] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.964821 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:02.970034 22188 leader_election.cc:343] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.970522 22188 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:02.971356 22577 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.981166 22267 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:02.981716 22267 ts_tablet_manager.cc:1403] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.093s	user 0.026s	sys 0.012s
I20260709 12:26:02.983199 22263 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:02.983698 22263 ts_tablet_manager.cc:1403] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.009s
I20260709 12:26:02.984453 22267 raft_consensus.cc:359] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.985163 22267 raft_consensus.cc:385] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.985453 22267 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.986491 22263 raft_consensus.cc:359] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.987208 22263 raft_consensus.cc:385] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.987485 22263 raft_consensus.cc:740] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.986133 22267 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.991520 22267 ts_tablet_manager.cc:1434] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:02.992478 22267 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:02.992408 22263 consensus_queue.cc:260] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.998117 22263 ts_tablet_manager.cc:1434] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:26:02.998724 22267 tablet_bootstrap.cc:654] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.981192 22262 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:02.999289 22263 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:02.999452 22262 ts_tablet_manager.cc:1403] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.109s	user 0.023s	sys 0.036s
I20260709 12:26:03.002206 22262 raft_consensus.cc:359] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.002915 22262 raft_consensus.cc:385] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.003185 22262 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.003948 22262 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:02.977355 21970 catalog_manager.cc:5697] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.006209 22262 ts_tablet_manager.cc:1434] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:03.006074 21970 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.007174 22262 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:03.007761 21970 catalog_manager.cc:5697] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.014051 22262 tablet_bootstrap.cc:654] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.023517 22588 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.043221 22263 tablet_bootstrap.cc:654] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.047765 22262 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:03.048291 22262 ts_tablet_manager.cc:1403] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.012s
I20260709 12:26:03.056748 22588 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:03.069628 22267 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:03.070145 22267 ts_tablet_manager.cc:1403] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.000s
I20260709 12:26:03.082378 22262 raft_consensus.cc:359] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.083148 22262 raft_consensus.cc:385] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.083416 22262 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.084076 22262 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.086037 22267 raft_consensus.cc:359] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.086756 22267 raft_consensus.cc:385] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.087155 22267 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.090647 22263 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:03.091252 22263 ts_tablet_manager.cc:1403] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.092s	user 0.021s	sys 0.007s
I20260709 12:26:03.095340 22267 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.097740 22267 ts_tablet_manager.cc:1434] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:26:03.098277 22470 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.098779 22470 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.099467 22262 ts_tablet_manager.cc:1434] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:26:03.100752 22470 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.101312 22267 tablet_bootstrap.cc:492] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:03.104624 22262 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:03.104353 22263 raft_consensus.cc:359] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.105121 22263 raft_consensus.cc:385] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.105449 22263 raft_consensus.cc:740] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.106312 22263 consensus_queue.cc:260] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.106894 22575 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.108815 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:03.110060 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.110674 22216 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:03.112588 22038 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:03.113370 22585 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.113854 22585 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.114656 22593 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.115020 22593 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.115394 22267 tablet_bootstrap.cc:654] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.115769 22585 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:03.116143 22036 leader_election.cc:343] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.118537 22262 tablet_bootstrap.cc:654] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.118723 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:03.119678 22066 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:03.122895 22114 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:03.123749 22587 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.124112 22587 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.124475 22587 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.125322 22263 ts_tablet_manager.cc:1434] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:26:03.126422 22263 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:03.132071 22267 tablet_bootstrap.cc:492] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:03.132602 22267 ts_tablet_manager.cc:1403] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.001s
I20260709 12:26:03.134418 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.135136 22216 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:03.137121 22262 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:03.137581 22262 ts_tablet_manager.cc:1403] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.006s
I20260709 12:26:03.115332 22593 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.140244 22267 raft_consensus.cc:359] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.141062 22267 raft_consensus.cc:385] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.141320 22267 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.142891 22262 raft_consensus.cc:359] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.143668 22262 raft_consensus.cc:385] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.143939 22262 raft_consensus.cc:740] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.145360 22575 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:03.144722 22267 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.149171 22263 tablet_bootstrap.cc:654] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.150089 22262 consensus_queue.cc:260] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.158430 22267 ts_tablet_manager.cc:1434] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 12:26:03.158820 22262 ts_tablet_manager.cc:1434] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:26:03.159507 22267 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:03.159795 22262 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:03.168334 22593 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.180049 22587 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.198349 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:03.199072 22066 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.200713 22593 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.207639 22577 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.209744 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:03.219877 22213 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.221168 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:03.221772 22219 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.218900 22577 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.213775 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:03.226882 22426 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.231063 22426 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.231371 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:03.227276 22577 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:03.232024 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:03.232702 22575 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.233132 22426 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:03.233211 22575 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.232643 22144 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
W20260709 12:26:03.235486 22188 leader_election.cc:343] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.236490 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:03.237128 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:03.238760 22145 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.239905 22185 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:03.242990 22426 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.243469 22426 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.243752 22188 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:03.223309 22587 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.244952 22494 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:03.245800 22577 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:03.250061 22470 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.243800 22426 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.253383 22575 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.242951 22219 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:03.254387 22214 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.230242 22066 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:03.255596 22113 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:03.258360 22587 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.282117 22262 tablet_bootstrap.cc:654] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:03.286295 22036 leader_election.cc:343] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.291719 22426 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.293998 22426 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:03.287110 22587 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:03.296590 22587 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.303313 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:03.304088 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:03.305398 22213 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:03.306877 22066 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:03.308415 22188 leader_election.cc:343] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.310842 22470 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:03.298916 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:03.271456 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.322027 22038 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:03.329114 22575 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.329667 22575 raft_consensus.cc:697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:03.330767 22575 consensus_queue.cc:237] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.319698 22585 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.339102 21970 catalog_manager.cc:5697] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.344313 22585 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.349552 22585 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.351465 22593 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:03.336921 22144 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.359710 22267 tablet_bootstrap.cc:654] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.358922 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:03.377139 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 66559.8us
I20260709 12:26:03.377892 22036 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:03.374115 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.366529 22585 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:26:03.386337 22113 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:03.392107 22262 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:03.393026 22262 ts_tablet_manager.cc:1403] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.233s	user 0.024s	sys 0.019s
I20260709 12:26:03.390769 22588 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.425734 21969 catalog_manager.cc:5697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.390443 22575 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:03.432840 22263 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:03.433440 22263 ts_tablet_manager.cc:1403] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.307s	user 0.034s	sys 0.033s
I20260709 12:26:03.432822 22144 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:03.446126 22185 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:03.447223 22426 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.447794 22426 raft_consensus.cc:697] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:03.448803 22426 consensus_queue.cc:237] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.460568 22263 raft_consensus.cc:359] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.461323 22263 raft_consensus.cc:385] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.461581 22263 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.462260 22263 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.470942 22262 raft_consensus.cc:359] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.471666 22262 raft_consensus.cc:385] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.471927 22262 raft_consensus.cc:740] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.473786 22263 ts_tablet_manager.cc:1434] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:26:03.474812 22263 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:03.474200 22262 consensus_queue.cc:260] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.478485 22267 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:03.479104 22267 ts_tablet_manager.cc:1403] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.320s	user 0.011s	sys 0.020s
I20260709 12:26:03.478422 22593 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:26:03.507647 22587 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.508211 22587 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.511145 22587 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.514706 22262 ts_tablet_manager.cc:1434] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.001s
I20260709 12:26:03.515928 22262 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:03.516651 22593 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.517237 22593 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.519994 22593 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.523614 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:03.523828 22267 raft_consensus.cc:359] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:03.525213 22036 leader_election.cc:343] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.524456 22267 raft_consensus.cc:385] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.559177 22267 raft_consensus.cc:740] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.563362 22263 tablet_bootstrap.cc:654] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.563730 22267 consensus_queue.cc:260] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.572763 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:03.597087 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 143585us
I20260709 12:26:03.603305 22267 ts_tablet_manager.cc:1434] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.124s	user 0.017s	sys 0.011s
I20260709 12:26:03.604430 22267 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:03.608546 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.609233 22214 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
W20260709 12:26:03.627703 22641 log.cc:927] Time spent T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:26:03.632520 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:03.632346 22113 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:26:03.637075 22114 leader_election.cc:343] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.636291 22569 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.651841 22569 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.666460 22569 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.692862 22267 tablet_bootstrap.cc:654] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.693114 22569 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.700424 22569 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.716524 22262 tablet_bootstrap.cc:654] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.716809 21969 catalog_manager.cc:5697] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.717479 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:03.718163 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.728615 22220 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:03.729842 22038 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:03.731103 22650 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.731518 22650 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.731855 22650 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.724668 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:03.734795 22216 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.758908 22650 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.762766 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:26:03.764230 22036 leader_election.cc:343] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.764597 22588 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.765076 22588 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.767592 22588 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.769369 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:03.773331 22262 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:03.775535 22262 ts_tablet_manager.cc:1403] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.260s	user 0.020s	sys 0.008s
I20260709 12:26:03.773310 22650 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.782373 22216 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
W20260709 12:26:03.784834 22114 leader_election.cc:343] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:03.786105 22114 leader_election.cc:343] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.789283 22113 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:03.793079 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.791321 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:03.796581 22220 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.794016 22588 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.797461 22588 raft_consensus.cc:697] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:03.798272 22588 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:03.801184 22113 leader_election.cc:343] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.801599 22113 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:03.803712 22639 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:03.805142 22263 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:03.805606 22263 ts_tablet_manager.cc:1403] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.331s	user 0.024s	sys 0.018s
I20260709 12:26:03.811967 22263 raft_consensus.cc:359] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.812668 22263 raft_consensus.cc:385] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.812914 22263 raft_consensus.cc:740] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.813017 22262 raft_consensus.cc:359] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.813717 22262 raft_consensus.cc:385] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.813978 22262 raft_consensus.cc:740] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.814615 22262 consensus_queue.cc:260] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.817548 22220 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:03.818614 22038 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:03.819479 22630 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.819190 22263 consensus_queue.cc:260] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.820815 22263 ts_tablet_manager.cc:1434] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:26:03.819937 22262 ts_tablet_manager.cc:1434] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 12:26:03.821762 22263 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:03.822144 22630 raft_consensus.cc:697] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:03.823511 22630 consensus_queue.cc:237] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.832647 22262 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:03.838744 22639 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.839365 22639 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.840562 22262 tablet_bootstrap.cc:654] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.844342 22263 tablet_bootstrap.cc:654] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.848986 22639 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.849993 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:03.851526 22114 leader_election.cc:343] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.854730 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.855189 22262 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:03.855408 22214 raft_consensus.cc:2468] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:03.856194 22262 ts_tablet_manager.cc:1403] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 12:26:03.856997 22113 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:03.857937 22267 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:03.858374 22267 ts_tablet_manager.cc:1403] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.254s	user 0.019s	sys 0.038s
I20260709 12:26:03.858870 22262 raft_consensus.cc:359] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.859556 22262 raft_consensus.cc:385] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.859836 22262 raft_consensus.cc:740] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.860452 22262 consensus_queue.cc:260] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.861358 22267 raft_consensus.cc:359] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.862089 22267 raft_consensus.cc:385] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.862352 22267 raft_consensus.cc:740] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.862489 22577 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.863083 22267 consensus_queue.cc:260] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.870497 22267 ts_tablet_manager.cc:1434] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:26:03.871542 22267 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:03.858740 22569 raft_consensus.cc:2804] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.875620 22569 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.876032 22569 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.876262 22647 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.886998 22267 tablet_bootstrap.cc:654] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.882050 22587 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:03.894037 22647 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.894579 22647 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.896754 22647 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.899296 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.899953 22220 raft_consensus.cc:2468] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:03.901206 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:03.901671 22262 ts_tablet_manager.cc:1434] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:26:03.901958 22647 raft_consensus.cc:2804] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:03.902307 22647 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.902666 22647 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.901418 22263 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:03.903591 22263 ts_tablet_manager.cc:1403] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.011s
I20260709 12:26:03.905856 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:03.902640 22262 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:03.913883 22647 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.916002 22647 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.921511 22262 tablet_bootstrap.cc:654] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.923671 22066 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.928682 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:03.935992 22214 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.938226 22262 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:03.939028 22262 ts_tablet_manager.cc:1403] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.003s
I20260709 12:26:03.916766 22569 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.930193 22585 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.933558 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:26:03.947454 22036 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.942446 22587 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.948642 22587 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.950701 22587 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.954182 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:03.955129 22263 raft_consensus.cc:359] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.956239 22263 raft_consensus.cc:385] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.956651 22263 raft_consensus.cc:740] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
W20260709 12:26:03.956754 22113 leader_election.cc:343] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:03.957633 22263 consensus_queue.cc:260] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.961333 22146 raft_consensus.cc:2393] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:03.966259 22569 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:03.967428 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:03.969702 22263 ts_tablet_manager.cc:1434] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.065s	user 0.004s	sys 0.003s
I20260709 12:26:03.971453 22262 raft_consensus.cc:359] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.972277 22262 raft_consensus.cc:385] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.972565 22262 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.973280 22262 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.978049 22267 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:03.987993 22267 ts_tablet_manager.cc:1403] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.016s
I20260709 12:26:03.979743 21970 catalog_manager.cc:5697] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.990638 22267 raft_consensus.cc:359] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.991292 22267 raft_consensus.cc:385] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.993129 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:03.994099 22267 raft_consensus.cc:740] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.995420 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:03.995255 22267 consensus_queue.cc:260] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:03.996203 22070 raft_consensus.cc:2393] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:26:03.996158 22071 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:03.996775 22267 ts_tablet_manager.cc:1434] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:26:03.997666 22267 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:03.980432 22263 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:03.986934 22648 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:26:03.987483 22214 raft_consensus.cc:2468] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:03.985196 21969 catalog_manager.cc:5697] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.983731 22262 ts_tablet_manager.cc:1434] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:26:04.005406 22262 tablet_bootstrap.cc:492] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:04.007405 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:04.012324 22647 raft_consensus.cc:2804] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.012867 22647 raft_consensus.cc:697] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:04.013933 22647 consensus_queue.cc:237] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.000684 22114 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:04.025528 22114 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:04.025616 22569 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.031502 22587 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.032171 22587 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.032655 22587 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.060532 22263 tablet_bootstrap.cc:654] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.063246 22587 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.065456 22587 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:04.066073 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:04.066571 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:04.067181 22220 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.066730 22066 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.070298 22262 tablet_bootstrap.cc:654] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.076437 22267 tablet_bootstrap.cc:654] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.088080 22663 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.088711 22663 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.093390 22663 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:04.092695 22220 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:04.098834 22113 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:04.093641 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:04.094204 22066 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:04.101794 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:04.104257 22663 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:04.104894 22113 leader_election.cc:343] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.109123 22663 raft_consensus.cc:697] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:04.110239 22663 consensus_queue.cc:237] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.114434 22267 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:04.116020 22267 ts_tablet_manager.cc:1403] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.007s
I20260709 12:26:04.116707 22262 tablet_bootstrap.cc:492] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:04.117229 22262 ts_tablet_manager.cc:1403] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.003s
I20260709 12:26:04.119767 22262 raft_consensus.cc:359] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.120596 22263 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:04.069416 21971 catalog_manager.cc:5697] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.181053 22263 ts_tablet_manager.cc:1403] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.208s	user 0.026s	sys 0.021s
W20260709 12:26:04.158353 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 52220.9us
W20260709 12:26:04.164215 22114 leader_election.cc:343] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.185269 22114 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:04.188690 22569 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.120541 22267 raft_consensus.cc:359] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.197288 22267 raft_consensus.cc:385] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.197718 22267 raft_consensus.cc:740] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.120831 22262 raft_consensus.cc:385] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.203274 22262 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.206605 22262 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.204872 22267 consensus_queue.cc:260] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.208976 22262 ts_tablet_manager.cc:1434] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 12:26:04.210850 22262 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:04.213907 21970 catalog_manager.cc:5697] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.222899 22267 ts_tablet_manager.cc:1434] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.107s	user 0.010s	sys 0.002s
I20260709 12:26:04.227365 22267 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:04.230641 22262 tablet_bootstrap.cc:654] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.230644 22263 raft_consensus.cc:359] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.231662 22263 raft_consensus.cc:385] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.231969 22263 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.239051 22263 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.248792 22267 tablet_bootstrap.cc:654] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.257718 22263 ts_tablet_manager.cc:1434] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.001s
I20260709 12:26:04.259356 22263 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:04.268497 22630 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.290141 22648 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.290906 22648 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.294957 22648 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:04.295315 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:04.295744 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:04.297304 22145 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:04.300010 22185 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:04.300340 22262 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:04.300849 22262 ts_tablet_manager.cc:1403] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.018s
W20260709 12:26:04.311017 22188 leader_election.cc:343] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.313033 22648 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.317915 22262 raft_consensus.cc:359] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.318888 22262 raft_consensus.cc:385] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.319262 22262 raft_consensus.cc:740] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.319911 22263 tablet_bootstrap.cc:654] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.320434 22262 consensus_queue.cc:260] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.321422 22648 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.321998 22648 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.322834 22267 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:04.323441 22267 ts_tablet_manager.cc:1403] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.014s
I20260709 12:26:04.327476 22267 raft_consensus.cc:359] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.329243 22267 raft_consensus.cc:385] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.329619 22267 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.331957 22262 ts_tablet_manager.cc:1434] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.008s
I20260709 12:26:04.333176 22267 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.336030 22267 ts_tablet_manager.cc:1434] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:04.339262 22648 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.340334 22267 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:04.343096 22648 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:04.353449 22114 consensus_peers.cc:597] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:04.355369 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:04.356349 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:04.357074 22146 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.356503 22142 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.367619 22262 tablet_bootstrap.cc:492] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:04.367691 22267 tablet_bootstrap.cc:654] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.376725 22329 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.377372 22329 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.382727 22329 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:04.383359 22066 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.384640 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:04.394214 22630 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.401324 22146 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:04.402849 22185 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:04.403793 22648 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.404435 22648 raft_consensus.cc:697] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:04.406347 22648 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.424564 22146 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.425295 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:04.429278 22587 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.436122 22038 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:04.457546 22262 tablet_bootstrap.cc:654] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.469343 22263 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:04.469854 22263 ts_tablet_manager.cc:1403] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.211s	user 0.013s	sys 0.018s
I20260709 12:26:04.476370 22066 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:04.477766 22329 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:04.479524 22263 raft_consensus.cc:359] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.480243 22263 raft_consensus.cc:385] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.480504 22263 raft_consensus.cc:740] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.481276 22263 consensus_queue.cc:260] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.495589 22263 ts_tablet_manager.cc:1434] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 12:26:04.497205 22263 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:04.500589 22267 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:04.501159 22267 ts_tablet_manager.cc:1403] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.161s	user 0.023s	sys 0.047s
I20260709 12:26:04.529186 22262 tablet_bootstrap.cc:492] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:04.529810 22262 ts_tablet_manager.cc:1403] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.163s	user 0.008s	sys 0.011s
I20260709 12:26:04.529526 22267 raft_consensus.cc:359] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.532920 22262 raft_consensus.cc:359] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.523375 21970 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.538285 22263 tablet_bootstrap.cc:654] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.530530 22267 raft_consensus.cc:385] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.539240 22267 raft_consensus.cc:740] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.538841 22262 raft_consensus.cc:385] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.539985 22262 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.541010 22262 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.543324 22267 consensus_queue.cc:260] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.544026 22262 ts_tablet_manager.cc:1434] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:26:04.545229 22262 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:04.546504 22267 ts_tablet_manager.cc:1434] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:26:04.549328 22267 tablet_bootstrap.cc:492] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:04.551318 22262 tablet_bootstrap.cc:654] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.557734 22267 tablet_bootstrap.cc:654] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.559648 22262 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:04.560231 22262 ts_tablet_manager.cc:1403] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:26:04.565490 22262 raft_consensus.cc:359] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.568135 22263 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:04.568856 22263 ts_tablet_manager.cc:1403] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.072s	user 0.006s	sys 0.009s
I20260709 12:26:04.571702 22263 raft_consensus.cc:359] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.572805 22263 raft_consensus.cc:385] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.573139 22263 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.573861 22263 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.576068 22263 ts_tablet_manager.cc:1434] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:04.572436 22262 raft_consensus.cc:385] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.577152 22262 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.578050 22262 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.579692 22262 ts_tablet_manager.cc:1434] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:26:04.580787 22262 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:04.581915 22263 tablet_bootstrap.cc:492] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:04.588171 22267 tablet_bootstrap.cc:492] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:04.588790 22267 ts_tablet_manager.cc:1403] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.003s
I20260709 12:26:04.594254 22630 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.591766 22267 raft_consensus.cc:359] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.600373 22267 raft_consensus.cc:385] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.600744 22267 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.601500 22267 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.604056 22267 ts_tablet_manager.cc:1434] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:04.607975 22267 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:04.614739 22263 tablet_bootstrap.cc:654] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.614465 22329 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.616050 22262 tablet_bootstrap.cc:654] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.619349 22267 tablet_bootstrap.cc:654] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.638183 22267 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:04.638715 22267 ts_tablet_manager.cc:1403] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 12:26:04.644855 22267 raft_consensus.cc:359] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.645591 22267 raft_consensus.cc:385] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.645871 22267 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.646556 22267 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.648394 22267 ts_tablet_manager.cc:1434] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:04.649364 22267 tablet_bootstrap.cc:492] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:04.654580 22267 tablet_bootstrap.cc:654] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.659520 22587 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:04.687915 22663 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.696530 22329 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.697023 22329 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.698874 22329 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:04.700418 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:04.702021 22036 leader_election.cc:343] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.703362 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:04.704234 22216 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:04.710637 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:04.712002 22329 raft_consensus.cc:2804] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.712456 22329 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.712815 22329 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.732812 22329 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.734051 22262 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:04.734691 22262 ts_tablet_manager.cc:1403] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.154s	user 0.010s	sys 0.018s
I20260709 12:26:04.735571 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:04.737635 22262 raft_consensus.cc:359] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:04.738142 22036 leader_election.cc:343] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.738385 22262 raft_consensus.cc:385] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.738729 22262 raft_consensus.cc:740] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.744361 22263 tablet_bootstrap.cc:492] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:04.744948 22263 ts_tablet_manager.cc:1403] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.017s
I20260709 12:26:04.746156 22329 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:04.753568 22262 consensus_queue.cc:260] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.756112 22262 ts_tablet_manager.cc:1434] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:04.757403 22262 tablet_bootstrap.cc:492] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:04.758702 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:04.759347 22220 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.761653 22263 raft_consensus.cc:359] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.762377 22263 raft_consensus.cc:385] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.759438 22267 tablet_bootstrap.cc:492] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:04.762696 22263 raft_consensus.cc:740] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.764912 22267 ts_tablet_manager.cc:1403] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.116s	user 0.042s	sys 0.033s
I20260709 12:26:04.765868 22263 consensus_queue.cc:260] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.771149 22426 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.771656 22426 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.774669 22426 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:04.774907 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:04.775801 22262 tablet_bootstrap.cc:654] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.775718 22146 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:04.776140 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:04.777061 22185 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:04.784442 22426 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.785005 22426 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.785384 22426 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:04.788456 22188 leader_election.cc:343] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.780840 22220 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:04.781503 22267 raft_consensus.cc:359] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.789193 22267 raft_consensus.cc:385] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.789536 22267 raft_consensus.cc:740] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.790262 22267 consensus_queue.cc:260] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.791613 22263 ts_tablet_manager.cc:1434] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.005s
I20260709 12:26:04.792506 22267 ts_tablet_manager.cc:1434] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:26:04.792979 22263 tablet_bootstrap.cc:492] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:04.793670 22267 tablet_bootstrap.cc:492] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:04.797008 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:04.802294 22329 raft_consensus.cc:2804] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.802798 22329 raft_consensus.cc:697] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:04.803510 22329 consensus_queue.cc:237] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.812601 22426 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.833232 22066 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.837270 22262 tablet_bootstrap.cc:492] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:04.837783 22262 ts_tablet_manager.cc:1403] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.019s
I20260709 12:26:04.838375 22263 tablet_bootstrap.cc:654] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.839704 22267 tablet_bootstrap.cc:654] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:04.843004 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:04.843442 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:04.843982 22426 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:04.845551 22188 leader_election.cc:343] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.845546 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:04.846262 22146 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.847437 22262 raft_consensus.cc:359] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.848116 22262 raft_consensus.cc:385] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.848371 22262 raft_consensus.cc:740] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.849056 22262 consensus_queue.cc:260] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.843729 21969 catalog_manager.cc:5697] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.851310 22262 ts_tablet_manager.cc:1434] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:26:04.856207 22262 tablet_bootstrap.cc:492] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:04.858057 22263 tablet_bootstrap.cc:492] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:04.858559 22263 ts_tablet_manager.cc:1403] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.001s
I20260709 12:26:04.867894 22146 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:04.871289 22263 raft_consensus.cc:359] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.872038 22263 raft_consensus.cc:385] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.872607 22263 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.873289 22263 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.875355 22262 tablet_bootstrap.cc:654] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.878850 22267 tablet_bootstrap.cc:492] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:04.879252 22267 ts_tablet_manager.cc:1403] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.086s	user 0.005s	sys 0.015s
I20260709 12:26:04.880694 22262 tablet_bootstrap.cc:492] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:04.881175 22262 ts_tablet_manager.cc:1403] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.006s
I20260709 12:26:04.882527 22267 raft_consensus.cc:359] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.883244 22267 raft_consensus.cc:385] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.883493 22267 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.884106 22267 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.886224 22267 ts_tablet_manager.cc:1434] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:04.887471 22638 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:04.888192 22263 ts_tablet_manager.cc:1434] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:26:04.889518 22263 tablet_bootstrap.cc:492] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:04.887488 22185 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:04.891933 22648 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:04.892400 22648 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:04.893209 22648 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.896013 22263 tablet_bootstrap.cc:654] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.896564 22262 raft_consensus.cc:359] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.897235 22262 raft_consensus.cc:385] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.897500 22262 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.898258 22262 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.899261 22267 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:04.900583 22262 ts_tablet_manager.cc:1434] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:26:04.902339 22262 tablet_bootstrap.cc:492] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:04.906664 22267 tablet_bootstrap.cc:654] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.917052 22263 tablet_bootstrap.cc:492] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:04.917505 22262 tablet_bootstrap.cc:654] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.917549 22263 ts_tablet_manager.cc:1403] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.002s
I20260709 12:26:04.921341 22263 raft_consensus.cc:359] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.922086 22263 raft_consensus.cc:385] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.922349 22263 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.923012 22263 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.927806 22263 ts_tablet_manager.cc:1434] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:26:04.928445 22633 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.928988 22633 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.928988 22263 tablet_bootstrap.cc:492] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:04.931468 22633 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:04.936872 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:04.938709 22036 leader_election.cc:343] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.947501 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:04.948436 22220 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:04.950718 22263 tablet_bootstrap.cc:654] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.952603 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:04.953449 22630 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.953943 22630 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.957798 22630 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:04.958453 22593 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.958899 22593 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.959235 22593 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.967139 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:04.967912 22146 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:04.969143 22036 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:04.970022 22630 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.970376 22630 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.970746 22630 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.977941 22593 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.978437 22630 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:04.965409 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:04.980705 22220 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:04.982110 22262 tablet_bootstrap.cc:492] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:04.982573 22262 ts_tablet_manager.cc:1403] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.008s
I20260709 12:26:04.988446 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:04.989161 22146 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.986444 22630 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.029721 22426 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.058571 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:05.062839 22220 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.064105 22663 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.064669 22663 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.069830 22146 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:05.026350 22633 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.070740 22633 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.073055 22633 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.107995 22663 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.142799 22593 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.143733 22220 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:05.151403 22587 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.152146 22587 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.157186 22663 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.158797 22663 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.170734 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:05.170925 22262 raft_consensus.cc:359] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.171695 22262 raft_consensus.cc:385] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.171550 22146 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:05.172032 22262 raft_consensus.cc:740] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.173415 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:05.174276 22267 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:05.174796 22267 ts_tablet_manager.cc:1403] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.276s	user 0.013s	sys 0.030s
I20260709 12:26:05.177577 22267 raft_consensus.cc:359] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.178268 22267 raft_consensus.cc:385] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.173977 21968 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.178558 22267 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.190521 22263 tablet_bootstrap.cc:492] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:05.216413 22709 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.230331 22709 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.231868 22263 ts_tablet_manager.cc:1403] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.302s	user 0.051s	sys 0.061s
I20260709 12:26:05.200971 22036 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:05.191587 22267 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.203145 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:05.232671 22709 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.237600 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:05.238238 22267 ts_tablet_manager.cc:1434] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 12:26:05.237188 22036 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:05.239334 22267 tablet_bootstrap.cc:492] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:05.239114 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:05.240852 22707 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.236534 22070 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:05.244493 22263 raft_consensus.cc:359] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.245343 22263 raft_consensus.cc:385] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.245703 22263 raft_consensus.cc:740] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.245791 22630 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.246272 22630 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.246470 22263 consensus_queue.cc:260] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.250277 22707 raft_consensus.cc:697] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:05.251719 22630 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:05.252167 22036 leader_election.cc:343] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.252403 22707 consensus_queue.cc:237] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.253829 22263 ts_tablet_manager.cc:1434] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:26:05.260547 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:05.261219 22146 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:05.262858 22263 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:05.264978 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:05.262111 22630 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.289249 22708 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.290439 22708 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.291123 22708 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.293485 22263 tablet_bootstrap.cc:654] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.293597 22587 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.294579 22630 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.299073 22630 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.299551 22630 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.298174 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:05.300771 22146 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:05.302983 22114 leader_election.cc:343] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.303937 22114 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:05.304919 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:05.305961 22145 raft_consensus.cc:2393] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:05.306293 22630 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.321975 22587 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.325004 22587 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.325493 22587 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.333210 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:05.324998 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:05.349956 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:05.368033 22220 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 0.
I20260709 12:26:05.471549 22267 tablet_bootstrap.cc:654] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.473392 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:26:05.518496 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 179640us
I20260709 12:26:05.527019 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:05.527784 22222 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:05.505617 22216 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.526381 22262 consensus_queue.cc:260] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.546161 22262 ts_tablet_manager.cc:1434] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.563s	user 0.015s	sys 0.017s
I20260709 12:26:05.545115 22663 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:05.546533 22262 ts_tablet_manager.cc:1467] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet startup took 563ms
I20260709 12:26:05.549248 22263 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:05.550349 22263 ts_tablet_manager.cc:1403] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.294s	user 0.017s	sys 0.014s
I20260709 12:26:05.559410 22263 raft_consensus.cc:359] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.560207 22263 raft_consensus.cc:385] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.560469 22263 raft_consensus.cc:740] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.561122 22263 consensus_queue.cc:260] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.562990 22263 ts_tablet_manager.cc:1434] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:05.571336 22708 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:05.577365 22113 leader_election.cc:343] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.578478 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:05.583628 22142 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.581131 22569 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:05.547941 22262 ts_tablet_manager.cc:1469] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Trace:
0709 12:25:56.703392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.803079 (+ 99687us) service_pool.cc:224] Handling call
0709 12:25:56.831173 (+ 28094us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b5800003098. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e21a2 00007ff192523889 00007ff191654d88 00007ff191717b80 00007ff1916c6400 00007ff18ab4baf4 00007ff18ab4ba82 00007ff18ab4b9b1 00007ff18ab4b92c
0709 12:25:56.873864 (+ 42691us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:25:56.874175 (+   311us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:25:57.028260 (+154085us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:57.085626 (+ 57366us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:57.086063 (+   437us) inbound_call.cc:177] Queueing success response
0709 12:26:04.901920 (+7815857us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:04.982858 (+ 80938us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:04.983382 (+   524us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:04.989688 (+  6306us) tablet_replica.cc:280] Starting consensus
0709 12:26:05.526059 (+536371us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4c003b2500. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18a9d2a20 00007ff18a9e3a29 00007ff18a9a9644 00007ff18a9d0f2d 00007ff18a9d0b93 00007ff18c70118b 00007ff18c701cb5 00007ff18c6fcf30 00007ff18c6fbc40 00007ff1900f8b2e 00007ff19171ad8a
Metrics: {"raft.queue_time_us":6774,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3107,"spinlock_wait_cycles":43083264,"tablet-open.queue_time_us":7815928}
I20260709 12:26:05.591841 22146 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:05.590536 22262 tablet_bootstrap.cc:492] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:05.593740 22708 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.604490 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:05.605355 22221 raft_consensus.cc:2393] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:26:05.605799 22267 tablet_bootstrap.cc:492] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:05.606194 22703 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.606382 22267 ts_tablet_manager.cc:1403] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.367s	user 0.023s	sys 0.024s
I20260709 12:26:05.606698 22703 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.596570 22216 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:05.615782 22113 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:05.618198 22329 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.618360 22036 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:05.620559 22710 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.623972 22633 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.625002 22633 raft_consensus.cc:697] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:05.625130 22703 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:05.625962 22633 consensus_queue.cc:237] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.618949 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:05.631335 22267 raft_consensus.cc:359] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.631832 22267 raft_consensus.cc:385] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.632037 22267 raft_consensus.cc:740] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.642231 22267 consensus_queue.cc:260] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.644498 22262 tablet_bootstrap.cc:654] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.644451 22267 ts_tablet_manager.cc:1434] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.001s
I20260709 12:26:05.635850 22587 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.647318 22146 raft_consensus.cc:2393] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:05.647680 22267 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:05.649127 22587 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:05.645752 21969 catalog_manager.cc:5697] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.651891 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:05.654182 22070 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.652514 22141 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:05.662978 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:05.663625 22213 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.669453 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:05.670217 22072 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:05.672801 22213 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:05.675163 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:26:05.677580 22038 leader_election.cc:343] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:05.679363 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 357418us
I20260709 12:26:05.684688 22113 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:05.685521 22663 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.686005 22663 raft_consensus.cc:697] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:05.693137 22263 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
I20260709 12:26:05.682454 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:05.686820 22663 consensus_queue.cc:237] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.719508 22577 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:05.722021 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:05.731774 22188 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:05.733765 22426 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:05.730904 22708 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.726286 22707 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:26:05.733269 22648 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.737898 22648 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.739662 22708 raft_consensus.cc:697] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:05.741590 22708 consensus_queue.cc:237] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.743788 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:05.744608 22073 raft_consensus.cc:2393] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:26:05.762275 22262 tablet_bootstrap.cc:492] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:05.738301 22648 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.765427 22267 tablet_bootstrap.cc:654] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.771188 22262 ts_tablet_manager.cc:1403] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.002s
I20260709 12:26:05.777173 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:05.778035 22219 raft_consensus.cc:2393] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 1: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:05.791085 22038 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:26:05.798229 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 65639.1us
W20260709 12:26:05.795540 22038 leader_election.cc:343] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.801380 22593 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.849017 22038 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:05.851243 22720 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.847812 21969 catalog_manager.cc:5697] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.855062 22262 raft_consensus.cc:359] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.855820 22262 raft_consensus.cc:385] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.856105 22262 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.858961 22709 consensus_queue.cc:1048] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:05.868372 22262 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.885561 22267 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:05.886119 22267 ts_tablet_manager.cc:1403] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.239s	user 0.009s	sys 0.015s
I20260709 12:26:05.893149 22262 ts_tablet_manager.cc:1434] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.122s	user 0.007s	sys 0.001s
I20260709 12:26:05.892612 22263 tablet_bootstrap.cc:654] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.902073 22577 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.902632 22577 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.909792 22577 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:05.920033 22267 raft_consensus.cc:359] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.920830 22267 raft_consensus.cc:385] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.921092 22267 raft_consensus.cc:740] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.920051 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:05.921716 22267 consensus_queue.cc:260] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.924057 22648 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:05.926110 22648 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:05.927739 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:05.931654 22267 ts_tablet_manager.cc:1434] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 12:26:05.936105 22262 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: Bootstrap starting.
I20260709 12:26:05.940016 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:05.940706 22065 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.941248 22267 tablet_bootstrap.cc:492] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: Bootstrap starting.
I20260709 12:26:05.944715 22071 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 0.
I20260709 12:26:05.965420 22188 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:26:05.957653 22019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:05.971213 22426 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.971611 22426 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.971942 22426 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.945792 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:05.974094 22707 consensus_queue.cc:1048] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:26:06.000991 22267 tablet_bootstrap.cc:654] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.990473 22147 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.011890 22426 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.019459 22262 tablet_bootstrap.cc:654] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.020999 22426 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:06.029594 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:06.030288 22070 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.030858 22263 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:06.031323 22263 ts_tablet_manager.cc:1403] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.338s	user 0.020s	sys 0.011s
I20260709 12:26:06.034001 22263 raft_consensus.cc:359] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.036998 22263 raft_consensus.cc:385] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.037262 22263 raft_consensus.cc:740] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.037906 22263 consensus_queue.cc:260] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.040119 22263 ts_tablet_manager.cc:1434] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:06.050045 22263 tablet_bootstrap.cc:492] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa: Bootstrap starting.
W20260709 12:26:06.056442 22185 leader_election.cc:343] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.064513 22070 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:06.053467 22147 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:06.082770 22065 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:06.085942 22188 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:06.090862 22638 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.091379 22638 raft_consensus.cc:697] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:06.092312 22638 consensus_queue.cc:237] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.097726 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:26:06.106313 22185 leader_election.cc:343] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.112775 22188 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:06.114988 22648 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.115697 22648 raft_consensus.cc:697] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:06.116552 22648 consensus_queue.cc:237] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.130097 22263 tablet_bootstrap.cc:654] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.132082 22267 tablet_bootstrap.cc:492] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: No bootstrap required, opened a new log
I20260709 12:26:06.132587 22267 ts_tablet_manager.cc:1403] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.009s
I20260709 12:26:06.133484 22262 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: No bootstrap required, opened a new log
I20260709 12:26:06.133899 22262 ts_tablet_manager.cc:1403] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent bootstrapping tablet: real 0.226s	user 0.013s	sys 0.006s
I20260709 12:26:06.135855 21969 catalog_manager.cc:5697] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.143471 22262 raft_consensus.cc:359] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.146901 22262 raft_consensus.cc:385] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.147202 22262 raft_consensus.cc:740] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.147992 22262 consensus_queue.cc:260] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.150861 22267 raft_consensus.cc:359] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.151593 22267 raft_consensus.cc:385] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.151894 22267 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.152611 22267 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.175814 22262 ts_tablet_manager.cc:1434] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 12:26:06.176218 22267 ts_tablet_manager.cc:1434] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.002s
I20260709 12:26:06.185401 22633 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.190230 21968 catalog_manager.cc:5697] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.196753 22263 tablet_bootstrap.cc:492] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa: No bootstrap required, opened a new log
I20260709 12:26:06.197357 22263 ts_tablet_manager.cc:1403] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.002s
I20260709 12:26:06.202564 21969 catalog_manager.cc:5697] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.212090 22263 raft_consensus.cc:359] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.214471 22263 raft_consensus.cc:385] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.214788 22263 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.215009 22215 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.217051 22263 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.218497 22721 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.219022 22263 ts_tablet_manager.cc:1434] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 12:26:06.218983 22721 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.221964 22721 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:06.224879 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:06.225572 22143 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:06.226963 22036 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:06.232901 22633 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.233286 22633 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.233786 22633 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.235389 21969 catalog_manager.cc:5697] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.245452 22707 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.247298 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:06.248311 22216 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 0.
I20260709 12:26:06.250910 22721 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.251637 22587 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.252161 22587 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.256313 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:06.257074 22067 raft_consensus.cc:2393] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 1: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:06.259064 22587 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:06.260267 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:06.264243 22113 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:06.265828 22587 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.271288 22633 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.277372 22717 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.282500 22143 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.296252 22633 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:06.296903 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:06.299363 22141 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.315631 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:06.316319 22215 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.325716 22141 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:06.330435 22718 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.332657 22036 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:06.333997 22721 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.334477 22721 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:06.335777 22721 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.337533 22587 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.334754 22708 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:26:06.334842 22215 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:06.361703 22718 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.362179 22718 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:06.369213 22718 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:06.370682 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:06.391469 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:06.412328 22113 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:06.419555 22587 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:06.422161 21968 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 0 to 1, leader changed from <none> to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.635923 22577 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.652674 22426 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.672785 22426 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.692000 22638 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.764531 22707 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.776219 22721 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.934754 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:07.964452 22765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:07.965364 22764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:07.966114 22767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:07.966706 20917 server_base.cc:1061] running on GCE node
I20260709 12:26:07.968510 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:07.968788 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:07.968951 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783599967968938 us; error 0 us; skew 500 ppm
I20260709 12:26:07.969580 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:07.972254 20917 webserver.cc:533] Webserver started at http://127.20.109.68:40653/ using document root <none> and password file <none>
I20260709 12:26:07.972786 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:07.972976 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:07.973304 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:07.974539 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-3-root/instance:
uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
format_stamp: "Formatted at 2026-07-09 12:26:07 on dist-test-slave-sc4p"
I20260709 12:26:07.979756 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:07.983212 22772 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:07.984119 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:07.984436 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-3-root
uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
format_stamp: "Formatted at 2026-07-09 12:26:07 on dist-test-slave-sc4p"
I20260709 12:26:07.984745 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:08.012884 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:08.014590 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:08.016685 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:08.019603 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:08.019889 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:08.020200 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:08.020391 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:08.093834 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.68:41677
I20260709 12:26:08.093920 22834 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.68:41677 every 8 connection(s)
I20260709 12:26:08.098321 20917 auto_leader_rebalancer-test.cc:439] add a tserver: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:08.112198 22835 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41439
I20260709 12:26:08.112636 22835 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:08.113404 22835 heartbeater.cc:507] Master 127.20.109.126:41439 requested a full tablet report, sending...
I20260709 12:26:08.115198 21970 ts_manager.cc:194] Registered new tserver with Master: 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:08.116848 21970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38180
I20260709 12:26:09.119354 22835 heartbeater.cc:499] Master 127.20.109.126:41439 was elected leader, sending a full tablet report...
I20260709 12:26:09.170466 22215 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.177341 22067 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.178628 22426 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.179206 22141 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.180511 22426 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:09.204809 22186 consensus_peers.cc:597] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66ebd42ef0064f2489bbc02ec3e9500b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.206629 22638 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.208098 22067 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.215902 22141 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.227108 21970 catalog_manager.cc:5697] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.241315 22067 consensus_queue.cc:237] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.258561 22143 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.258607 22213 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.259948 22840 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.261122 22707 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:09.275401 22037 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 838948750f334b409ad4d7798a822e6d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.284579 22707 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.287591 22213 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.295485 22143 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.320384 21969 catalog_manager.cc:5697] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.325119 22143 consensus_queue.cc:237] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.374457 22213 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.374476 22070 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.376048 22839 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.376821 22861 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.390651 22216 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.388041 22847 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.404912 22070 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.415434 21970 catalog_manager.cc:5697] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.430011 22141 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:09.436544 22112 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ec6cbbf70dc43daa892eda3ef90f702. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.442049 22112 consensus_peers.cc:597] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48a34f9ae8654955bc6eda7229323ca3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.444188 22070 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.445119 22216 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.445663 22861 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.446491 22839 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.460517 22847 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.461758 22067 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.468375 22216 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:09.482400 21969 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.637109 22869 ts_tablet_manager.cc:933] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:09.640200 22869 tablet_copy_client.cc:323] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:09.652359 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 66ebd42ef0064f2489bbc02ec3e9500b from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:09.653139 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 66ebd42ef0064f2489bbc02ec3e9500b from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-66ebd42ef0064f2489bbc02ec3e9500b
I20260709 12:26:09.665576 22232 tablet_copy_source_session.cc:215] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.670253 22869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ebd42ef0064f2489bbc02ec3e9500b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.687556 22869 tablet_copy_client.cc:806] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.688199 22869 tablet_copy_client.cc:670] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.701371 22869 tablet_copy_client.cc:538] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.715299 22869 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:09.745045 22869 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.746266 22869 tablet_bootstrap.cc:492] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:09.746847 22869 ts_tablet_manager.cc:1403] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.014s
I20260709 12:26:09.749361 22869 raft_consensus.cc:359] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.750173 22869 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:09.750844 22869 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.758030 22869 ts_tablet_manager.cc:1434] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 12:26:09.760440 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-66ebd42ef0064f2489bbc02ec3e9500b received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:09.760895 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-66ebd42ef0064f2489bbc02ec3e9500b on tablet 66ebd42ef0064f2489bbc02ec3e9500b with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:09.810250 22869 ts_tablet_manager.cc:933] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:09.814543 22869 tablet_copy_client.cc:323] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:09.815843 22875 ts_tablet_manager.cc:933] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:09.840153 22875 tablet_copy_client.cc:323] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:09.841188 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 838948750f334b409ad4d7798a822e6d from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:09.841796 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 838948750f334b409ad4d7798a822e6d from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-838948750f334b409ad4d7798a822e6d
I20260709 12:26:09.849633 22083 tablet_copy_source_session.cc:215] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.852736 22869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838948750f334b409ad4d7798a822e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.870009 22869 tablet_copy_client.cc:806] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.870612 22869 tablet_copy_client.cc:670] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.876163 22869 tablet_copy_client.cc:538] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.877354 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 4ec6cbbf70dc43daa892eda3ef90f702 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:09.877952 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 4ec6cbbf70dc43daa892eda3ef90f702 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-4ec6cbbf70dc43daa892eda3ef90f702
I20260709 12:26:09.885119 22158 tablet_copy_source_session.cc:215] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.888700 22875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec6cbbf70dc43daa892eda3ef90f702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.892387 22869 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:09.909448 22875 tablet_copy_client.cc:806] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.910010 22875 tablet_copy_client.cc:670] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.913404 22869 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.914326 22869 tablet_bootstrap.cc:492] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:09.914645 22875 tablet_copy_client.cc:538] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.914965 22869 ts_tablet_manager.cc:1403] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 12:26:09.918457 22869 raft_consensus.cc:359] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.919312 22869 raft_consensus.cc:740] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:09.919935 22869 consensus_queue.cc:260] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.922179 22869 ts_tablet_manager.cc:1434] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:26:09.923591 22875 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:09.925010 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-838948750f334b409ad4d7798a822e6d received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:09.925513 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-838948750f334b409ad4d7798a822e6d on tablet 838948750f334b409ad4d7798a822e6d with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:09.946744 22875 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.947464 22875 tablet_bootstrap.cc:492] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:09.948011 22875 ts_tablet_manager.cc:1403] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:26:09.950184 22875 raft_consensus.cc:359] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.950840 22875 raft_consensus.cc:740] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:09.951486 22875 consensus_queue.cc:260] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:09.953534 22875 ts_tablet_manager.cc:1434] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:09.955158 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-4ec6cbbf70dc43daa892eda3ef90f702 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:09.955585 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-4ec6cbbf70dc43daa892eda3ef90f702 on tablet 4ec6cbbf70dc43daa892eda3ef90f702 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:09.992892 22875 ts_tablet_manager.cc:933] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:10.000754 22875 tablet_copy_client.cc:323] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:10.002301 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 48a34f9ae8654955bc6eda7229323ca3 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:10.002761 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 48a34f9ae8654955bc6eda7229323ca3 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-48a34f9ae8654955bc6eda7229323ca3
I20260709 12:26:10.013394 22158 tablet_copy_source_session.cc:215] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:10.017321 22875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a34f9ae8654955bc6eda7229323ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.022562 22810 raft_consensus.cc:1217] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.041118 22875 tablet_copy_client.cc:806] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:10.041694 22875 tablet_copy_client.cc:670] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:10.044994 22875 tablet_copy_client.cc:538] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:10.053921 22875 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:10.075651 22875 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:10.076942 22875 tablet_bootstrap.cc:492] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:10.077579 22875 ts_tablet_manager.cc:1403] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.002s
I20260709 12:26:10.079838 22875 raft_consensus.cc:359] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:10.080435 22875 raft_consensus.cc:740] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:10.080895 22875 consensus_queue.cc:260] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:10.083412 22875 ts_tablet_manager.cc:1434] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:26:10.085031 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-48a34f9ae8654955bc6eda7229323ca3 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:10.085381 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-48a34f9ae8654955bc6eda7229323ca3 on tablet 48a34f9ae8654955bc6eda7229323ca3 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:10.272738 22810 raft_consensus.cc:1217] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.369071 22810 raft_consensus.cc:1217] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.375865 22810 raft_consensus.cc:1217] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.423996 22883 raft_consensus.cc:1064] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:10.427117 22883 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:10.436404 22810 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.438870 22067 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.439038 22638 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.441340 22142 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.441980 22638 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.445066 22849 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.469614 22849 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.473660 22810 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.472210 22067 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.488547 22142 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.519243 21970 catalog_manager.cc:5697] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.547614 22213 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:10.554708 22143 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.555449 22810 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.556913 22638 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.558744 22886 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.565582 22849 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.572599 22810 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.580574 22143 raft_consensus.cc:2955] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.585944 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66ebd42ef0064f2489bbc02ec3e9500b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.602986 21971 catalog_manager.cc:5697] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.615020 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 66ebd42ef0064f2489bbc02ec3e9500b with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:10.617360 22894 tablet_replica.cc:333] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:10.624981 22894 raft_consensus.cc:2243] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.625771 22894 raft_consensus.cc:2272] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.629508 22894 ts_tablet_manager.cc:1916] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.645536 22894 ts_tablet_manager.cc:1929] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.645969 22894 log.cc:1199] T 66ebd42ef0064f2489bbc02ec3e9500b P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/66ebd42ef0064f2489bbc02ec3e9500b
I20260709 12:26:10.647678 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 66ebd42ef0064f2489bbc02ec3e9500b (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:10.851456 22630 raft_consensus.cc:1064] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:10.853277 22630 consensus_queue.cc:237] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:10.859618 22810 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.860136 22213 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.861277 22896 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.865114 22143 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.865252 22630 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.869602 22630 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.884245 22630 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.885927 22213 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.891465 22143 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.904420 22810 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.909729 21971 catalog_manager.cc:5697] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:10.953522 22065 consensus_queue.cc:237] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:10.956853 22884 raft_consensus.cc:1064] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:10.959213 22884 consensus_queue.cc:237] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:10.964571 22809 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.967082 22847 raft_consensus.cc:1064] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:10.967506 22630 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.968361 22213 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.970845 22707 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.969512 22847 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:10.980563 22216 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.985538 22810 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.986557 22065 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.000782 22861 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.999198 22897 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.001430 22213 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.006206 22216 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.004649 22901 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:11.007615 22810 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.008119 22861 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:11.016997 22884 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:26:11.034183 22904 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:11.060413 22808 raft_consensus.cc:2955] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.076145 22065 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.078008 22861 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:11.082914 21969 catalog_manager.cc:5697] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.082504 22901 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.088375 22215 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:11.090902 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 77238.8us
I20260709 12:26:11.092658 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 838948750f334b409ad4d7798a822e6d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.098887 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 838948750f334b409ad4d7798a822e6d with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:11.116853 22910 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.118427 21969 catalog_manager.cc:5697] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.121116 22810 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.121490 22065 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.136029 21970 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.138459 22215 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.143599 22808 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.152873 22067 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.163264 22143 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:11.167522 22916 tablet_replica.cc:333] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:11.168632 22916 raft_consensus.cc:2243] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.171095 22916 raft_consensus.cc:2272] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.183117 22141 consensus_queue.cc:237] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:11.188109 22916 ts_tablet_manager.cc:1916] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:11.191380 22810 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.192538 22808 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.193300 22901 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:11.191630 22065 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.193819 22861 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:11.205093 22847 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.205525 22884 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.205499 22861 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:26:11.207268 22807 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.218146 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ec6cbbf70dc43daa892eda3ef90f702 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.204782 22916 ts_tablet_manager.cc:1929] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:11.231202 22916 log.cc:1199] T 838948750f334b409ad4d7798a822e6d P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/838948750f334b409ad4d7798a822e6d
I20260709 12:26:11.194231 22067 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.233412 21968 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.234894 22910 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.222450 22809 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.227761 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48a34f9ae8654955bc6eda7229323ca3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.234400 21969 catalog_manager.cc:5697] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.237241 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 838948750f334b409ad4d7798a822e6d (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:11.239974 22073 raft_consensus.cc:2955] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.219974 22065 raft_consensus.cc:2955] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:11.252162 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 48a34f9ae8654955bc6eda7229323ca3 with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:11.254396 22211 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec6cbbf70dc43daa892eda3ef90f702 with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:11.276135 22918 tablet_replica.cc:333] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:11.277060 22918 raft_consensus.cc:2243] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.277854 22918 raft_consensus.cc:2272] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.282099 22918 ts_tablet_manager.cc:1916] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:11.302652 22918 ts_tablet_manager.cc:1929] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:11.302968 22918 log.cc:1199] T 48a34f9ae8654955bc6eda7229323ca3 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/48a34f9ae8654955bc6eda7229323ca3
I20260709 12:26:11.304276 22918 tablet_replica.cc:333] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:11.304265 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 48a34f9ae8654955bc6eda7229323ca3 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:11.305228 22918 raft_consensus.cc:2243] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.305811 22918 raft_consensus.cc:2272] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.308771 22918 ts_tablet_manager.cc:1916] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:11.319463 22918 ts_tablet_manager.cc:1929] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:11.319859 22918 log.cc:1199] T 4ec6cbbf70dc43daa892eda3ef90f702 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/4ec6cbbf70dc43daa892eda3ef90f702
I20260709 12:26:11.321075 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 4ec6cbbf70dc43daa892eda3ef90f702 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:12.346716 22215 consensus_queue.cc:237] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:12.354858 22186 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 147ee46d74a94d69bbe00644cd192cc2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.355050 22073 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.355705 22143 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.356299 22849 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.357125 22920 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.364267 22849 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.365907 22143 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.366182 22073 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.382975 21968 catalog_manager.cc:5697] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.388224 22215 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:12.396481 22073 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:12.396796 22186 consensus_peers.cc:597] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f775ac681f8f42d3a3a16bf664e0bee7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.397928 22920 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.398132 22143 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.401855 22920 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.408891 22883 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.411937 22073 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.422430 22143 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.423714 22141 consensus_queue.cc:237] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:12.436709 21970 catalog_manager.cc:5697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.473091 22065 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:12.473694 22112 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b1a99afb1f741bf8a2d6318f0ca4e2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.473906 22216 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.474548 22847 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.475483 22931 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.483342 22847 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.487419 22214 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.497228 22141 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:12.504928 22112 consensus_peers.cc:597] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 451d96b5461b4c21aa4930657c835b50. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.505677 22065 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.510088 21969 catalog_manager.cc:5697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.519388 22073 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.520948 22931 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.527391 22216 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.533782 22884 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.539083 22884 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.541746 22065 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.545388 22214 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.561306 21968 catalog_manager.cc:5697] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:12.839582 22940 ts_tablet_manager.cc:933] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:12.844336 22940 tablet_copy_client.cc:323] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:12.846256 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 147ee46d74a94d69bbe00644cd192cc2 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:12.846844 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 147ee46d74a94d69bbe00644cd192cc2 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-147ee46d74a94d69bbe00644cd192cc2
I20260709 12:26:12.854209 22232 tablet_copy_source_session.cc:215] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.858134 22940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147ee46d74a94d69bbe00644cd192cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.875713 22940 tablet_copy_client.cc:806] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.876363 22940 tablet_copy_client.cc:670] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.880805 22940 tablet_copy_client.cc:538] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.889786 22940 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:12.907428 22940 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.908685 22940 tablet_bootstrap.cc:492] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:12.909430 22940 ts_tablet_manager.cc:1403] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:26:12.912802 22940 raft_consensus.cc:359] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:12.913772 22940 raft_consensus.cc:740] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:12.914522 22940 consensus_queue.cc:260] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:12.919018 22940 ts_tablet_manager.cc:1434] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:26:12.921150 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-147ee46d74a94d69bbe00644cd192cc2 received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:12.921605 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-147ee46d74a94d69bbe00644cd192cc2 on tablet 147ee46d74a94d69bbe00644cd192cc2 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:12.985845 22940 ts_tablet_manager.cc:933] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:12.998080 22945 ts_tablet_manager.cc:933] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:13.000061 22940 tablet_copy_client.cc:323] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:13.002094 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet f775ac681f8f42d3a3a16bf664e0bee7 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:13.002683 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet f775ac681f8f42d3a3a16bf664e0bee7 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-f775ac681f8f42d3a3a16bf664e0bee7
I20260709 12:26:13.012480 22232 tablet_copy_source_session.cc:215] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:13.015959 22940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f775ac681f8f42d3a3a16bf664e0bee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.014650 22945 tablet_copy_client.cc:323] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:13.028337 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 451d96b5461b4c21aa4930657c835b50 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:13.028910 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 451d96b5461b4c21aa4930657c835b50 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-451d96b5461b4c21aa4930657c835b50
I20260709 12:26:13.032161 22940 tablet_copy_client.cc:806] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:13.032845 22940 tablet_copy_client.cc:670] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:13.036625 22158 tablet_copy_source_session.cc:215] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:13.037261 22940 tablet_copy_client.cc:538] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:13.039978 22945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451d96b5461b4c21aa4930657c835b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.046000 22940 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:13.063817 22945 tablet_copy_client.cc:806] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:13.064420 22945 tablet_copy_client.cc:670] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:13.071405 22947 ts_tablet_manager.cc:933] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:13.073129 22945 tablet_copy_client.cc:538] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:13.080430 22940 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.083725 22940 tablet_bootstrap.cc:492] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:13.085405 22940 ts_tablet_manager.cc:1403] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.012s
I20260709 12:26:13.084511 22945 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:13.086967 22947 tablet_copy_client.cc:323] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:13.088676 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:13.089133 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-6b1a99afb1f741bf8a2d6318f0ca4e2b
I20260709 12:26:13.091904 22940 raft_consensus.cc:359] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:13.093004 22940 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:13.093636 22940 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:13.109087 22158 tablet_copy_source_session.cc:215] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:13.113107 22947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.114113 22940 ts_tablet_manager.cc:1434] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:26:13.119946 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-f775ac681f8f42d3a3a16bf664e0bee7 received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:13.120388 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-f775ac681f8f42d3a3a16bf664e0bee7 on tablet f775ac681f8f42d3a3a16bf664e0bee7 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:13.126444 22945 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.127427 22945 tablet_bootstrap.cc:492] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:13.128154 22945 ts_tablet_manager.cc:1403] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.017s
I20260709 12:26:13.131003 22945 raft_consensus.cc:359] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:13.131788 22945 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:13.132470 22945 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:13.139581 22947 tablet_copy_client.cc:806] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:13.140184 22947 tablet_copy_client.cc:670] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:13.141141 22945 ts_tablet_manager.cc:1434] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.004s
I20260709 12:26:13.146634 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-451d96b5461b4c21aa4930657c835b50 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:13.151081 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-451d96b5461b4c21aa4930657c835b50 on tablet 451d96b5461b4c21aa4930657c835b50 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:13.145757 22947 tablet_copy_client.cc:538] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:13.167824 22947 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:13.345250 22947 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.346159 22947 tablet_bootstrap.cc:492] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:13.346850 22947 ts_tablet_manager.cc:1403] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.179s	user 0.018s	sys 0.009s
I20260709 12:26:13.350862 22947 raft_consensus.cc:359] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:13.351711 22947 raft_consensus.cc:740] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:13.352406 22947 consensus_queue.cc:260] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:13.355195 22947 ts_tablet_manager.cc:1434] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:13.408890 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-6b1a99afb1f741bf8a2d6318f0ca4e2b received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:13.409391 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-6b1a99afb1f741bf8a2d6318f0ca4e2b on tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:26:13.545279 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 81406.2us
W20260709 12:26:13.546382 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 82411.3us
I20260709 12:26:13.605473 22808 raft_consensus.cc:1217] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.610342 22810 raft_consensus.cc:1217] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:26:13.620889 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 73886us
I20260709 12:26:13.630697 22810 raft_consensus.cc:1217] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.646404 22810 raft_consensus.cc:1217] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.988430 22964 raft_consensus.cc:1064] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:13.999944 22964 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:14.009012 22807 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.010316 22959 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:14.013415 22073 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.013355 22140 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.015255 22961 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.017107 22961 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.030498 22964 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.032681 22807 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.048153 22141 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.048925 21968 catalog_manager.cc:5697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.073041 22073 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.094977 22967 raft_consensus.cc:1064] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:14.099385 22967 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:14.108400 22213 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:14.124672 22807 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.126358 22961 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.132426 22141 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.136715 22957 raft_consensus.cc:1064] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:14.137434 22962 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.138451 22959 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.139583 22957 consensus_queue.cc:237] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:14.140750 22810 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.143188 22216 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.145423 22967 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.152029 22141 raft_consensus.cc:2955] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.151427 22807 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.164070 22966 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.171382 22964 raft_consensus.cc:1064] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:14.173960 22964 consensus_queue.cc:237] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:14.187258 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f775ac681f8f42d3a3a16bf664e0bee7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.192041 22073 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.195266 22884 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.198036 21970 catalog_manager.cc:5697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.208283 22807 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.209980 22961 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.211397 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet f775ac681f8f42d3a3a16bf664e0bee7 with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:14.213307 22983 tablet_replica.cc:333] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:14.214895 22983 raft_consensus.cc:2243] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.216763 22983 raft_consensus.cc:2272] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.221096 22983 ts_tablet_manager.cc:1916] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.242540 22140 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.246410 22959 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.250854 22073 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.253218 22962 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:14.257432 22981 log.cc:927] Time spent T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:14.269790 22962 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.275679 22065 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.281818 22809 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.281354 22213 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.284768 22983 ts_tablet_manager.cc:1929] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.285291 22983 log.cc:1199] T f775ac681f8f42d3a3a16bf664e0bee7 P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/f775ac681f8f42d3a3a16bf664e0bee7
I20260709 12:26:14.285413 22966 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.288143 22963 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.300174 22213 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.304267 22068 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.304682 22987 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.305006 22073 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.315260 22966 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:14.327961 22966 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.332847 22809 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.340354 22808 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.358270 22808 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.402942 22213 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.427191 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet f775ac681f8f42d3a3a16bf664e0bee7 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:14.449399 22141 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.474431 21970 catalog_manager.cc:5697] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.446166 21968 catalog_manager.cc:5697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.449445 21969 catalog_manager.cc:5697] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:14.486054 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800134ee0 after lost signal to thread 20920
W20260709 12:26:14.488046 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc3a0 after lost signal to thread 22005
W20260709 12:26:14.489830 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca720 after lost signal to thread 22097
W20260709 12:26:14.493649 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8a20 after lost signal to thread 22172
W20260709 12:26:14.504499 22243 debug-util.cc:398] Leaking SignalData structure 0x7b080004f940 after lost signal to thread 22246
W20260709 12:26:14.522505 22243 debug-util.cc:398] Leaking SignalData structure 0x7b080029b6c0 after lost signal to thread 22834
I20260709 12:26:14.550765 22140 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:14.574744 22066 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.593349 22808 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.596473 22966 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:14.605357 22213 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.613785 22963 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:14.617606 22213 consensus_queue.cc:237] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:14.621052 22987 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.629199 22809 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.645906 22216 raft_consensus.cc:2955] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.647331 21971 catalog_manager.cc:5697] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.660392 22808 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.664979 22962 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:14.674088 22066 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.680081 22959 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:26:14.689707 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 451d96b5461b4c21aa4930657c835b50 with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:14.691712 22983 tablet_replica.cc:333] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:14.692982 22983 raft_consensus.cc:2243] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.693929 22983 raft_consensus.cc:2272] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.701663 22068 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.706305 22983 ts_tablet_manager.cc:1916] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.707345 22808 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.707387 22962 raft_consensus.cc:2955] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.722128 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 451d96b5461b4c21aa4930657c835b50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.735222 22140 consensus_queue.cc:237] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:14.750379 22809 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.757998 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 147ee46d74a94d69bbe00644cd192cc2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.757066 22066 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.760845 22987 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.775666 21968 catalog_manager.cc:5697] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.791558 22987 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:14.798302 22931 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.802520 22066 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.804139 22808 raft_consensus.cc:2955] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.804325 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 147ee46d74a94d69bbe00644cd192cc2 with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:14.814061 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.823328 22997 tablet_replica.cc:333] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:14.827329 22997 raft_consensus.cc:2243] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.827771 22983 ts_tablet_manager.cc:1929] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.828222 22997 raft_consensus.cc:2272] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.828379 22983 log.cc:1199] T 451d96b5461b4c21aa4930657c835b50 P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/451d96b5461b4c21aa4930657c835b50
I20260709 12:26:14.830446 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 451d96b5461b4c21aa4930657c835b50 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:14.832301 22997 ts_tablet_manager.cc:1916] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.834273 21967 catalog_manager.cc:5697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:14.846791 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:14.848279 22997 ts_tablet_manager.cc:1929] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.848857 22997 log.cc:1199] T 147ee46d74a94d69bbe00644cd192cc2 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/147ee46d74a94d69bbe00644cd192cc2
I20260709 12:26:14.850979 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 147ee46d74a94d69bbe00644cd192cc2 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:14.857152 22998 tablet_replica.cc:333] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:14.858264 22998 raft_consensus.cc:2243] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.859102 22998 raft_consensus.cc:2272] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.864802 22998 ts_tablet_manager.cc:1916] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.881628 22998 ts_tablet_manager.cc:1929] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.882179 22998 log.cc:1199] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/6b1a99afb1f741bf8a2d6318f0ca4e2b
I20260709 12:26:14.884397 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 6b1a99afb1f741bf8a2d6318f0ca4e2b (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:15.941628 22216 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:15.949772 22186 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0007b92daafb42eda8843693014ea1d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.950587 22141 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.951339 22067 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.952221 22961 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:15.953193 22959 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.961577 22961 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:15.964351 22141 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:15.970038 22067 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:15.975980 22066 consensus_queue.cc:237] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:15.990204 21971 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.002926 22213 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:16.004593 22999 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:16.007234 22037 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9360ea2e8bd04bd899235529e921b05d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.030300 22140 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:16.033165 22995 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:16.064226 22911 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.069092 22144 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.089293 22066 consensus_queue.cc:237] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.098376 21970 catalog_manager.cc:5697] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
W20260709 12:26:16.122030 22037 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39f024f1dc1c4aaaa8094ad37822a6e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.127264 22213 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:16.125809 22216 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.139240 22144 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:16.140905 22911 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:16.157917 22911 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.167163 22140 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.174923 23010 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:16.194969 22140 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.210392 21970 catalog_manager.cc:5697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.214066 22215 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.244102 22213 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:16.245605 22112 consensus_peers.cc:597] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b3632e739cf449a83c07dcdbce1528c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.245895 22987 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:16.262846 22066 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:16.264688 22966 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:16.266702 22966 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.296459 22215 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.303965 22065 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:16.314630 21971 catalog_manager.cc:5697] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.515524 23024 ts_tablet_manager.cc:933] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:16.517710 23024 tablet_copy_client.cc:323] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:16.520058 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 0007b92daafb42eda8843693014ea1d1 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:16.520620 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 0007b92daafb42eda8843693014ea1d1 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-0007b92daafb42eda8843693014ea1d1
I20260709 12:26:16.528861 22232 tablet_copy_source_session.cc:215] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.531706 23026 ts_tablet_manager.cc:933] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:16.532742 23024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0007b92daafb42eda8843693014ea1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.540288 23026 tablet_copy_client.cc:323] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:16.542667 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 39f024f1dc1c4aaaa8094ad37822a6e1 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:16.543207 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 39f024f1dc1c4aaaa8094ad37822a6e1 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-39f024f1dc1c4aaaa8094ad37822a6e1
I20260709 12:26:16.550969 22083 tablet_copy_source_session.cc:215] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.555271 23026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f024f1dc1c4aaaa8094ad37822a6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.579478 23024 tablet_copy_client.cc:806] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.584620 23024 tablet_copy_client.cc:670] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.587953 23026 tablet_copy_client.cc:806] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.588640 23026 tablet_copy_client.cc:670] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.604760 23024 tablet_copy_client.cc:538] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.614214 23026 tablet_copy_client.cc:538] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.635959 23026 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:16.664654 23024 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:16.735514 23026 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.747627 23030 ts_tablet_manager.cc:933] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:16.769016 23026 tablet_bootstrap.cc:492] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:16.748106 23028 ts_tablet_manager.cc:933] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:16.769829 23026 ts_tablet_manager.cc:1403] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.134s	user 0.025s	sys 0.010s
I20260709 12:26:16.794029 23026 raft_consensus.cc:359] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.797407 23026 raft_consensus.cc:740] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:16.800278 23026 consensus_queue.cc:260] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.801828 23028 tablet_copy_client.cc:323] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:16.804656 23030 tablet_copy_client.cc:323] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:16.806077 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 9360ea2e8bd04bd899235529e921b05d from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:16.807773 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 5b3632e739cf449a83c07dcdbce1528c from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:16.808451 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 5b3632e739cf449a83c07dcdbce1528c from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-5b3632e739cf449a83c07dcdbce1528c
I20260709 12:26:16.807920 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 9360ea2e8bd04bd899235529e921b05d from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-9360ea2e8bd04bd899235529e921b05d
I20260709 12:26:16.825338 23026 ts_tablet_manager.cc:1434] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.003s
I20260709 12:26:16.829829 22082 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-39f024f1dc1c4aaaa8094ad37822a6e1 received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:16.830127 22158 tablet_copy_source_session.cc:215] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.830336 22082 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-39f024f1dc1c4aaaa8094ad37822a6e1 on tablet 39f024f1dc1c4aaaa8094ad37822a6e1 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:16.840868 23024 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.842020 23024 tablet_bootstrap.cc:492] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:16.842798 23024 ts_tablet_manager.cc:1403] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.178s	user 0.022s	sys 0.004s
I20260709 12:26:16.845887 23024 raft_consensus.cc:359] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.846843 23024 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:16.847558 23024 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.850274 23024 ts_tablet_manager.cc:1434] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:16.852201 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-0007b92daafb42eda8843693014ea1d1 received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:16.852653 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-0007b92daafb42eda8843693014ea1d1 on tablet 0007b92daafb42eda8843693014ea1d1 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:16.852764 23030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3632e739cf449a83c07dcdbce1528c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.868438 22083 tablet_copy_source_session.cc:215] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.872510 23028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9360ea2e8bd04bd899235529e921b05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.874843 23030 tablet_copy_client.cc:806] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.875443 23030 tablet_copy_client.cc:670] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.880151 23030 tablet_copy_client.cc:538] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.895596 23030 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:16.897893 23028 tablet_copy_client.cc:806] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.898586 23028 tablet_copy_client.cc:670] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.902724 23028 tablet_copy_client.cc:538] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.913741 23028 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:16.929593 23030 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.930701 23030 tablet_bootstrap.cc:492] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:16.931455 23030 ts_tablet_manager.cc:1403] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.014s
I20260709 12:26:16.934573 23030 raft_consensus.cc:359] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.935490 23030 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:16.936331 23030 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.938575 23028 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.939584 23028 tablet_bootstrap.cc:492] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:16.939860 23030 ts_tablet_manager.cc:1434] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:26:16.940330 23028 ts_tablet_manager.cc:1403] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.027s	user 0.026s	sys 0.000s
I20260709 12:26:16.941679 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-5b3632e739cf449a83c07dcdbce1528c received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:16.942148 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-5b3632e739cf449a83c07dcdbce1528c on tablet 5b3632e739cf449a83c07dcdbce1528c with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:16.943642 23028 raft_consensus.cc:359] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.944937 23028 raft_consensus.cc:740] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:16.945667 23028 consensus_queue.cc:260] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:16.948099 23028 ts_tablet_manager.cc:1434] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:16.949867 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-9360ea2e8bd04bd899235529e921b05d received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:16.950266 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-9360ea2e8bd04bd899235529e921b05d on tablet 9360ea2e8bd04bd899235529e921b05d with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:16.955121 22809 raft_consensus.cc:1217] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:16.955161 22808 raft_consensus.cc:1217] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:17.016310 22808 raft_consensus.cc:1217] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:17.123754 22808 raft_consensus.cc:1217] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:17.418781 22995 raft_consensus.cc:1064] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:17.421418 22995 consensus_queue.cc:237] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:17.428567 22808 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.430058 23014 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:17.433089 22213 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.435276 22141 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.440136 23010 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:17.442256 23010 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.468935 23010 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.483111 22213 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.480702 22808 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.503360 22141 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.508774 21970 catalog_manager.cc:5697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.572252 23010 raft_consensus.cc:1064] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:17.573129 22961 raft_consensus.cc:1064] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:17.574805 23010 consensus_queue.cc:237] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:17.575752 22961 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:17.629339 22808 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.631212 22995 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.639343 22213 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.641734 22911 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.668113 22141 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.606895 22065 consensus_queue.cc:237] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:17.677444 23021 raft_consensus.cc:1064] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:17.677826 22808 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:17.680363 22995 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:17.688760 22995 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.698936 23045 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:17.699460 22808 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.702726 23021 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:17.711463 22140 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:26:17.729099 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 89565us
I20260709 12:26:17.746790 23045 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:26:17.765285 21971 catalog_manager.cc:5697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.770574 22141 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.774961 23057 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.770617 22065 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.784075 22141 raft_consensus.cc:2955] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.782759 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39f024f1dc1c4aaaa8094ad37822a6e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:17.795665 22215 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.801946 23010 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.792115 22140 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.809682 22959 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.881897 22809 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:17.901592 22808 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:26:17.901561 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 67254.4us
I20260709 12:26:17.910784 21971 catalog_manager.cc:5697] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.919317 22959 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.923914 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 39f024f1dc1c4aaaa8094ad37822a6e1 with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:17.954057 22808 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.965931 23067 tablet_replica.cc:333] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:17.966209 22067 consensus_queue.cc:237] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:17.966605 22931 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.972800 23067 raft_consensus.cc:2243] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.973960 22066 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.974661 23067 raft_consensus.cc:2272] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.983618 22810 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:17.985041 22222 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.985402 23067 ts_tablet_manager.cc:1916] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:17.987421 22931 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:17.998577 23061 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:18.025277 23057 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.032389 22809 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.038153 22067 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.047173 22215 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.060384 23053 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:26:18.074095 21970 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.094621 22213 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.094357 23045 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.130182 22911 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.130002 21970 catalog_manager.cc:5697] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.168303 22809 raft_consensus.cc:2955] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.188926 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9360ea2e8bd04bd899235529e921b05d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:18.190542 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 9360ea2e8bd04bd899235529e921b05d with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:18.209800 22148 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.244213 23021 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.243247 23074 tablet_replica.cc:333] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:18.252574 22065 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:18.255694 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 82229.7us
I20260709 12:26:18.266572 22222 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:18.277892 22066 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.279309 23057 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.280179 22808 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.286481 23067 ts_tablet_manager.cc:1929] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:18.286981 23067 log.cc:1199] T 39f024f1dc1c4aaaa8094ad37822a6e1 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/39f024f1dc1c4aaaa8094ad37822a6e1
I20260709 12:26:18.289084 22809 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.291126 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 39f024f1dc1c4aaaa8094ad37822a6e1 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:18.291807 22961 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.293592 23055 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.300406 22066 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.299131 21967 catalog_manager.cc:5697] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.305106 22808 raft_consensus.cc:2955] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.307632 22222 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.318862 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0007b92daafb42eda8843693014ea1d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:18.335595 23074 raft_consensus.cc:2243] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.336422 23074 raft_consensus.cc:2272] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.340261 23074 ts_tablet_manager.cc:1916] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:18.366801 23074 ts_tablet_manager.cc:1929] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:18.367292 23074 log.cc:1199] T 9360ea2e8bd04bd899235529e921b05d P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/9360ea2e8bd04bd899235529e921b05d
I20260709 12:26:18.369483 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 9360ea2e8bd04bd899235529e921b05d (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:18.371266 22140 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:18.372105 21968 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.378006 22222 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.378069 22809 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.380856 23021 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.390715 23073 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.395733 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 0007b92daafb42eda8843693014ea1d1 with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:18.396598 22809 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.397046 23074 tablet_replica.cc:333] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:18.399652 23047 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:26:18.414175 23074 raft_consensus.cc:2243] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.419414 22222 raft_consensus.cc:2955] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.435253 23074 raft_consensus.cc:2272] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.436543 21967 catalog_manager.cc:5697] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:18.437762 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b3632e739cf449a83c07dcdbce1528c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:18.446014 23074 ts_tablet_manager.cc:1916] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:18.451751 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b3632e739cf449a83c07dcdbce1528c with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:18.465452 23074 ts_tablet_manager.cc:1929] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:18.466003 23074 log.cc:1199] T 0007b92daafb42eda8843693014ea1d1 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/0007b92daafb42eda8843693014ea1d1
I20260709 12:26:18.467831 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 0007b92daafb42eda8843693014ea1d1 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:18.487582 23075 tablet_replica.cc:333] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:18.488695 23075 raft_consensus.cc:2243] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.489862 23075 raft_consensus.cc:2272] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.496327 23075 ts_tablet_manager.cc:1916] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:18.513353 23075 ts_tablet_manager.cc:1929] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:18.513867 23075 log.cc:1199] T 5b3632e739cf449a83c07dcdbce1528c P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/5b3632e739cf449a83c07dcdbce1528c
I20260709 12:26:18.515626 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 5b3632e739cf449a83c07dcdbce1528c (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:19.545778 22141 consensus_queue.cc:237] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:19.555431 22112 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57757a075ae444bf9e3ae62e6892f42a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:19.555749 22065 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:19.557147 22222 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:19.559062 23021 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.561156 23021 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.587598 23077 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:19.602756 22067 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:19.609273 22222 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:19.617491 22065 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:19.625703 21967 catalog_manager.cc:5697] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.651863 22217 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:19.653410 23045 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:19.655906 22037 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03eee184731a4ec1bf7ba98505a56567. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:19.667965 22141 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:19.669512 23045 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.682046 23069 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.263935 22217 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.396557 23102 ts_tablet_manager.cc:933] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
W20260709 12:26:20.417095 22141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.000s	sys 0.010s
W20260709 12:26:20.417516 22141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.000s	sys 0.010s
I20260709 12:26:20.422362 21968 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.429730 22141 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.453230 23102 tablet_copy_client.cc:323] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:20.465562 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 03eee184731a4ec1bf7ba98505a56567 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:20.466192 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 03eee184731a4ec1bf7ba98505a56567 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-03eee184731a4ec1bf7ba98505a56567
I20260709 12:26:20.468647 22215 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:20.480706 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 60654.6us
I20260709 12:26:20.493947 22083 tablet_copy_source_session.cc:215] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:20.503314 23102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03eee184731a4ec1bf7ba98505a56567. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:20.514323 22186 consensus_peers.cc:597] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 369b15e6e4254982a559940734df1656. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.533846 22073 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:20.544675 23104 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.564096 23102 tablet_copy_client.cc:806] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:20.564834 23102 tablet_copy_client.cc:670] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:20.569882 23102 tablet_copy_client.cc:538] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:20.570101 23113 ts_tablet_manager.cc:933] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:20.581496 23102 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:20.592324 23108 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.594182 22148 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:20.599336 22073 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.624792 22216 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:20.624931 21970 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.637840 23059 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.642326 23113 tablet_copy_client.cc:323] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:20.647143 23102 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:20.648295 23102 tablet_bootstrap.cc:492] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:20.649142 23102 ts_tablet_manager.cc:1403] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.004s
I20260709 12:26:20.652541 23102 raft_consensus.cc:359] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:20.653581 23102 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:20.654419 23102 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:20.658828 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 57757a075ae444bf9e3ae62e6892f42a from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:20.659587 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 57757a075ae444bf9e3ae62e6892f42a from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-57757a075ae444bf9e3ae62e6892f42a
I20260709 12:26:20.670475 22073 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:20.672032 22141 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:20.681787 23104 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.682878 23108 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:20.684055 22186 consensus_peers.cc:597] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c9cf5f021f44b55831f1ed964025c7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.695187 22158 tablet_copy_source_session.cc:215] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:20.699007 23113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57757a075ae444bf9e3ae62e6892f42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:20.701023 22148 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.706766 23108 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.708519 22141 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.712276 23102 ts_tablet_manager.cc:1434] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.063s	user 0.024s	sys 0.011s
I20260709 12:26:20.714269 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-03eee184731a4ec1bf7ba98505a56567 received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:20.714807 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-03eee184731a4ec1bf7ba98505a56567 on tablet 03eee184731a4ec1bf7ba98505a56567 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:20.735574 21968 catalog_manager.cc:5697] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.759883 22066 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:20.767704 23113 tablet_copy_client.cc:806] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:20.768666 23113 tablet_copy_client.cc:670] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:20.774108 23113 tablet_copy_client.cc:538] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:20.807708 23113 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:20.867071 23113 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:20.868014 23113 tablet_bootstrap.cc:492] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:20.868693 23113 ts_tablet_manager.cc:1403] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.014s
I20260709 12:26:20.877542 23113 raft_consensus.cc:359] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:20.878496 23113 raft_consensus.cc:740] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:20.879180 23113 consensus_queue.cc:260] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:20.881517 23113 ts_tablet_manager.cc:1434] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.004s
I20260709 12:26:20.884064 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-57757a075ae444bf9e3ae62e6892f42a received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:20.884483 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-57757a075ae444bf9e3ae62e6892f42a on tablet 57757a075ae444bf9e3ae62e6892f42a with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:20.982854 23113 ts_tablet_manager.cc:933] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:20.991117 22809 raft_consensus.cc:1217] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:20.992655 23113 tablet_copy_client.cc:323] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:20.995689 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 369b15e6e4254982a559940734df1656 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:20.996120 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 369b15e6e4254982a559940734df1656 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-369b15e6e4254982a559940734df1656
I20260709 12:26:21.012087 22232 tablet_copy_source_session.cc:215] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:21.016534 23113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369b15e6e4254982a559940734df1656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:21.043404 23113 tablet_copy_client.cc:806] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:21.044005 23113 tablet_copy_client.cc:670] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:21.047792 23113 tablet_copy_client.cc:538] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:21.056555 23113 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:21.078243 23113 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:21.078953 23113 tablet_bootstrap.cc:492] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:21.079466 23113 ts_tablet_manager.cc:1403] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 12:26:21.081614 23113 raft_consensus.cc:359] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:21.082204 23113 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:21.082734 23113 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:21.084811 23113 ts_tablet_manager.cc:1434] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:21.086944 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-369b15e6e4254982a559940734df1656 received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:21.087402 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-369b15e6e4254982a559940734df1656 on tablet 369b15e6e4254982a559940734df1656 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:21.153273 23113 ts_tablet_manager.cc:933] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:21.154851 23113 tablet_copy_client.cc:323] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:21.156304 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 1c9cf5f021f44b55831f1ed964025c7e from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:21.156828 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 1c9cf5f021f44b55831f1ed964025c7e from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-1c9cf5f021f44b55831f1ed964025c7e
I20260709 12:26:21.164402 22232 tablet_copy_source_session.cc:215] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:21.167430 23113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9cf5f021f44b55831f1ed964025c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:21.182371 23113 tablet_copy_client.cc:806] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:21.182950 23113 tablet_copy_client.cc:670] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:21.185938 23113 tablet_copy_client.cc:538] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:21.191812 23113 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:21.205051 23113 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:21.205945 23113 tablet_bootstrap.cc:492] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:21.206658 23113 ts_tablet_manager.cc:1403] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.004s
I20260709 12:26:21.208773 23113 raft_consensus.cc:359] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:21.209307 23113 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:21.209718 23113 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:21.211496 23113 ts_tablet_manager.cc:1434] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:21.213199 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-1c9cf5f021f44b55831f1ed964025c7e received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:21.213526 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-1c9cf5f021f44b55831f1ed964025c7e on tablet 1c9cf5f021f44b55831f1ed964025c7e with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:21.259459 22809 raft_consensus.cc:1217] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:26:21.290140 22243 debug-util.cc:398] Leaking SignalData structure 0x7b080029b380 after lost signal to thread 20920
W20260709 12:26:21.291129 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed060 after lost signal to thread 22005
W20260709 12:26:21.292491 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5ce0 after lost signal to thread 22097
W20260709 12:26:21.293561 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08001390e0 after lost signal to thread 22172
W20260709 12:26:21.294649 22243 debug-util.cc:398] Leaking SignalData structure 0x7b080012bb00 after lost signal to thread 22246
W20260709 12:26:21.295801 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08003279c0 after lost signal to thread 22834
I20260709 12:26:21.404505 22809 raft_consensus.cc:1217] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:21.465633 23096 raft_consensus.cc:1064] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:21.468269 23096 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:21.506642 22809 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.507213 22141 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.512219 23069 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.514070 23069 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.510878 22220 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.520408 23069 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.542376 23094 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.557241 22214 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.578979 21970 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:21.583654 22809 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.601035 22148 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.633351 22808 raft_consensus.cc:1217] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:21.657526 23106 raft_consensus.cc:1064] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:21.676039 23106 consensus_queue.cc:237] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:21.685029 22065 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:21.690605 22214 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:21.691177 22808 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:21.692229 23069 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:21.693193 23094 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:21.700487 23105 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.702090 22808 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.706840 22809 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.711645 23110 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.720744 22214 raft_consensus.cc:2955] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.736071 22065 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.736733 22220 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.737676 23099 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.740231 23100 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.744645 21971 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.757009 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03eee184731a4ec1bf7ba98505a56567 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:21.756234 23110 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.762745 22073 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.765836 22220 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.788026 23059 raft_consensus.cc:1064] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:21.800479 23059 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:21.805976 21968 catalog_manager.cc:5697] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.809595 22808 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.820452 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 03eee184731a4ec1bf7ba98505a56567 with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:21.830439 22148 consensus_queue.cc:237] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:21.843973 22065 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:21.843925 22810 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.845630 23104 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.846710 23142 tablet_replica.cc:333] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:21.846879 23106 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:21.848045 23142 raft_consensus.cc:2243] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.848698 23142 raft_consensus.cc:2272] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.858417 23110 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.866665 22145 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.867012 23142 ts_tablet_manager.cc:1916] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:21.868266 23104 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.872314 22067 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.890125 22065 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:21.891655 23059 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:21.890185 23142 ts_tablet_manager.cc:1929] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:21.893378 23142 log.cc:1199] T 03eee184731a4ec1bf7ba98505a56567 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/03eee184731a4ec1bf7ba98505a56567
I20260709 12:26:21.909921 22809 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:21.896157 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 03eee184731a4ec1bf7ba98505a56567 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:21.930701 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57757a075ae444bf9e3ae62e6892f42a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:21.903597 23104 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:21.947301 21970 catalog_manager.cc:5697] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.029135 21968 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.031157 22145 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.036548 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 57757a075ae444bf9e3ae62e6892f42a with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:22.045527 23110 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:22.046428 22809 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.058349 22216 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:22.081621 22145 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:26:22.082095 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 66884.9us
I20260709 12:26:22.110939 22809 raft_consensus.cc:2955] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:22.123041 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 125638us
I20260709 12:26:22.134271 22810 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:22.136296 23152 tablet_replica.cc:333] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:22.138355 23152 raft_consensus.cc:2243] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.139492 23152 raft_consensus.cc:2272] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.118834 23108 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:26:22.152904 23147 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:26:22.187011 23152 ts_tablet_manager.cc:1916] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:22.177922 23147 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.192747 22145 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.196682 22809 raft_consensus.cc:2955] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.209793 21970 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:22.219861 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 102947us
I20260709 12:26:22.228027 23152 ts_tablet_manager.cc:1929] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:22.231058 23152 log.cc:1199] T 57757a075ae444bf9e3ae62e6892f42a P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/57757a075ae444bf9e3ae62e6892f42a
I20260709 12:26:22.232632 23155 raft_consensus.cc:1064] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:22.235113 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 57757a075ae444bf9e3ae62e6892f42a (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:22.235373 23155 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:22.251605 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 369b15e6e4254982a559940734df1656 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:22.254462 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 369b15e6e4254982a559940734df1656 with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:22.266675 22809 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:22.267402 22145 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:22.268450 22073 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:22.268898 23147 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:22.269930 23155 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:22.271260 23108 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:22.279659 23159 tablet_replica.cc:333] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:22.280995 23159 raft_consensus.cc:2243] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.287480 23159 pending_rounds.cc:70] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: Trying to abort 1 pending ops.
I20260709 12:26:22.289963 23159 pending_rounds.cc:77] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305625525408215040 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "369b15e6e4254982a559940734df1656" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } } }
I20260709 12:26:22.291877 23159 raft_consensus.cc:2917] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:26:22.292383 23159 raft_consensus.cc:2889] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:26:22.295959 23159 raft_consensus.cc:2272] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.307374 23159 ts_tablet_manager.cc:1916] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:22.328653 23108 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.333209 22809 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.351564 21970 catalog_manager.cc:5697] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.345676 22073 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.378463 22220 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:22.391810 22810 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:22.331614 22148 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.396278 23108 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:26:22.409861 23108 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.411775 22809 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.424010 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c9cf5f021f44b55831f1ed964025c7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:22.429219 23159 ts_tablet_manager.cc:1929] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:22.429791 23159 log.cc:1199] T 369b15e6e4254982a559940734df1656 P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/369b15e6e4254982a559940734df1656
I20260709 12:26:22.442142 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 369b15e6e4254982a559940734df1656 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:22.435086 21970 catalog_manager.cc:5697] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.444027 22141 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:22.453060 23059 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:22.465198 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c9cf5f021f44b55831f1ed964025c7e with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:22.466197 23159 tablet_replica.cc:333] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:22.467388 23159 raft_consensus.cc:2243] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.468161 23159 raft_consensus.cc:2272] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.474186 23159 ts_tablet_manager.cc:1916] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:22.484694 22148 raft_consensus.cc:2955] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:22.508414 23159 ts_tablet_manager.cc:1929] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:22.508915 23159 log.cc:1199] T 1c9cf5f021f44b55831f1ed964025c7e P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/1c9cf5f021f44b55831f1ed964025c7e
I20260709 12:26:22.510586 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 1c9cf5f021f44b55831f1ed964025c7e (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:23.541415 22141 consensus_queue.cc:237] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:23.548211 22112 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a00dfd4bb864cbe94033b53b925fd76. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.548627 22216 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:23.550019 23099 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.550336 22065 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:23.551512 23110 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.557488 23110 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.558745 22216 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.581076 21970 catalog_manager.cc:5697] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.588698 22065 consensus_queue.cc:237] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:23.588286 22067 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
W20260709 12:26:23.616600 22037 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f20d90a634149ef85ae0b05adb8a34a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.616863 22148 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:23.618566 23168 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.620074 22216 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:23.622174 23168 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.627904 23169 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.629753 22148 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.650405 22216 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.660861 22148 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:23.667755 21968 catalog_manager.cc:5697] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
W20260709 12:26:23.706612 22112 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e92d357da9e844b2ae270e73b28170db. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.736822 22073 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:23.739244 22216 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:23.739223 23110 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.741078 23178 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.747993 23178 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.749737 22073 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.750468 22216 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.767411 21968 catalog_manager.cc:5697] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.774240 22141 consensus_queue.cc:237] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:23.786465 22112 consensus_peers.cc:597] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26519f93f2144612acf259d481dc4485. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.789022 22216 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:23.789022 22073 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:23.790383 23177 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.791119 23110 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.798182 23099 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.799942 22216 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.802434 22067 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:23.824473 21971 catalog_manager.cc:5697] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.166468 23184 ts_tablet_manager.cc:933] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:24.170883 23184 tablet_copy_client.cc:323] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:24.172991 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 0a00dfd4bb864cbe94033b53b925fd76 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:24.173590 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 0a00dfd4bb864cbe94033b53b925fd76 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-0a00dfd4bb864cbe94033b53b925fd76
I20260709 12:26:24.182125 22158 tablet_copy_source_session.cc:215] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:24.185801 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a00dfd4bb864cbe94033b53b925fd76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:24.202399 23184 tablet_copy_client.cc:806] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:24.204054 23184 tablet_copy_client.cc:670] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:24.208678 23184 tablet_copy_client.cc:538] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:24.227658 23186 ts_tablet_manager.cc:933] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:24.230157 23184 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:24.243535 23186 tablet_copy_client.cc:323] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:24.249594 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 9f20d90a634149ef85ae0b05adb8a34a from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:24.250303 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 9f20d90a634149ef85ae0b05adb8a34a from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-9f20d90a634149ef85ae0b05adb8a34a
I20260709 12:26:24.267899 22083 tablet_copy_source_session.cc:215] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:24.277735 23186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f20d90a634149ef85ae0b05adb8a34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:24.288384 23189 ts_tablet_manager.cc:933] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:24.301035 23184 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.302872 23189 tablet_copy_client.cc:323] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:24.303200 23184 tablet_bootstrap.cc:492] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:24.304121 23184 ts_tablet_manager.cc:1403] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.013s
I20260709 12:26:24.305166 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet e92d357da9e844b2ae270e73b28170db from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:24.305794 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet e92d357da9e844b2ae270e73b28170db from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-e92d357da9e844b2ae270e73b28170db
I20260709 12:26:24.308321 23184 raft_consensus.cc:359] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:24.309196 23184 raft_consensus.cc:740] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:24.309859 23184 consensus_queue.cc:260] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:24.313951 22158 tablet_copy_source_session.cc:215] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:24.320441 23192 ts_tablet_manager.cc:933] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:24.323724 23189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e92d357da9e844b2ae270e73b28170db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:24.328500 23192 tablet_copy_client.cc:323] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:24.328634 23184 ts_tablet_manager.cc:1434] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:26:24.332289 23186 tablet_copy_client.cc:806] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:24.333002 23186 tablet_copy_client.cc:670] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:24.336004 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 26519f93f2144612acf259d481dc4485 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:24.336280 22157 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-0a00dfd4bb864cbe94033b53b925fd76 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:24.342188 22157 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-0a00dfd4bb864cbe94033b53b925fd76 on tablet 0a00dfd4bb864cbe94033b53b925fd76 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:24.342819 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 26519f93f2144612acf259d481dc4485 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-26519f93f2144612acf259d481dc4485
I20260709 12:26:24.346961 23189 tablet_copy_client.cc:806] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:24.347553 23189 tablet_copy_client.cc:670] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:24.350886 22158 tablet_copy_source_session.cc:215] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:24.353125 23186 tablet_copy_client.cc:538] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:24.361120 23192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26519f93f2144612acf259d481dc4485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:24.363011 23189 tablet_copy_client.cc:538] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:24.364209 23186 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:24.379771 23189 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:24.394658 23192 tablet_copy_client.cc:806] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:24.395328 23192 tablet_copy_client.cc:670] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:24.399271 23192 tablet_copy_client.cc:538] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:24.414475 23192 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:24.428402 23186 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.429525 23186 tablet_bootstrap.cc:492] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:24.430308 23186 ts_tablet_manager.cc:1403] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.016s
I20260709 12:26:24.431623 23189 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.432554 23189 tablet_bootstrap.cc:492] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:24.433243 23189 ts_tablet_manager.cc:1403] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.009s
I20260709 12:26:24.433735 23186 raft_consensus.cc:359] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:24.435570 23186 raft_consensus.cc:740] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:24.437347 23189 raft_consensus.cc:359] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:24.438489 23189 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:24.439659 23189 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:24.442078 23189 ts_tablet_manager.cc:1434] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:24.436316 23186 consensus_queue.cc:260] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:24.444077 23186 ts_tablet_manager.cc:1434] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:26:24.447171 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-e92d357da9e844b2ae270e73b28170db received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:24.447623 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-e92d357da9e844b2ae270e73b28170db on tablet e92d357da9e844b2ae270e73b28170db with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:24.453469 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-9f20d90a634149ef85ae0b05adb8a34a received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:24.453903 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-9f20d90a634149ef85ae0b05adb8a34a on tablet 9f20d90a634149ef85ae0b05adb8a34a with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:24.457461 23192 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.459295 23192 tablet_bootstrap.cc:492] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:24.460086 23192 ts_tablet_manager.cc:1403] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.018s
I20260709 12:26:24.463411 23192 raft_consensus.cc:359] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:24.465881 23192 raft_consensus.cc:740] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:24.466568 23192 consensus_queue.cc:260] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:24.469240 23192 ts_tablet_manager.cc:1434] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:26:24.471732 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-26519f93f2144612acf259d481dc4485 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:24.472221 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-26519f93f2144612acf259d481dc4485 on tablet 26519f93f2144612acf259d481dc4485 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:24.605105 22809 raft_consensus.cc:1217] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:24.706200 22810 raft_consensus.cc:1217] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:24.762382 22810 raft_consensus.cc:1217] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:24.782872 22810 raft_consensus.cc:1217] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:25.047434 23178 raft_consensus.cc:1064] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:25.050954 23178 consensus_queue.cc:237] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:25.059481 22810 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.060937 23178 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:25.061586 22067 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.062862 22217 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.064278 23178 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.066066 23177 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.086390 23201 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.093015 22067 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.093137 22809 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.115716 21968 catalog_manager.cc:5697] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.120857 22217 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.138525 23169 raft_consensus.cc:1064] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:25.141799 23169 consensus_queue.cc:237] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:25.177371 23178 raft_consensus.cc:1064] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:25.182934 22217 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.185395 23199 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:25.188320 22809 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.191783 23199 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.213927 22141 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.230994 22144 consensus_queue.cc:237] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:25.239038 22810 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:25.242086 23169 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:25.242579 22067 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:25.244328 23202 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:25.252090 23202 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:25.261582 23177 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.181250 23178 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:25.271166 23169 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.291819 22809 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.300262 22810 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.283643 22067 raft_consensus.cc:2955] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.309662 23201 raft_consensus.cc:1064] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:25.315166 21971 catalog_manager.cc:5697] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.321753 23201 consensus_queue.cc:237] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:25.340487 22217 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:25.364852 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 73367.4us
I20260709 12:26:25.372037 21967 catalog_manager.cc:5697] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.376900 22073 consensus_queue.cc:237] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:25.390429 22216 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.405818 22220 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:25.407258 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a00dfd4bb864cbe94033b53b925fd76 with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:25.411713 22148 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.414245 23217 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:25.416239 22073 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:26:25.417459 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 65469.4us
I20260709 12:26:25.419876 22810 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:25.420084 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a00dfd4bb864cbe94033b53b925fd76 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:25.423008 22220 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.423432 22808 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.410872 22067 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.431370 22810 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:25.431922 23226 tablet_replica.cc:333] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:25.432891 23151 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:25.429060 23220 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:26:25.446776 23199 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.451109 23169 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:25.433441 23226 raft_consensus.cc:2243] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.467283 23226 raft_consensus.cc:2272] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.467170 22809 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.467698 22217 raft_consensus.cc:2955] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.429000 23178 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:26:25.475076 23217 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.491361 23221 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:25.496634 21967 catalog_manager.cc:5697] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.499764 23220 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.520381 23226 ts_tablet_manager.cc:1916] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:25.526667 23202 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.531209 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f20d90a634149ef85ae0b05adb8a34a with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:25.540823 22220 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.543054 23233 tablet_replica.cc:333] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:25.546185 23178 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.563558 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f20d90a634149ef85ae0b05adb8a34a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:25.549962 22809 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.549962 22067 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.556219 22808 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.573982 21967 catalog_manager.cc:5697] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.584038 22065 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.594022 23226 ts_tablet_manager.cc:1929] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:25.604873 23226 log.cc:1199] T 0a00dfd4bb864cbe94033b53b925fd76 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/0a00dfd4bb864cbe94033b53b925fd76
I20260709 12:26:25.608237 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 0a00dfd4bb864cbe94033b53b925fd76 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:25.616312 22220 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.622722 22142 consensus_queue.cc:237] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:25.634013 22217 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:25.637001 21968 catalog_manager.cc:5697] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.638463 23202 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:25.638907 22810 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:25.643885 23222 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:25.668457 22142 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:25.680428 22810 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:25.680653 22067 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:25.682361 23220 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:25.684921 23217 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:25.608357 23233 raft_consensus.cc:2243] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.688941 23233 raft_consensus.cc:2272] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.698864 23220 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.702659 22067 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.707490 23233 ts_tablet_manager.cc:1916] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:25.706835 22810 raft_consensus.cc:2955] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.707142 23201 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.711951 22809 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.719213 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e92d357da9e844b2ae270e73b28170db with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:25.725556 22217 raft_consensus.cc:2955] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.733659 21970 catalog_manager.cc:5697] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.749181 21971 catalog_manager.cc:5697] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:25.753159 23233 ts_tablet_manager.cc:1929] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:25.753756 23233 log.cc:1199] T 9f20d90a634149ef85ae0b05adb8a34a P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/9f20d90a634149ef85ae0b05adb8a34a
I20260709 12:26:25.758833 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 9f20d90a634149ef85ae0b05adb8a34a (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:25.759600 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26519f93f2144612acf259d481dc4485 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:25.761755 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet e92d357da9e844b2ae270e73b28170db with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:25.764048 23226 tablet_replica.cc:333] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:25.763947 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 26519f93f2144612acf259d481dc4485 with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:25.765460 23226 raft_consensus.cc:2243] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.766546 23226 raft_consensus.cc:2272] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.777338 23226 ts_tablet_manager.cc:1916] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:25.783459 23234 tablet_replica.cc:333] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:25.785115 23234 raft_consensus.cc:2243] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.785861 23234 raft_consensus.cc:2272] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.789342 23234 ts_tablet_manager.cc:1916] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:25.795969 23226 ts_tablet_manager.cc:1929] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:25.796339 23226 log.cc:1199] T e92d357da9e844b2ae270e73b28170db P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/e92d357da9e844b2ae270e73b28170db
I20260709 12:26:25.797724 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet e92d357da9e844b2ae270e73b28170db (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:25.801373 23234 ts_tablet_manager.cc:1929] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:25.801765 23234 log.cc:1199] T 26519f93f2144612acf259d481dc4485 P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/26519f93f2144612acf259d481dc4485
I20260709 12:26:25.803341 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 26519f93f2144612acf259d481dc4485 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:26.844760 22067 consensus_queue.cc:237] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:26.850255 22142 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.850802 22216 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:26.850957 22037 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7befabab572c4ed8832b542ff35c0ee1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.851781 23225 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.852880 23235 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.861959 23235 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:26.865044 22216 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:26.888054 22141 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:26.885353 21970 catalog_manager.cc:5697] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.901594 22216 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:26.935747 22186 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 953fcacc5a2943eeb23356e2f1c2cc5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.942799 22067 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.947867 22141 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.948977 23244 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.959861 23194 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.980286 23244 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:26.983016 22142 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:26.996229 22067 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.007449 22217 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:27.014369 21971 catalog_manager.cc:5697] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
W20260709 12:26:27.030676 22186 consensus_peers.cc:597] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2772ed1f79a846e3852654dad2c86235. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:27.032518 22142 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:27.034626 23194 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.036652 22067 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:27.038144 23194 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.048524 23108 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.054762 22141 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.059238 22067 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.072448 21968 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.084803 22065 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:27.093689 22037 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e537942a08e4c8fbf26a1a0084997c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:27.094722 22141 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:27.093719 22216 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:27.096189 23253 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.097419 23151 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.105010 23151 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.106946 22216 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.107250 22141 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.125195 21971 catalog_manager.cc:5697] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:27.323369 23257 ts_tablet_manager.cc:933] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:27.325429 23257 tablet_copy_client.cc:323] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:27.327236 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 7befabab572c4ed8832b542ff35c0ee1 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:27.327805 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 7befabab572c4ed8832b542ff35c0ee1 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-7befabab572c4ed8832b542ff35c0ee1
I20260709 12:26:27.337563 22083 tablet_copy_source_session.cc:215] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.341298 23257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befabab572c4ed8832b542ff35c0ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.357405 23257 tablet_copy_client.cc:806] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.358019 23257 tablet_copy_client.cc:670] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.362735 23257 tablet_copy_client.cc:538] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.370414 23257 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:27.387607 23257 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.388339 23257 tablet_bootstrap.cc:492] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:27.388880 23257 ts_tablet_manager.cc:1403] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 12:26:27.391306 23257 raft_consensus.cc:359] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:27.391897 23257 raft_consensus.cc:740] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:27.392529 23257 consensus_queue.cc:260] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:27.401072 23257 ts_tablet_manager.cc:1434] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:26:27.411092 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-7befabab572c4ed8832b542ff35c0ee1 received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:27.411715 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-7befabab572c4ed8832b542ff35c0ee1 on tablet 7befabab572c4ed8832b542ff35c0ee1 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:27.436268 23257 ts_tablet_manager.cc:933] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:27.437820 23257 tablet_copy_client.cc:323] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:27.439821 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 953fcacc5a2943eeb23356e2f1c2cc5f from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:27.440362 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 953fcacc5a2943eeb23356e2f1c2cc5f from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-953fcacc5a2943eeb23356e2f1c2cc5f
I20260709 12:26:27.454146 22232 tablet_copy_source_session.cc:215] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.488958 23257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953fcacc5a2943eeb23356e2f1c2cc5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.538955 23262 ts_tablet_manager.cc:933] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:27.541862 23257 tablet_copy_client.cc:806] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.543790 23257 tablet_copy_client.cc:670] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.548110 23257 tablet_copy_client.cc:538] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.551093 23262 tablet_copy_client.cc:323] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:27.552795 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 2772ed1f79a846e3852654dad2c86235 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:27.553330 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 2772ed1f79a846e3852654dad2c86235 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-2772ed1f79a846e3852654dad2c86235
I20260709 12:26:27.558449 23257 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:27.760802 22232 tablet_copy_source_session.cc:215] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.772571 23262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2772ed1f79a846e3852654dad2c86235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.828665 22808 raft_consensus.cc:1217] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:27.842569 23257 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.843596 23257 tablet_bootstrap.cc:492] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:27.844328 23257 ts_tablet_manager.cc:1403] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.286s	user 0.031s	sys 0.013s
I20260709 12:26:27.852021 23269 ts_tablet_manager.cc:933] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:27.914342 23269 tablet_copy_client.cc:323] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:27.932686 23262 tablet_copy_client.cc:806] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.933493 23262 tablet_copy_client.cc:670] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.937623 23262 tablet_copy_client.cc:538] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.954481 23262 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:27.959443 23257 raft_consensus.cc:359] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:27.960427 23257 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:27.961127 23257 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:27.985965 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 123207us
I20260709 12:26:27.991755 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 5e537942a08e4c8fbf26a1a0084997c4 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:27.992367 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 5e537942a08e4c8fbf26a1a0084997c4 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-5e537942a08e4c8fbf26a1a0084997c4
I20260709 12:26:27.999850 22083 tablet_copy_source_session.cc:215] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:28.015180 23257 ts_tablet_manager.cc:1434] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.171s	user 0.008s	sys 0.001s
I20260709 12:26:28.017405 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-953fcacc5a2943eeb23356e2f1c2cc5f received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:28.017875 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-953fcacc5a2943eeb23356e2f1c2cc5f on tablet 953fcacc5a2943eeb23356e2f1c2cc5f with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:28.030913 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e537942a08e4c8fbf26a1a0084997c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:28.088886 23262 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:28.089999 23262 tablet_bootstrap.cc:492] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:28.097366 23262 ts_tablet_manager.cc:1403] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.143s	user 0.027s	sys 0.018s
I20260709 12:26:28.096674 23269 tablet_copy_client.cc:806] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:28.100098 23269 tablet_copy_client.cc:670] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:28.104132 23269 tablet_copy_client.cc:538] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:28.104202 23262 raft_consensus.cc:359] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:28.105116 23262 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:28.105826 23262 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:28.108831 23262 ts_tablet_manager.cc:1434] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:28.110993 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-2772ed1f79a846e3852654dad2c86235 received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:28.111433 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-2772ed1f79a846e3852654dad2c86235 on tablet 2772ed1f79a846e3852654dad2c86235 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:28.121104 23269 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:28.148909 23269 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:28.149860 23269 tablet_bootstrap.cc:492] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:28.150569 23269 ts_tablet_manager.cc:1403] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.005s
I20260709 12:26:28.154572 23269 raft_consensus.cc:359] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:28.155689 23269 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:28.156630 23269 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:28.159796 23269 ts_tablet_manager.cc:1434] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:26:28.163991 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-5e537942a08e4c8fbf26a1a0084997c4 received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:28.164454 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-5e537942a08e4c8fbf26a1a0084997c4 on tablet 5e537942a08e4c8fbf26a1a0084997c4 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:28.299993 22810 raft_consensus.cc:1217] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:28.441807 23151 raft_consensus.cc:1064] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:28.443725 23151 consensus_queue.cc:237] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:28.451308 22810 raft_consensus.cc:1217] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:28.462915 22810 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.463868 22147 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.464398 23151 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.469242 22220 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.472997 23265 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.477244 23272 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.489326 22809 raft_consensus.cc:1217] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:28.508565 23151 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:28.510380 22147 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:28.512485 22220 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:28.540365 21968 catalog_manager.cc:5697] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:28.547760 22809 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:28.623106 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc240 after lost signal to thread 20920
W20260709 12:26:28.624212 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2700 after lost signal to thread 22005
W20260709 12:26:28.625546 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc0a0 after lost signal to thread 22097
W20260709 12:26:28.626791 22094 debug-util.cc:398] Leaking SignalData structure 0x7b0800262e60 after lost signal to thread 22172
I20260709 12:26:28.626682 22066 consensus_queue.cc:237] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:26:28.628017 22094 debug-util.cc:398] Leaking SignalData structure 0x7b080011a1a0 after lost signal to thread 22246
W20260709 12:26:28.629182 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5b00 after lost signal to thread 22834
I20260709 12:26:28.645828 22809 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:28.651525 23151 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:28.657569 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.678753 22220 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:28.683346 23265 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:28.691818 23235 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:28.698021 22809 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:28.703539 22216 raft_consensus.cc:2955] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:28.705313 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7befabab572c4ed8832b542ff35c0ee1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:28.717753 21971 catalog_manager.cc:5697] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.734707 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 7befabab572c4ed8832b542ff35c0ee1 with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:28.741901 23284 tablet_replica.cc:333] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:28.750377 23284 raft_consensus.cc:2243] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.751446 23284 raft_consensus.cc:2272] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:28.755503 23284 ts_tablet_manager.cc:1916] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:28.774272 23284 ts_tablet_manager.cc:1929] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:28.777331 23284 log.cc:1199] T 7befabab572c4ed8832b542ff35c0ee1 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/7befabab572c4ed8832b542ff35c0ee1
I20260709 12:26:28.779453 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 7befabab572c4ed8832b542ff35c0ee1 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:28.810873 22067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:28.811594 22067 raft_consensus.cc:606] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:28.845817 23194 raft_consensus.cc:1064] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:28.848490 23194 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:28.862951 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26519f93f2144612acf259d481dc4485"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:28.863601 22141 raft_consensus.cc:606] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:28.866961 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:28.867575 22141 raft_consensus.cc:606] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:28.873762 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:28.874344 22141 raft_consensus.cc:606] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:28.885401 22808 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.886180 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:28.886844 22141 raft_consensus.cc:606] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:28.888756 23283 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.889371 23178 raft_consensus.cc:993] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:28.889839 23178 raft_consensus.cc:1081] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:28.892450 22808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44162
I20260709 12:26:28.893059 22808 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.893411 22808 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.893736 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:28.895526 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:28.896569 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.909121 23265 raft_consensus.cc:1064] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:28.911836 23265 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:28.940575 22808 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:28.944423 22067 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.947593 23194 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.961753 22810 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.964601 23235 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:28.974916 22216 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.977843 23272 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.990815 22141 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.000344 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:29.001294 22067 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:29.015501 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 89735.1us
W20260709 12:26:29.018438 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 102665us
W20260709 12:26:29.021384 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 99273.5us
I20260709 12:26:29.035096 23283 raft_consensus.cc:1064] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:29.033437 23266 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.036260 22806 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.038137 23283 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.050380 22808 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:29.053930 23151 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.060896 21967 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.076792 22808 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.097175 23272 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.099911 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:29.100631 22141 raft_consensus.cc:3055] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.100966 22141 raft_consensus.cc:740] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:29.101804 22141 consensus_queue.cc:260] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.103578 22141 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.110903 22147 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.119496 22147 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.134866 22141 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:29.136217 22773 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:29.137184 23260 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.141628 23299 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.148784 22065 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.150764 22066 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.152266 23260 raft_consensus.cc:697] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:29.153311 23260 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.174728 23273 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.176482 22067 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
W20260709 12:26:29.184329 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 64460.4us
I20260709 12:26:29.185949 22214 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.193603 23301 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.195984 21971 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.198797 23236 raft_consensus.cc:993] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:29.199334 23236 raft_consensus.cc:1081] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:29.210036 23290 raft_consensus.cc:993] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:29.210544 23290 raft_consensus.cc:1081] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:29.187631 23194 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.213902 22806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26519f93f2144612acf259d481dc4485"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44162
I20260709 12:26:29.214862 22806 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.215348 22806 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.214206 22810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44162
I20260709 12:26:29.215951 22810 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.216291 22810 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.228794 23290 raft_consensus.cc:993] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:29.229403 23290 raft_consensus.cc:1081] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:29.232884 22809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44162
I20260709 12:26:29.233853 22809 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.234293 22809 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.236311 22806 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.238019 22810 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.247879 23235 raft_consensus.cc:993] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:29.248826 23235 raft_consensus.cc:1081] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:29.251477 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:29.239126 22806 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:29.239811 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:29.254388 22147 raft_consensus.cc:3055] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.255048 22147 raft_consensus.cc:740] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:29.257236 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:29.255913 22147 consensus_queue.cc:260] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.257997 22145 raft_consensus.cc:3055] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.258395 22145 raft_consensus.cc:740] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:29.257985 22810 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:29.259344 22145 consensus_queue.cc:260] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.260648 22145 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.263196 22147 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.242863 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:29.272006 22214 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.274428 22808 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.252099 22067 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.275424 22809 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.280175 23299 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.287598 22805 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.308415 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:29.309051 22066 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.315398 22147 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:29.316613 22773 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:29.317487 23260 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.317958 23260 raft_consensus.cc:697] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:29.319057 22214 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:29.318843 23260 consensus_queue.cc:237] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.321072 22145 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:29.324790 22773 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:29.326188 23300 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.332772 22066 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:29.334425 22776 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:29.335232 22141 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.338974 22067 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:29.327035 21967 catalog_manager.cc:5697] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.359265 22066 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.362233 22145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:29.363130 22809 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:29.364180 22142 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.372637 23311 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.373265 23311 raft_consensus.cc:697] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:29.374122 23311 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.362867 22145 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.382032 22145 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.393268 23300 raft_consensus.cc:697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:29.415584 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:29.416337 22142 raft_consensus.cc:3055] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.416131 22145 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:29.416757 22142 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:29.417739 22142 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.419109 22142 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.427831 22142 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:29.449806 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:29.450486 22214 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.449620 22145 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:29.456847 23293 log.cc:927] Time spent T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:26:29.482122 22214 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
W20260709 12:26:29.484076 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 149879us
I20260709 12:26:29.495682 23300 consensus_queue.cc:237] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:26:29.502974 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 80191.7us
I20260709 12:26:29.528149 22113 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:29.550094 23236 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.552304 23236 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:29.560928 23236 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:29.590737 21971 catalog_manager.cc:5697] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:29.596984 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 64137.2us
W20260709 12:26:29.610846 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 160892us
I20260709 12:26:29.616719 22141 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.637064 22139 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:29.660120 21970 catalog_manager.cc:5697] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.707240 22066 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:29.711480 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 77641.9us
I20260709 12:26:29.716212 22216 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.739204 22805 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:29.740964 22144 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:29.749346 23300 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:29.743450 22220 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:26:29.767537 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 55391.3us
I20260709 12:26:29.781010 23325 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:29.787290 22067 raft_consensus.cc:1240] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.788674 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:29.789412 22069 raft_consensus.cc:3055] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.789745 22069 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:29.804539 22071 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:29.806056 23194 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:29.810329 21971 catalog_manager.cc:5697] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.812232 21971 catalog_manager.cc:5697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.790498 22069 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:29.813702 22069 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:29.825174 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 112162us
I20260709 12:26:29.829795 22809 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:29.832312 23283 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:29.837361 22139 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:29.839052 22147 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.839010 23314 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:26:29.818960 23331 consensus_queue.cc:1175] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:26:29.915835 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56221.3us
I20260709 12:26:29.948298 22213 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:29.950618 22147 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:29.917048 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.919552 22069 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:29.849336 23317 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:26:29.930362 23303 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.936667 22220 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:29.938519 22805 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.962679 23314 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:29.966140 22808 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:29.968236 22069 raft_consensus.cc:2955] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.970309 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 953fcacc5a2943eeb23356e2f1c2cc5f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:29.975438 22140 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:29.982921 23194 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:29.982475 21970 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.988600 23314 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:29.991823 22066 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:29.995296 22071 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:29.996996 23300 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:29.987776 23325 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:29.998354 23300 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:30.002629 22809 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:30.009270 23303 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:30.025575 22141 raft_consensus.cc:2955] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:30.042969 21971 catalog_manager.cc:5697] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.076646 22147 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:30.081189 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.090401 22065 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.112605 22213 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.106550 22808 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:30.102082 23300 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:26:30.114949 23290 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:26:30.155274 21968 catalog_manager.cc:5697] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:30.226739 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e537942a08e4c8fbf26a1a0084997c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:30.170956 23292 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:26:30.253310 22140 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:30.266558 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 953fcacc5a2943eeb23356e2f1c2cc5f with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:30.173660 23194 raft_consensus.cc:2955] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:30.285802 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 158978us
I20260709 12:26:30.427742 22065 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:30.321090 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 185293us
W20260709 12:26:30.438759 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 54665.6us
W20260709 12:26:30.431437 23309 log.cc:927] Time spent T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:26:30.482754 23342 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:26:30.584358 23348 tablet_replica.cc:333] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
W20260709 12:26:30.608414 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 176220us
I20260709 12:26:30.624297 21967 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:30.650581 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 220458us
I20260709 12:26:30.653367 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2772ed1f79a846e3852654dad2c86235 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:30.691725 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 2772ed1f79a846e3852654dad2c86235 with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:30.692961 22067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:30.693648 22067 raft_consensus.cc:606] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:30.695508 23302 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:30.696127 23302 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:30.710260 22140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:30.711077 22140 raft_consensus.cc:606] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:30.714886 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:30.715217 23302 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:30.720079 23362 tablet_replica.cc:333] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:30.721381 23362 raft_consensus.cc:2243] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.728731 22069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:30.729526 22069 raft_consensus.cc:606] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:30.734329 22069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:30.735054 22069 raft_consensus.cc:606] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:30.737917 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e537942a08e4c8fbf26a1a0084997c4 with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:30.741063 23364 tablet_replica.cc:333] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:30.742256 23364 raft_consensus.cc:2243] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.742152 22069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:30.743155 22069 raft_consensus.cc:606] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:30.743347 23364 raft_consensus.cc:2272] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.749467 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:30.751587 23364 ts_tablet_manager.cc:1916] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.757122 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:30.766498 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:30.767563 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.786244 23362 raft_consensus.cc:2272] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.794953 22185 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:26:30.795763 22185 raft_consensus.cc:2686] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:30.797799 23362 ts_tablet_manager.cc:1916] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.802866 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:30.820634 23348 raft_consensus.cc:2243] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.826041 23348 raft_consensus.cc:2272] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.826843 23351 raft_consensus.cc:993] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:30.823076 23330 raft_consensus.cc:993] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:30.827338 23351 raft_consensus.cc:1081] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:30.827749 23330 raft_consensus.cc:1081] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:30.835354 23328 raft_consensus.cc:993] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:30.835913 23328 raft_consensus.cc:1081] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:30.836299 23348 ts_tablet_manager.cc:1916] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.847028 22145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:30.847630 22145 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.847959 22145 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.848137 23290 raft_consensus.cc:993] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:30.848606 23290 raft_consensus.cc:1081] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:30.850271 22805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44162
I20260709 12:26:30.850852 22805 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.851197 22805 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.854861 22145 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:30.861783 22145 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:30.863657 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:30.864369 22071 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.864790 22071 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:30.865837 22071 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:30.868489 22071 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.871402 23362 ts_tablet_manager.cc:1929] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:30.864239 23364 ts_tablet_manager.cc:1929] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:30.884922 23364 log.cc:1199] T 5e537942a08e4c8fbf26a1a0084997c4 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/5e537942a08e4c8fbf26a1a0084997c4
I20260709 12:26:30.877296 22805 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:30.878764 23348 ts_tablet_manager.cc:1929] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:30.888393 23348 log.cc:1199] T 953fcacc5a2943eeb23356e2f1c2cc5f P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/953fcacc5a2943eeb23356e2f1c2cc5f
I20260709 12:26:30.888628 22071 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:30.888872 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:30.889480 22145 raft_consensus.cc:3055] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.889797 22145 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:30.890340 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 953fcacc5a2943eeb23356e2f1c2cc5f (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:30.889926 22114 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:30.890381 23362 log.cc:1199] T 2772ed1f79a846e3852654dad2c86235 P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/2772ed1f79a846e3852654dad2c86235
I20260709 12:26:30.891876 23297 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.892438 23297 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:30.893333 23297 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:30.895237 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 2772ed1f79a846e3852654dad2c86235 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:30.895805 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:30.895247 22805 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:30.896400 22214 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.902480 22145 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:30.903668 22145 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.910048 21970 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.911546 22214 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:30.912982 22775 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:30.913975 23319 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.914497 23319 raft_consensus.cc:697] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:30.915506 23319 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:30.918009 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:30.918637 22216 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.921762 22217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58424
I20260709 12:26:30.922310 22217 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.922704 22217 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.922907 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58424
I20260709 12:26:30.923398 22214 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.923739 22214 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.926343 22216 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:30.933393 22217 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:30.937851 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 5e537942a08e4c8fbf26a1a0084997c4 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:30.943811 21970 catalog_manager.cc:5697] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.948556 22217 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:30.948350 22214 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:30.949481 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:30.950052 22147 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.952517 22145 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:30.964617 22147 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:30.967675 22185 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:30.971524 22214 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:30.966670 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:30.975633 22071 raft_consensus.cc:3055] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.975976 22071 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:30.977720 23354 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.978206 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:30.987466 22147 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.976785 22071 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:30.980813 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:30.981452 23354 raft_consensus.cc:697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:30.996615 23354 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:30.998966 22147 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:30.999941 22185 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:30.995301 22069 raft_consensus.cc:3055] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:31.002440 22071 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.002758 23299 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:31.007606 23299 raft_consensus.cc:697] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:31.008482 23299 consensus_queue.cc:237] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:31.001878 22069 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:31.011905 22069 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:31.013310 22069 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.020231 22071 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:31.026621 22069 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:31.026899 21970 catalog_manager.cc:5697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.051932 21970 catalog_manager.cc:5697] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.163515 23350 raft_consensus.cc:993] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:31.164036 23317 raft_consensus.cc:1081] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:31.166735 22139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:31.167335 22139 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.167714 22139 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.181668 22139 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:31.188234 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:31.188846 22069 raft_consensus.cc:3055] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:31.189193 22069 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:31.189905 22069 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:31.190972 22069 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.192585 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:31.194821 22213 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.215444 22213 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:31.216576 22113 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:31.217510 23290 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:31.217619 22069 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:31.218921 22139 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:31.218935 23290 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:31.220430 23290 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:31.236837 21970 catalog_manager.cc:5697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.331907 22213 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:31.333668 23346 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:31.351291 22147 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:31.353714 23319 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:26:31.461273 22213 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.461294 22071 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.463758 23343 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.465425 23273 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.500427 22069 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.502297 23353 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:31.532759 22147 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.534372 23273 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.596058 22139 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.597378 23273 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:32.417925 22071 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:32.431401 23388 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:32.576498 23395 log.cc:927] Time spent T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:26:32.654583 23393 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:32.655231 23393 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.665313 23383 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:32.678416 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:32.670399 23393 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.731536 23422 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:32.734380 23422 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:32.736120 23416 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:32.736652 23416 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.688655 23396 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:32.688830 23418 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:32.740648 23396 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.746969 23418 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:32.749069 23396 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.732286 23400 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:32.750136 23400 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:32.751122 23416 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:32.752568 23400 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:32.738392 23411 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:32.736568 23422 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.753721 23411 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.755206 23404 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:32.755829 23404 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.690192 23398 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:32.756762 23398 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.759270 23398 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.749560 23418 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.756124 23411 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.684201 23383 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:32.762614 23422 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:32.762981 23404 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:32.762665 23383 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:32.763149 23422 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:32.765913 23422 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:32.766376 23422 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:32.772868 23422 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:32.777362 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 910) took 1177 ms. Trace:
I20260709 12:26:32.777894 22139 rpcz_store.cc:276] 0709 12:26:31.599548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.599666 (+   118us) service_pool.cc:224] Handling call
0709 12:26:31.599979 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.600331 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.600366 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.600764 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.601757 (+   993us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:31.601791 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.601878 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.777102 (+1175224us) raft_consensus.cc:1685] finished
0709 12:26:32.777126 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.777282 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":676,"threads_started":1,"wal-append.queue_time_us":2774,"wal-append.run_cpu_time_us":1849,"wal-append.run_wall_time_us":1012684}
I20260709 12:26:32.828197 23419 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:32.877403 23419 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.879760 23419 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:32.880317 23419 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:32.880808 23419 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.803186 23422 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:32.884460 23419 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:32.903702 23400 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:32.904363 23400 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:32.906409 23400 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:32.907312 23400 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:32.907840 23400 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.910136 23401 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:32.910841 23401 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.913057 23401 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.927403 23406 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.009442 23406 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:32.927979 23399 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.010860 23399 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.012326 23388 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.013033 23399 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.012949 23388 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.013597 23399 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.015645 23388 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.018431 23406 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.018839 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.019134 23406 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.019737 23406 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.020606 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:33.022071 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 283916us
I20260709 12:26:33.022879 23406 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:32.929008 23429 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.023664 23429 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.023651 23410 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.024712 23419 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.025276 23419 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.026587 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.026762 23404 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.027243 22066 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:33.027330 23404 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.028961 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.027174 23410 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.029955 23429 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:32.929905 23427 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:32.930523 23411 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.030920 23411 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.032745 23404 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.033304 23411 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.034070 23427 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.036608 23427 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:32.977244 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:32.997009 23400 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.997965 23409 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.038653 23409 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.041180 23409 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.998427 23421 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.042034 23421 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.026662 23388 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.043841 23388 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.044471 23421 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:32.999236 23384 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.045529 23384 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.046005 23388 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.047854 23384 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.014111 23399 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.050336 23399 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:32.906710 23416 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:32.928843 23405 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.027483 23419 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.054790 23398 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.067919 23400 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.068080 23398 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.068629 22066 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:33.058481 23404 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.057987 23416 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.069386 23404 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.065042 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.070322 23398 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.058367 23411 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.065960 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.070557 22142 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:33.065930 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.071242 23416 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.070997 23411 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.067067 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.072827 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.068465 23400 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.073055 23404 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.059128 23405 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.077440 23424 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.067010 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.059486 23410 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.090268 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.084740 23421 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.093375 23422 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.093168 23421 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.093911 23422 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.095359 23421 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.095911 23422 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.096407 23422 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.096876 23422 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.046527 23388 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:32.607190 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.099004 23423 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.098860 23388 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.085799 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.077968 23424 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.098292 23431 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.103199 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.109862 22217 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:33.099509 23423 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.106484 23393 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.116672 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.113871 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.114194 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.073060 23411 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.121526 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.122618 23423 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.123200 23414 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:33.098734 23418 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.123749 23414 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.128520 22215 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:33.137918 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.138741 22144 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:26:33.124459 23393 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.141157 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.141784 23393 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.128654 23418 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.142869 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.143890 23405 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.144377 23418 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.119050 22071 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:33.131661 23410 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.151052 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.146411 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.146658 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.141189 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.146998 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.118013 23404 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.152300 22073 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:33.122618 23424 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.155723 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.155933 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.129396 23398 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:33.159821 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.160660 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.156778 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.127192 23422 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.145525 23400 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.164616 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.164948 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.165841 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.132758 23423 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.129303 23402 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:33.131105 23434 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.148097 23416 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.152921 23429 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.146200 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.116698 23431 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.167481 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.176826 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.129179 23428 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:33.177433 22147 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:26:33.166846 23398 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.169694 23429 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.188858 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.175093 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.166877 23433 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.185644 23414 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.168605 23416 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.169251 23423 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.199826 22773 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:33.200583 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.200984 23423 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.201113 23398 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.201380 22773 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:33.181072 23405 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.169169 23388 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.202085 23405 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.177688 23404 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.204334 23429 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.169338 23402 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.181967 23424 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.154664 23410 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.189661 23400 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.190559 22036 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:33.205181 23414 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.204797 23433 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.237509 23433 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.187258 23428 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.240053 23428 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.202529 23423 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.252552 23431 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.253504 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.253343 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.204383 23404 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.243090 23425 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.168311 23434 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.243264 23400 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.259959 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.260411 23430 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:26:33.265473 22072 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:33.210937 23422 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.266353 23400 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.244742 23414 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.204368 23405 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.264573 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.266567 23422 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.268420 23422 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.247411 23418 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.270947 23418 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.271718 23416 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.211432 23424 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.273619 23418 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.274403 23434 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.275463 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.276782 23424 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.249815 23423 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.278221 23402 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.273409 23425 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.286911 23425 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.278260 23423 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.288435 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.289769 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.295943 23423 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.280426 23414 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.282212 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.282998 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.268392 23410 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.284293 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.371448 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.371641 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.372804 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.372655 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.373878 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.370231 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.374931 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.375650 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.375972 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.374210 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.377002 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.377581 22222 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:26:33.285100 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.378512 22805 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.377482 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.285966 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.297974 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.300736 23425 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.307492 23426 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.380570 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.380839 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.310810 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:33.320482 22776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.005s	sys 0.004s
I20260709 12:26:33.320436 22038 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.381814 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:26:33.382452 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 62112.3us
I20260709 12:26:33.381788 23425 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.383391 23425 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.379525 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.384845 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.385627 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.290400 22221 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:33.386967 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.387384 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.388226 22142 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.389073 22114 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:33.325289 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.327306 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.329280 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.412988 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.414222 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.336748 23437 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.329280 22113 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.414883 23437 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:26:33.415345 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 86173.9us
I20260709 12:26:33.416433 22113 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.417474 23437 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.417884 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.342533 22188 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:26:33.418782 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 76329.5us
I20260709 12:26:33.419421 23419 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.419888 23419 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.420267 23419 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.420437 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.421924 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.423302 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.424434 23420 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.424944 23420 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.425362 23420 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.425806 23405 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.424789 23414 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.427901 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.429507 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.430997 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.347190 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.368211 23438 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.380396 23426 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.319180 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.386227 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.323892 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.393662 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.392644 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.433791 23426 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.434198 22803 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:26:33.399015 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.434486 23438 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.435431 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.436030 22188 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:33.436480 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.436837 23402 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:33.378684 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.383019 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.400110 22038 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.437587 23414 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.438127 23414 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:33.400240 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:33.393191 22776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.005s	sys 0.005s
I20260709 12:26:33.438508 23414 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:33.438925 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 750869us
I20260709 12:26:33.437574 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.400585 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.441431 23425 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.443637 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.444746 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.445017 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.445456 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.446135 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.446934 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.430876 23419 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.446125 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.398439 22142 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:33.400974 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.402946 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.379921 22220 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:26:33.448707 22036 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:33.403947 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.449709 23425 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:33.449785 23415 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.446961 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.450274 23425 raft_consensus.cc:697] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:26:33.451475 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 62488.8us
I20260709 12:26:33.451210 23425 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.455075 22037 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.455339 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.405181 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.456372 22037 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.405723 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:33.438453 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 51851.8us
I20260709 12:26:33.457578 23389 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.458098 22038 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.458454 22185 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.459355 22038 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.459656 23401 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.458252 23389 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.459903 23415 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.460392 23415 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.406893 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.279443 23422 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.433543 22219 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:33.464237 22810 raft_consensus.cc:1240] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.391695 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.447300 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.448113 22141 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.465934 23404 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.467988 23422 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.395825 23423 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.464548 23401 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.468307 23419 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.469769 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:33.436888 23438 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.471436 23389 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:33.471760 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.472055 23389 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.472482 23389 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.463517 22188 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.473392 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.474040 22188 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:33.476326 23414 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.468959 22185 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.480014 23389 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.483258 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.483160 23431 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.484532 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.485389 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.486167 22804 raft_consensus.cc:2393] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 2: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:26:33.486222 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.484913 23431 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.488055 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.489068 23431 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.489276 23389 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.490108 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.491621 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.492303 22808 raft_consensus.cc:2393] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 2: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:26:33.494185 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.494534 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.495652 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.496841 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.498386 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.498493 23426 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.499295 23426 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.499670 23426 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.500036 23426 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.502070 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:33.502383 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.503698 22112 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.498682 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:33.505180 22112 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.505462 23394 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.506174 23393 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.508893 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.509039 22071 consensus_queue.cc:237] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:33.510735 22776 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.510859 23419 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.511721 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.510736 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:33.512867 22185 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:26:33.512799 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 104662us
I20260709 12:26:33.517804 22775 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:33.517954 21970 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.520437 23422 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.522621 22776 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.525449 23388 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.525770 22073 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.529012 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.531095 23402 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.531426 23422 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.532475 22112 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.533285 22776 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.527395 22185 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.478525 23414 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.535871 23388 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.536173 23422 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.478121 23420 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.537081 23422 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.537529 23422 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:33.537925 23422 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.538522 23420 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.541421 22185 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.542492 23388 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.532788 22113 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.545888 22775 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.548938 23402 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.551223 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:33.551671 23423 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.553435 22775 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.555989 23423 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.557646 22776 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.558388 23423 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.559749 22776 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.560923 22775 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:26:33.561590 22037 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b155a7c146564fdbb5330057eca55fd8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.562517 23423 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.565573 23422 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.565913 22141 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:33.577255 22805 raft_consensus.cc:1240] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.579107 23397 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:33.579674 23425 consensus_queue.cc:1059] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.580842 23425 raft_consensus.cc:3055] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.581188 23425 raft_consensus.cc:740] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:33.582185 23425 consensus_queue.cc:260] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.586874 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:33.567514 23388 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.589669 23425 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.590019 23419 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.590565 23419 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:33.591609 23419 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.593156 23419 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.593679 23422 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.572541 23438 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.573415 22186 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.573905 23423 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.600580 23423 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.574820 22140 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.601367 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.602388 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.602872 23404 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.603570 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.604940 22186 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.606509 23410 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.602945 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.608011 23423 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.608920 23425 consensus_queue.cc:1059] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.565716 22776 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.610357 22186 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:33.616322 22186 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.617316 23422 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:33.618947 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 53336.1us
I20260709 12:26:33.620729 23410 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:33.621299 23410 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.621703 23410 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.623703 23404 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.631560 23415 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.632565 22775 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.633495 23388 consensus_queue.cc:1059] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:33.633972 23415 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.634831 22113 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.637463 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:33.637493 22219 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:33.637797 23437 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.640703 23438 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.640628 22776 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.644688 23397 raft_consensus.cc:3055] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.645198 23397 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:33.646413 22113 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.646272 23397 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.647262 23438 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.647706 23397 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:33.649957 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 108635us
I20260709 12:26:33.650772 22185 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.651304 22775 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.569655 23426 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.653179 23422 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.654174 23426 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:33.654769 23437 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.660200 22113 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.661448 22113 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.661904 23438 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.662648 23438 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.663259 22113 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.663968 23438 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.663008 23389 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:33.664412 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.665156 23438 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.665648 22113 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.666404 23438 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.667891 23388 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.671204 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:33.675815 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.679594 22185 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.680585 23404 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.685262 23423 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.686728 23415 raft_consensus.cc:3055] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.687168 23438 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.677111 22188 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.688836 23426 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.689617 22188 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.687188 23415 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:33.690407 23426 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.690836 22188 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.691555 22776 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.691275 23415 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.692025 23426 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.692775 23415 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.693290 22185 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.693442 22775 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:33.705893 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:33.694448 23422 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.707576 23422 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:33.708192 23422 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:33.709228 23422 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.712536 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.718658 22071 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:33.719998 22776 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.721160 23434 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:33.694453 22141 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:33.698490 23404 consensus_queue.cc:1059] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.721643 23434 raft_consensus.cc:697] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:33.723832 23434 consensus_queue.cc:237] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.702296 23410 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.733454 23410 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:33.735078 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:33.736400 22066 consensus_queue.cc:237] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:33.750918 23404 consensus_queue.cc:1243] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer d465f3cb42174eb89615dcd747f9e682 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:26:33.751673 23426 raft_consensus.cc:3055] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.752056 23426 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:33.752939 23426 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.745827 21967 catalog_manager.cc:5697] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.761478 21970 catalog_manager.cc:5697] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:33.762620 23410 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:33.763625 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 70448.8us
W20260709 12:26:33.764170 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 72209.7us
I20260709 12:26:33.705042 23423 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:33.764518 22185 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.766232 23426 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:33.779675 22243 debug-util.cc:398] Leaking SignalData structure 0x7b080031e560 after lost signal to thread 20920
I20260709 12:26:33.770533 22805 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:33.772050 22037 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b8326670393490f9fabe3827cd6d958. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.783059 23420 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.784174 23420 raft_consensus.cc:3055] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.764051 21970 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:33.784538 23420 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:33.785454 23420 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.785820 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:26:33.781076 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800334120 after lost signal to thread 22005
I20260709 12:26:33.786895 23420 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:33.787518 22243 debug-util.cc:398] Leaking SignalData structure 0x7b080030ed60 after lost signal to thread 22097
W20260709 12:26:33.788671 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2200 after lost signal to thread 22172
W20260709 12:26:33.789736 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800361280 after lost signal to thread 22246
I20260709 12:26:33.773089 22141 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:33.794988 23425 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.800823 23410 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:33.801502 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800361b60 after lost signal to thread 22834
I20260709 12:26:33.803319 22185 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.804261 23410 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.805488 22185 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.806185 23410 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.808811 22038 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.810343 23425 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.812474 22140 raft_consensus.cc:1240] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.814510 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.815995 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:26:33.817097 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.817752 23403 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:33.818151 23403 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:33.818506 23403 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.818730 22113 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.820096 22113 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.820693 23420 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.825127 23420 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.829540 22113 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.831892 23389 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:33.833957 23420 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.834275 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.834729 23414 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.836382 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.837329 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:33.837980 22113 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.838356 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.838747 23414 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.845682 22139 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:33.849493 22141 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:33.852669 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.858932 22220 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:33.857385 22218 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:33.866580 22218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:33.867240 22218 raft_consensus.cc:606] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:33.868856 22113 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.867882 23426 consensus_queue.cc:1059] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:33.870072 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.871030 23397 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.866984 22185 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.872558 23410 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.873023 23404 raft_consensus.cc:3055] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.873430 23404 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:33.874269 23404 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.876226 23404 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.867403 23403 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.884925 23403 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:33.885934 22019 auto_rebalancer.cc:629] Failed to schedule move for tablet 68d18246b3984c719bedcfe7da84c5c5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:33.888355 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.891144 22219 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.894897 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.895234 23420 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.897286 22220 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.898860 22219 raft_consensus.cc:1240] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.890106 21970 catalog_manager.cc:5697] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.900949 22072 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:33.874805 22185 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.907387 23426 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.908643 22185 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:33.909307 23426 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.913136 22185 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:33.915803 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:33.916590 22146 raft_consensus.cc:2393] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 2: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:33.913269 22066 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.918027 23411 consensus_queue.cc:1059] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:33.918985 23411 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.919296 23411 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:33.920164 23411 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:33.920637 23426 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:33.921450 23426 raft_consensus.cc:697] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:33.922430 23411 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.922286 23426 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:33.929068 23425 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.929746 23386 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.931488 22148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:33.931720 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:33.932016 22148 raft_consensus.cc:606] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:33.935570 22066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "838948750f334b409ad4d7798a822e6d"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:33.936386 22066 raft_consensus.cc:606] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:33.939095 22066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:33.939596 22066 raft_consensus.cc:606] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:33.943830 22146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:33.944530 22146 raft_consensus.cc:606] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.943759 22222 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:33.945827 22139 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:33.949541 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.950322 23403 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:33.951568 22037 consensus_peers.cc:597] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2601e033c5b34310a9d1582b3d94c3aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.952826 23403 raft_consensus.cc:993] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:33.953766 23425 raft_consensus.cc:1081] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:33.953902 22071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:33.954566 22071 raft_consensus.cc:606] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:33.954375 23413 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.957412 22217 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:33.958926 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:33.960819 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:33.961639 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.962478 22805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "838948750f334b409ad4d7798a822e6d"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44146
W20260709 12:26:33.968291 20922 debug-util.cc:398] Leaking SignalData structure 0x7b080000f080 after lost signal to thread 22776
I20260709 12:26:33.963054 22805 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.972216 22113 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:33.974447 22222 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:33.976446 22805 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.977145 23412 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.971010 23403 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:26:33.972894 23414 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:26:33.993386 21970 catalog_manager.cc:5697] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.982403 23405 consensus_queue.cc:1059] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:26:33.981885 23402 consensus_queue.cc:1059] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:26:33.983496 23389 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:26:34.009289 23410 raft_consensus.cc:993] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:34.009765 23410 raft_consensus.cc:1081] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:34.012742 22146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51452
I20260709 12:26:34.013231 22146 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.013537 22146 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.018185 23424 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.018571 23424 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:34.019472 23424 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.022547 23424 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.041062 22146 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.043155 22146 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:34.043228 23402 raft_consensus.cc:3055] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.054490 23402 raft_consensus.cc:740] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:34.055734 23402 consensus_queue.cc:260] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.043797 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:34.048702 23414 raft_consensus.cc:3055] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.075871 22071 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.089859 22148 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.075057 23402 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.096733 23465 ts_tablet_manager.cc:933] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:34.048877 23403 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:34.097440 23425 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:26:34.111088 22139 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:34.087442 23414 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:26:34.122864 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 141631us
I20260709 12:26:34.135878 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:34.136404 22217 raft_consensus.cc:3055] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:34.136648 22071 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:34.136665 22217 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:34.138239 22114 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:34.138142 22217 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.140259 23405 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:34.157618 23405 raft_consensus.cc:697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:34.158504 23405 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.141084 22773 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:34.142408 22221 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.162326 23422 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.138523 23394 raft_consensus.cc:993] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:34.139746 22072 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:34.144912 23414 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.167285 23414 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.167307 23424 consensus_queue.cc:1059] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:34.147599 22805 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:34.169260 23466 raft_consensus.cc:1081] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:34.179100 23394 raft_consensus.cc:3055] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:34.179580 23394 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:34.180394 23394 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.181659 23394 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.182986 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:34.183660 22216 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.186832 22805 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:34.189005 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:34.189755 22072 raft_consensus.cc:3055] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.190135 22072 raft_consensus.cc:740] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:34.191058 22072 consensus_queue.cc:260] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:34.192435 22072 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.192848 22217 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.148413 23465 tablet_copy_client.cc:323] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:34.199043 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet b155a7c146564fdbb5330057eca55fd8 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:34.199599 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet b155a7c146564fdbb5330057eca55fd8 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-b155a7c146564fdbb5330057eca55fd8
I20260709 12:26:34.202512 22217 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:34.210419 22083 tablet_copy_source_session.cc:215] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:34.211719 22221 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.213836 23423 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:34.217000 23465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b155a7c146564fdbb5330057eca55fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.139951 22219 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
W20260709 12:26:34.160633 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 70899us
I20260709 12:26:34.227234 22216 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:34.237529 22775 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:34.241698 22072 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:34.246295 22148 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.248174 22218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:34.248903 22218 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.249274 22218 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.240095 23423 raft_consensus.cc:2804] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.250520 21970 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.258881 23423 raft_consensus.cc:697] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:34.259945 23423 consensus_queue.cc:237] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:34.261847 22218 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.267772 22218 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:34.272578 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:34.273214 22066 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.249208 23473 ts_tablet_manager.cc:933] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:34.274720 22218 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:34.294832 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:34.296062 22139 raft_consensus.cc:3055] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.296392 22139 raft_consensus.cc:740] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:34.310279 22066 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:34.312901 22071 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.314657 22188 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:34.339720 23473 tablet_copy_client.cc:323] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:34.325417 23383 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.347586 21970 catalog_manager.cc:5697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 3, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.323390 23434 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:26:34.323307 22139 consensus_queue.cc:260] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.359560 22139 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.376864 22148 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:34.386386 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 53354us
I20260709 12:26:34.391772 23422 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:34.391856 23384 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:34.351577 23383 raft_consensus.cc:697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:34.400688 23383 consensus_queue.cc:237] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.404456 22139 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:34.416236 22805 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.418015 23384 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:34.419508 23403 raft_consensus.cc:993] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:34.420017 23403 raft_consensus.cc:1081] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:34.421685 22146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:34.422260 22146 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.422662 22146 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.439278 22146 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.445214 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:34.445421 22146 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:34.445887 22071 raft_consensus.cc:3055] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.446280 22071 raft_consensus.cc:740] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:34.446944 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:34.447566 22220 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.449425 22071 consensus_queue.cc:260] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.450388 22071 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.463119 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 6b8326670393490f9fabe3827cd6d958 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:34.463876 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 6b8326670393490f9fabe3827cd6d958 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-6b8326670393490f9fabe3827cd6d958
I20260709 12:26:34.468783 22071 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:34.472506 22114 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:34.488462 22220 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:34.492349 23414 raft_consensus.cc:2804] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.492956 23414 raft_consensus.cc:697] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:34.497891 22083 tablet_copy_source_session.cc:215] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:34.493880 23414 consensus_queue.cc:237] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:34.502199 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 49450.3us
I20260709 12:26:34.493800 22219 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.511842 23422 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:34.552879 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 73374.8us
I20260709 12:26:34.591912 23492 ts_tablet_manager.cc:933] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:34.588506 23465 tablet_copy_client.cc:806] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:34.599690 23465 tablet_copy_client.cc:670] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:34.627920 23412 raft_consensus.cc:993] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:34.628515 23412 raft_consensus.cc:1081] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:34.634160 22805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44162
I20260709 12:26:34.634848 22805 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.636760 22805 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.657979 23492 tablet_copy_client.cc:323] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:34.676383 23401 raft_consensus.cc:993] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:34.677098 23401 raft_consensus.cc:1081] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
W20260709 12:26:34.725835 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 136678us
I20260709 12:26:34.732548 21968 catalog_manager.cc:5697] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:34.790136 22809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44146
I20260709 12:26:34.791304 22809 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.791909 22809 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:34.807919 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 72006us
I20260709 12:26:34.849460 22809 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:34.902915 23480 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:34.903741 23480 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:34.902998 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 2601e033c5b34310a9d1582b3d94c3aa from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:34.907364 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 2601e033c5b34310a9d1582b3d94c3aa from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-2601e033c5b34310a9d1582b3d94c3aa
I20260709 12:26:34.901706 22809 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:34.923159 22066 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.928208 21970 catalog_manager.cc:5697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:34.931221 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:34.932137 22071 raft_consensus.cc:3055] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.932475 22071 raft_consensus.cc:740] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:34.933497 22071 consensus_queue.cc:260] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:34.906432 23480 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:34.935140 22071 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.915508 22805 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:34.939165 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:34.939348 22810 raft_consensus.cc:1240] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:34.940163 22140 raft_consensus.cc:2393] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:34.946547 23473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8326670393490f9fabe3827cd6d958. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:34.946743 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 363591us
W20260709 12:26:34.962435 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 399882us
I20260709 12:26:34.967846 23465 tablet_copy_client.cc:538] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:34.967563 23478 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:34.975651 22071 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:34.978361 23393 consensus_queue.cc:1059] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:34.980023 23393 raft_consensus.cc:3055] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.980506 23393 raft_consensus.cc:740] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:34.980168 22805 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:34.981640 23393 consensus_queue.cc:260] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:34.988978 22141 raft_consensus.cc:1275] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.991879 23465 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:34.992426 22219 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.994973 23383 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.995810 23383 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:34.998520 23383 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:35.004594 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:35.004492 23404 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:35.005355 22219 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.983109 23393 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.013413 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:35.017905 23506 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:26:35.019898 22809 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:35.011158 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:35.022373 22141 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:35.025255 22185 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:35.028020 23500 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.028522 23500 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.028901 23500 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.035989 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:35.037283 22066 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:35.040527 22219 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:35.053910 22069 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:35.070354 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:35.072453 22776 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:35.076548 23505 raft_consensus.cc:2804] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:35.077126 23505 raft_consensus.cc:697] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:26:35.096143 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 69218.5us
I20260709 12:26:35.099027 23505 consensus_queue.cc:237] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:35.100044 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:35.100478 23503 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.105520 22068 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.107223 23503 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.126863 23424 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:35.125053 22219 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:35.140817 22143 raft_consensus.cc:2468] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:35.150411 22083 tablet_copy_source_session.cc:215] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:35.167004 23492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2601e033c5b34310a9d1582b3d94c3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:35.148321 23503 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.180627 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:35.195223 22069 raft_consensus.cc:1275] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:35.195941 23503 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.196482 23503 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.198560 23503 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.202196 22773 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:35.204058 23478 raft_consensus.cc:2804] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:35.204588 23478 raft_consensus.cc:697] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:35.205602 23478 consensus_queue.cc:237] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:35.208153 22218 raft_consensus.cc:1275] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:35.208371 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:35.209117 22216 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:35.209081 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:35.216694 22070 raft_consensus.cc:1275] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:35.218149 23393 consensus_queue.cc:1048] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:35.165079 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:35.222048 22068 raft_consensus.cc:2468] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:35.223049 23504 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:35.226307 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:35.166467 23500 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:35.244263 23500 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:35.245018 22066 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:35.246299 22114 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:35.247095 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:35.247439 23504 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.247740 22805 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.247871 23504 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.248279 23504 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.262938 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:35.263702 22139 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.269500 22805 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:26:35.286440 22188 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:26:35.330878 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 44555.1us
I20260709 12:26:35.324290 23498 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:35.332437 23498 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.292841 21969 catalog_manager.cc:5697] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.274796 23487 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:35.347507 23487 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.349891 23487 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.345342 23388 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:26:35.350277 23424 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.350941 23424 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.359191 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:35.360257 22145 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:35.362123 23498 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.339486 23404 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:35.364056 23404 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:35.364482 23404 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.365577 23424 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.367496 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:35.368290 23492 tablet_copy_client.cc:806] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:35.368906 23492 tablet_copy_client.cc:670] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:35.370306 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:35.371047 22143 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:35.368284 22219 raft_consensus.cc:2393] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 2: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:35.364398 22036 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:35.377697 22036 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:35.377867 23409 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:35.378449 23409 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:35.378919 23409 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.267223 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44146 (request call id 224) took 1045 ms. Trace:
I20260709 12:26:35.386139 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:35.394352 22216 raft_consensus.cc:2393] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 2: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:35.379940 23465 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:35.402763 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:35.402901 23401 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:35.404558 23492 tablet_copy_client.cc:538] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:35.378942 23498 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:35.414885 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:35.419193 22219 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:35.411293 23498 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:35.415314 23487 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:35.434094 22139 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:26:35.387643 23473 rpcz_store.cc:276] 0709 12:26:34.222128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.222579 (+   451us) service_pool.cc:224] Handling call
0709 12:26:34.274704 (+ 52125us) ts_tablet_manager.cc:934] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
0709 12:26:34.944427 (+669723us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:35.168797 (+224370us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:35.168930 (+   133us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:35.266125 (+ 97195us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:35.266495 (+   370us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:35.266872 (+   377us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:35.266962 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":335,"tablet-copy.queue_time_us":26088,"thread_start_us":116936,"threads_started":2}
I20260709 12:26:35.436396 23487 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.437306 23438 consensus_queue.cc:1048] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:26:35.442420 23473 tablet_copy_client.cc:806] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:35.437729 23504 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.428998 23498 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.451444 23473 tablet_copy_client.cc:670] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:35.455686 23504 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.463351 23465 tablet_bootstrap.cc:492] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:35.479758 22113 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:35.480960 23504 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:35.481112 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 71998.9us
I20260709 12:26:35.481421 23504 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.481797 23504 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.428077 23401 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.489919 23504 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.492408 23504 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.492555 23401 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.494969 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:35.496295 22139 raft_consensus.cc:2393] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:35.518077 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:35.527725 23424 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.528057 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:35.528270 23424 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.528635 23424 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.528688 22216 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.517630 23438 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.517738 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:35.541199 23480 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:35.541891 23480 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.550634 22218 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.554241 22186 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:35.522167 23500 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.564848 23424 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.567277 23424 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.567698 23383 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:35.576897 22218 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:35.577858 23388 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.578347 23388 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.530055 23438 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.600310 23438 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.603426 23492 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:35.616643 23480 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:35.639017 23465 ts_tablet_manager.cc:1403] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.648s	user 0.044s	sys 0.015s
I20260709 12:26:35.640519 23500 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:35.641031 23518 log.cc:927] Time spent T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:26:35.641712 23409 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:35.642854 23516 log.cc:927] Time spent T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:26:35.645380 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:35.647265 22143 raft_consensus.cc:2368] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:35.644245 23409 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.690330 22216 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:35.691362 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:35.691980 22071 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.699005 23389 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.699748 23389 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:35.704036 23519 log.cc:927] Time spent T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:26:35.736368 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:35.748306 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:35.749004 22219 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:35.750219 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:35.751019 22066 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:35.765537 22071 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:35.737675 23389 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.751686 23383 raft_consensus.cc:697] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:26:35.800134 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 52794.4us
I20260709 12:26:35.772387 23487 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.807894 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:35.811473 22218 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:35.825313 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:35.833603 22217 raft_consensus.cc:2368] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:35.823299 23412 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.837402 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:35.842129 22073 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.846693 23412 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.849071 23412 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.827195 23498 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.855396 22073 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:35.855417 22139 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:35.860481 23521 log.cc:927] Time spent T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:26:35.864333 23465 raft_consensus.cc:359] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:35.865470 23465 raft_consensus.cc:740] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
W20260709 12:26:35.867990 23404 consensus_meta.cc:287] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 12:26:35.868557 23404 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.853084 23500 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:35.856408 23383 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:35.873765 23502 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.874552 23502 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:35.877127 23502 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:35.877619 22067 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:35.885524 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:35.887064 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:35.887758 22145 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:35.892678 22036 leader_election.cc:400] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:35.893085 22036 leader_election.cc:403] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:35.886343 22139 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:35.894701 23498 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:35.895349 23404 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:35.896931 23528 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:35.900557 23388 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:35.916025 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 129226us
I20260709 12:26:35.921648 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:35.922381 22139 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
W20260709 12:26:35.923398 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 122525us
I20260709 12:26:35.866186 23465 consensus_queue.cc:260] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:35.951287 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:35.959563 23465 ts_tablet_manager.cc:1434] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.320s	user 0.008s	sys 0.002s
I20260709 12:26:35.962440 22141 raft_consensus.cc:2368] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:35.963723 22036 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:35.965469 23533 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.966003 23533 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.966331 23533 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.970377 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:35.971176 22142 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:35.965456 22036 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:35.963850 22038 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:35.987977 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:35.988791 22068 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:35.989531 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:26:35.992527 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 56382.2us
I20260709 12:26:35.994017 22073 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:35.994205 22036 leader_election.cc:400] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:35.994792 22036 leader_election.cc:403] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:35.997711 22114 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:35.997648 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:35.998492 22217 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:36.002283 23525 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:35.950744 23412 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.007597 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:36.001132 22113 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:36.005254 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:36.008562 22219 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 2: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:36.009150 22141 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:36.002772 23525 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:35.997633 23409 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.006336 23503 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:36.041353 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:26:36.050069 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 56405us
I20260709 12:26:36.052259 22038 leader_election.cc:400] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:36.015679 23438 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.069967 22219 raft_consensus.cc:1275] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:36.020406 23525 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.037187 23409 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:36.080502 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:36.081605 22218 raft_consensus.cc:2393] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 2: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:26:36.013327 23412 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.054555 23503 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:36.079520 23409 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.097893 22143 raft_consensus.cc:2393] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:36.100225 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:36.089915 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:36.097182 23542 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.103053 22220 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.090469 23466 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.104825 23466 raft_consensus.cc:697] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:36.105835 23466 consensus_queue.cc:237] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.107018 22805 raft_consensus.cc:1217] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:36.109158 23503 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.071710 23438 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.112310 23438 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.113704 23531 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:36.117736 23409 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.120149 23533 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.123507 22220 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:36.149833 22185 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:36.150873 23522 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.151302 23522 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:36.152652 23522 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.153380 23409 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:36.161338 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:36.102396 23412 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:36.162127 22073 raft_consensus.cc:2368] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:26:36.178809 22185 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:26:36.175917 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 154949us
I20260709 12:26:36.184450 22185 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:26:36.183079 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 127143us
I20260709 12:26:36.192584 22067 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:36.188326 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:36.193293 22066 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:36.196830 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:36.196672 23499 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:36.202962 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 189878us
I20260709 12:26:36.180932 23542 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:36.210147 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:36.199554 23500 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.203774 23466 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.246869 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:36.243768 23500 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.249720 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:36.251014 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:36.211258 23473 tablet_copy_client.cc:538] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:36.210274 23533 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:36.209872 23499 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.397401 23499 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.199041 23505 consensus_queue.cc:1048] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:26:36.332772 23478 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:26:36.245245 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:26:36.405548 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 182066us
I20260709 12:26:36.405663 23504 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.406147 23504 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.406486 23504 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.210491 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-b155a7c146564fdbb5330057eca55fd8 received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:36.377737 22139 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:36.377662 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 168652us
I20260709 12:26:36.385434 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:36.410488 22218 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:36.417752 22113 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:36.427275 23503 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.427731 23503 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.428062 23503 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.388433 23500 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:36.385597 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 138327us
I20260709 12:26:36.392206 23466 raft_consensus.cc:697] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:36.395793 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:36.468680 23555 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:26:36.441551 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-b155a7c146564fdbb5330057eca55fd8 on tablet b155a7c146564fdbb5330057eca55fd8 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:36.440956 23438 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.477404 22147 raft_consensus.cc:2368] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:36.478014 23533 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:36.478621 23533 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:36.451912 23466 consensus_queue.cc:237] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.502279 23543 raft_consensus.cc:1064] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
W20260709 12:26:36.561051 23553 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
W20260709 12:26:36.565748 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45341us
W20260709 12:26:36.578578 23552 log.cc:927] Time spent T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:26:36.587096 23492 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:36.588150 23492 tablet_bootstrap.cc:492] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
W20260709 12:26:36.589375 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 182923us
I20260709 12:26:36.594017 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:36.596858 23498 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:36.597587 23498 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.599879 23498 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:36.601691 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:36.601748 21970 catalog_manager.cc:5697] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.604317 22036 leader_election.cc:400] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:36.604662 22036 leader_election.cc:403] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:36.604962 21970 catalog_manager.cc:5697] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.605777 23551 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.609334 22067 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:36.632401 22809 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:36.414311 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:36.642244 22069 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:26:36.645040 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:36.622711 23492 ts_tablet_manager.cc:1403] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 1.020s	user 0.023s	sys 0.025s
I20260709 12:26:36.688469 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:36.677516 23539 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:36.656273 22188 leader_election.cc:400] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Vote denied by peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979) with higher term. Message: Invalid argument: T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
W20260709 12:26:36.709744 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 54115.9us
I20260709 12:26:36.711457 23492 raft_consensus.cc:359] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:36.713697 22139 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:26:36.708432 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56766.3us
I20260709 12:26:36.655236 23438 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:36.718497 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 65005.2us
W20260709 12:26:36.724160 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.725864 22036 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:36.735219 22148 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:36.696966 23503 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.738230 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:36.735474 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:36.744099 23487 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:36.744692 23487 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:36.745604 23487 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.752478 23504 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.722553 23492 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:36.768088 22188 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:26:36.733691 23525 consensus_meta.cc:287] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.008s
I20260709 12:26:36.701474 23499 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.780731 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:26:36.786655 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 70654.1us
I20260709 12:26:36.774642 23480 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:36.795656 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:26:36.800843 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 76420us
I20260709 12:26:36.767552 23533 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:36.804190 22218 raft_consensus.cc:2368] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:36.815265 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:36.816265 22218 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:36.816203 23480 raft_consensus.cc:697] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:36.817482 23480 consensus_queue.cc:237] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.821409 23500 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.822738 22222 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
W20260709 12:26:36.800843 23522 consensus_meta.cc:287] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.648s	user 0.019s	sys 0.007s
I20260709 12:26:36.754817 23539 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.767856 23540 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:26:36.808781 23504 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:36.847523 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:36.848249 22069 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.781193 23525 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.862959 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:26:36.846755 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 96606.3us
I20260709 12:26:36.879307 22066 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
W20260709 12:26:36.879688 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 76537.6us
I20260709 12:26:36.878228 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:36.882334 22065 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:36.829071 23544 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:26:36.886550 23503 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:36.888744 23539 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:36.808722 23492 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:36.839023 23522 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:36.891865 23525 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:36.892755 23438 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.899541 23466 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:26:36.905881 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:36.908005 23492 ts_tablet_manager.cc:1434] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.253s	user 0.007s	sys 0.003s
I20260709 12:26:36.908301 23499 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:36.908504 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 82651.5us
W20260709 12:26:36.909555 23561 log.cc:927] Time spent T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:26:36.911669 23551 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:36.913719 22213 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.920085 22145 raft_consensus.cc:2368] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:36.923406 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:36.927173 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:36.933861 23523 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:26:36.938915 23500 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:36.940228 23522 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:36.939973 23543 consensus_queue.cc:237] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:36.941869 23473 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:36.946667 22147 raft_consensus.cc:2393] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:36.948009 22036 leader_election.cc:400] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:36.948365 22036 leader_election.cc:403] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:36.955411 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:36.956223 22139 raft_consensus.cc:2368] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:26:36.958894 23572 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.967698 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:36.976523 22142 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:36.979204 22069 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:36.980881 22114 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:26:36.986460 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 183219us
I20260709 12:26:36.989938 22038 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:36.993952 22213 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:37.014118 22069 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.020043 23564 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.997648 23563 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:37.039542 22038 leader_election.cc:400] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:37.037130 23563 raft_consensus.cc:697] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:37.054085 22071 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.058733 23545 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:26:37.061167 23563 consensus_queue.cc:237] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.071668 22806 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:37.074826 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:37.079376 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:37.082257 22217 raft_consensus.cc:2368] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:37.090559 23530 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:37.090517 23497 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:37.090538 23397 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:26:37.095839 23572 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:37.121850 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-2601e033c5b34310a9d1582b3d94c3aa received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:37.122396 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-2601e033c5b34310a9d1582b3d94c3aa on tablet 2601e033c5b34310a9d1582b3d94c3aa with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:37.152566 23530 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:37.153268 23530 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.155593 23530 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:37.157186 22064 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:37.106446 23497 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.169970 23497 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:37.170702 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:37.215025 22185 leader_election.cc:400] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:26:37.215555 22185 leader_election.cc:403] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:37.252681 22810 raft_consensus.cc:1217] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:26:37.263118 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 44877.6us
I20260709 12:26:37.286422 22038 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:37.299002 22038 leader_election.cc:400] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3.
I20260709 12:26:37.300588 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:37.301462 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:37.306394 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:37.313241 22073 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:26:37.314983 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:37.323364 22066 raft_consensus.cc:2393] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:26:37.329535 23583 log.cc:927] Time spent T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:26:37.313416 23587 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:37.349112 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 104789us
I20260709 12:26:37.327034 23404 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:26:37.360988 21968 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.352893 22188 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:37.384023 22188 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:37.385679 22188 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:37.385157 23383 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:37.387374 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 141183us
I20260709 12:26:37.386319 23383 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:37.390034 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 183483us
I20260709 12:26:37.388181 22188 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:37.394299 22114 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:37.386639 23404 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.387408 23540 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:37.403728 22139 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.413578 22144 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:37.410338 23466 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:37.415845 23480 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.418269 23540 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:37.419019 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:37.419310 23540 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.420699 23543 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:37.421160 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:37.391088 23383 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.434916 22216 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.444314 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:37.427037 23466 raft_consensus.cc:697] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:37.454547 23466 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.460330 22070 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.470072 22216 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.469184 23404 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.484241 23404 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.459262 23569 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:26:37.494848 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:37.486549 23404 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:37.515013 23588 log.cc:927] Time spent T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:26:37.489871 23414 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:26:37.551896 23522 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:37.502326 23536 consensus_queue.cc:1059] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 12:26:37.590569 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 181671us
W20260709 12:26:37.597766 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 138213us
I20260709 12:26:37.560220 23522 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.615491 22113 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:37.624441 22219 raft_consensus.cc:3055] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:37.626375 22219 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:37.605202 23598 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:26:37.625793 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 225617us
I20260709 12:26:37.620899 23530 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.625206 23544 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:26:37.645969 22219 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.641106 23590 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:26:37.654520 23601 log.cc:927] Time spent T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:37.675567 23590 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:37.637751 23598 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:37.683966 22216 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:37.776005 22218 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.753260 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:26:37.759701 23600 log.cc:927] Time spent T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:26:37.684820 23598 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:37.793607 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:37.799269 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:37.773996 23383 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.683939 23590 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:37.805763 22038 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:37.808130 23608 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:37.810115 23401 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.809988 23608 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.813364 22215 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:37.817348 23522 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:37.818795 23608 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:37.804860 23409 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 12:26:37.831427 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 313015us
I20260709 12:26:37.807548 23497 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:26:37.838212 22219 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.840163 23383 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:37.858217 23413 raft_consensus.cc:1064] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:37.864121 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:37.866861 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:37.868793 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:37.869831 22219 raft_consensus.cc:1275] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:37.870266 22219 pending_rounds.cc:85] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting all ops after (but not including) 1
I20260709 12:26:37.870507 22219 pending_rounds.cc:107] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:37.870836 22219 raft_consensus.cc:2889] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:37.871510 23539 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:26:37.871666 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:37.875495 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:37.843029 23473 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:37.898339 23473 tablet_bootstrap.cc:492] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:37.898845 22073 raft_consensus.cc:1275] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.843627 22065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:37.838227 23605 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:37.936285 23473 ts_tablet_manager.cc:1403] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.983s	user 0.025s	sys 0.021s
I20260709 12:26:37.894999 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:37.910584 23414 consensus_queue.cc:1059] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:26:37.910851 22217 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.861137 23413 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:37.936555 23605 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:37.942765 23545 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:37.944288 23605 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:26:37.935848 23570 log.cc:927] Time spent T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: Append to log took a long time: real 0.380s	user 0.010s	sys 0.006s
I20260709 12:26:37.948272 23414 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:37.948650 23414 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:37.949515 23414 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:37.954028 23414 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.940076 22065 raft_consensus.cc:606] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:26:37.954111 23613 log.cc:927] Time spent T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:26:37.968621 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 92515us
W20260709 12:26:37.973405 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 157201us
I20260709 12:26:37.995040 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:26:38.069960 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 96896.7us
I20260709 12:26:38.071441 23405 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:38.125764 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 110899us
W20260709 12:26:38.542469 23413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.010s	sys 0.021s
W20260709 12:26:38.543184 23413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.010s	sys 0.021s
I20260709 12:26:38.555987 23567 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:38.557050 23567 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:38.570194 23567 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:38.592643 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.600234 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:38.600591 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:38.602061 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.602965 22188 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:38.641650 22144 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:38.640617 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:38.638924 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:38.609984 23473 raft_consensus.cc:359] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:38.655192 23605 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:26:38.672365 23473 raft_consensus.cc:740] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:38.702919 23473 consensus_queue.cc:260] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:38.709074 23616 log.cc:927] Time spent T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:26:38.733673 21969 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.729314 23567 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:26:38.760345 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 168303us
I20260709 12:26:38.765375 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:38.779901 21968 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46396 (request call id 236) took 2165 ms. Trace:
I20260709 12:26:38.815738 21970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38180 (request call id 129) took 2764 ms. Trace:
W20260709 12:26:38.827421 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 178942us
I20260709 12:26:38.827330 21969 catalog_manager.cc:5697] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.817945 23480 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:38.841801 22065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:38.846549 22146 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:38.840297 21969 catalog_manager.cc:5697] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.842715 22065 raft_consensus.cc:606] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:38.818634 23567 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:38.836892 23397 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:38.857748 23620 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:38.887221 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 284357us
W20260709 12:26:38.890846 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 287113us
I20260709 12:26:38.894479 22218 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:38.907778 22810 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:38.887545 23397 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:38.910013 23397 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:38.910682 22216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:38.911285 22216 raft_consensus.cc:606] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:38.911624 22216 raft_consensus.cc:614] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:38.912066 23621 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:38.912649 23621 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:38.816177 21968 rpcz_store.cc:276] 0709 12:26:36.597152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.597538 (+   386us) service_pool.cc:224] Handling call
0709 12:26:36.635031 (+ 37493us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54002e0090. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e20b2 00007ff19255b759 00007ff1924f3a76 00007ff1924c4d58 00007ff1925c304e 00007ff190a842a4 00007ff190a84232 00007ff190a84161 00007ff190a840dc
0709 12:26:38.762208 (+2127177us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:37.385835 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:37.386372 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:37.387053 (+   681us) write_op.cc:435] Acquired schema lock
0709 12:26:37.387072 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:37.411373 (+ 24301us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:37.411431 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:37.411457 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:37.411674 (+   217us) tablet.cc:701] Row locks acquired
0709 12:26:37.411687 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:26:37.411830 (+   143us) write_op.cc:270] Start()
0709 12:26:37.411941 (+   111us) write_op.cc:276] Timestamp: P: 1783599997411783 usec, L: 0
0709 12:26:37.411955 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:26:37.412617 (+   662us) log.cc:844] Serialized 536 byte log entry
0709 12:26:37.957007 (+544390us) op_driver.cc:464] REPLICATION: finished
0709 12:26:37.957563 (+   556us) write_op.cc:301] APPLY: starting
0709 12:26:37.957643 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:37.957763 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:37.957856 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:37.958125 (+   269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:37.958497 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:37.958541 (+    44us) write_op.cc:312] APPLY: finished
0709 12:26:37.958795 (+   254us) log.cc:844] Serialized 23 byte log entry
0709 12:26:37.958959 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.959043 (+    84us) write_op.cc:454] Released schema lock
0709 12:26:37.959083 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:37.959655 (+   572us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.959682 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":650402,"reported_tablets":3,"spinlock_wait_cycles":26762880,"child_traces":[["op",{"apply.queue_time_us":302,"apply.run_cpu_time_us":1651,"apply.run_wall_time_us":1868,"num_ops":1,"prepare.queue_time_us":315,"prepare.run_cpu_time_us":2843,"prepare.run_wall_time_us":27699,"replication_time_us":537146}]]}
I20260709 12:26:38.859170 23480 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:38.931211 23631 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.818675 21970 rpcz_store.cc:276] 0709 12:26:36.051149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.051321 (+   172us) service_pool.cc:224] Handling call
0709 12:26:38.815653 (+2764332us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:36.752676 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:36.753741 (+  1065us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:36.753785 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:26:36.753803 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:36.754495 (+   692us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:36.754658 (+   163us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:36.754705 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:26:36.755277 (+   572us) tablet.cc:701] Row locks acquired
0709 12:26:36.755296 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:36.769466 (+ 14170us) write_op.cc:270] Start()
0709 12:26:36.779532 (+ 10066us) write_op.cc:276] Timestamp: P: 1783599996767194 usec, L: 0
0709 12:26:36.788121 (+  8589us) op_driver.cc:348] REPLICATION: starting
0709 12:26:36.811785 (+ 23664us) log.cc:844] Serialized 919 byte log entry
0709 12:26:37.383502 (+571717us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b18002e4320. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:26:37.658085 (+274583us) op_driver.cc:464] REPLICATION: finished
0709 12:26:37.845952 (+187867us) write_op.cc:301] APPLY: starting
0709 12:26:37.846072 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:37.846192 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:37.846211 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:37.846660 (+   449us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:37.846839 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:26:37.846887 (+    48us) write_op.cc:312] APPLY: finished
0709 12:26:37.847092 (+   205us) log.cc:844] Serialized 29 byte log entry
0709 12:26:37.847253 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.856825 (+  9572us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b2000039078. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c2b4b91 00007ff18c2d6a19 00007ff18c2a18c3 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169 00007ff18c2aa131 00007ff18c2a942d 0000000000388634
0709 12:26:37.941024 (+ 84199us) write_op.cc:454] Released schema lock
0709 12:26:37.952782 (+ 11758us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:37.953201 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.953227 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":119894,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":178341,"apply.run_cpu_time_us":4181,"apply.run_wall_time_us":107215,"num_ops":2,"prepare.queue_time_us":108687,"prepare.run_cpu_time_us":45779,"prepare.run_wall_time_us":129684,"raft.queue_time_us":186488,"raft.run_cpu_time_us":18646,"raft.run_wall_time_us":201783,"replication_time_us":846815,"spinlock_wait_cycles":102918656,"thread_start_us":323837,"threads_started":4,"wal-append.queue_time_us":91871}]]}
W20260709 12:26:38.967115 23617 log.cc:927] Time spent T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:26:38.970554 23594 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:38.983487 23473 ts_tablet_manager.cc:1434] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 1.043s	user 0.012s	sys 0.026s
I20260709 12:26:38.974254 23531 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:38.900646 23620 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:38.928810 23542 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:26:38.992539 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:38.990487 21967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46372 (request call id 209) took 1594 ms. Trace:
I20260709 12:26:38.975016 23621 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:38.980566 23401 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:38.991359 23497 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:38.992514 23592 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:38.968921 23631 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.037217 21967 rpcz_store.cc:276] 0709 12:26:37.245519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.260613 (+ 15094us) service_pool.cc:224] Handling call
0709 12:26:38.827873 (+1567260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73324,"reported_tablets":7,"spinlock_wait_cycles":122112}
W20260709 12:26:38.994531 23473 ts_tablet_manager.cc:1467] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Tablet startup took 1057ms
W20260709 12:26:39.057560 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 169586us
W20260709 12:26:39.057698 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 172678us
I20260709 12:26:39.064728 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1190) took 1152 ms. Trace:
I20260709 12:26:39.037132 23531 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.067394 23480 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:39.068526 23531 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.049672 23624 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:39.094769 22188 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.065155 22215 rpcz_store.cc:276] 0709 12:26:37.907880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.911245 (+  3365us) service_pool.cc:224] Handling call
0709 12:26:37.954569 (+ 43324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.003266 (+ 48697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.003303 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:38.190792 (+187489us) log.cc:844] Serialized 26 byte log entry
0709 12:26:38.670148 (+479356us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:38.670180 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.670240 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:39.060413 (+390173us) raft_consensus.cc:1685] finished
0709 12:26:39.060439 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.060621 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20302,"raft.queue_time_us":48559,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":52399,"thread_start_us":455941,"threads_started":1,"wal-append.queue_time_us":492285}
I20260709 12:26:39.108978 22188 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:26:39.109061 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45357.5us
W20260709 12:26:39.111052 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 45045.9us
I20260709 12:26:39.111306 22114 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:26:39.060909 23473 ts_tablet_manager.cc:1469] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Trace:
0709 12:26:34.222128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.222579 (+   451us) service_pool.cc:224] Handling call
0709 12:26:34.274704 (+ 52125us) ts_tablet_manager.cc:934] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
0709 12:26:34.944427 (+669723us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:35.168797 (+224370us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:35.168930 (+   133us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:35.266125 (+ 97195us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:35.266495 (+   370us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:35.266872 (+   377us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:35.266962 (+    90us) inbound_call.cc:177] Queueing success response
0709 12:26:35.536248 (+269286us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b4c0023d3c0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18a9d2a20 00007ff18a9e3a29 00007ff18a9e413f 00007ff18a9a82ab 00007ff18a9d5f3c 00007ff18a9d6461 00007ff18a9d6768 00007ff19075c66b 00007ff19169915b 00007ff191698f98 00007ff19168a322
0709 12:26:36.941418 (+1405170us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:37.936726 (+995308us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:37.946379 (+  9653us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:37.947673 (+  1294us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":335,"raft.queue_time_us":53311,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":47806,"spinlock_wait_cycles":21124480,"tablet-copy.queue_time_us":26088,"tablet-download-pool.queue_time_us":194,"tablet-download-pool.run_cpu_time_us":4338,"tablet-download-pool.run_wall_time_us":752928,"thread_start_us":116936,"threads_started":2}
I20260709 12:26:39.000353 23594 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.053442 23619 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.124990 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1312) took 1244 ms. Trace:
I20260709 12:26:39.098978 23595 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.128916 22071 rpcz_store.cc:276] 0709 12:26:37.875533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.876504 (+   971us) service_pool.cc:224] Handling call
0709 12:26:38.590810 (+714306us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b5800010598. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:26:38.591298 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.591801 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:26:38.944092 (+352291us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.119592 (+175500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.119651 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:39.119696 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.119771 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.119888 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61981,"prepare.queue_time_us":340225,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":66148,"spinlock_wait_cycles":8250112,"thread_start_us":438689,"threads_started":2}
W20260709 12:26:39.128369 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 129344us
W20260709 12:26:39.129114 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 132013us
I20260709 12:26:39.052174 23497 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.108783 23531 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.118861 23614 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:39.057003 23401 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.054728 23592 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.127286 23567 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.150839 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.137795 23628 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:39.137392 23605 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:39.199306 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 59822.7us
I20260709 12:26:39.202347 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.136445 23623 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.190673 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.114753 23624 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.143630 23642 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.206187 22148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2d9646522845819383a8daea185649"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
W20260709 12:26:39.196049 23627 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:26:39.208464 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.142894 23531 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:26:39.210047 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 68365.6us
I20260709 12:26:39.197728 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-6b8326670393490f9fabe3827cd6d958 received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:39.224241 23653 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.218906 22148 raft_consensus.cc:606] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.225658 22775 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.205852 23624 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.225472 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-6b8326670393490f9fabe3827cd6d958 on tablet 6b8326670393490f9fabe3827cd6d958 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:39.206185 23623 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:39.224888 23653 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.240727 23653 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.134102 23619 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:39.243678 23645 log.cc:927] Time spent T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:39.243803 23619 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.245087 23401 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.246232 23497 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:39.245893 23623 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.247099 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:39.248589 23623 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.225528 23649 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:39.249259 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:39.152923 23614 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.200402 23628 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.251994 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.250555 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:39.212189 23409 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:26:39.271431 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 55548.2us
W20260709 12:26:39.272046 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 146495us
W20260709 12:26:39.272495 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 146575us
I20260709 12:26:39.232821 22144 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:39.276283 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.274701 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.272881 22188 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.286585 22071 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:26:39.276938 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.284116 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.289866 22065 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:39.291163 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 70981.6us
I20260709 12:26:39.293730 22146 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:39.280100 23654 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.301637 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.304049 23628 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.310878 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1189) took 1403 ms. Trace:
I20260709 12:26:39.308557 22188 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.270390 23620 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.316509 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.340036 22188 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.272794 23631 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.301669 23614 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:39.311451 22222 rpcz_store.cc:276] 0709 12:26:37.907572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.911644 (+  4072us) service_pool.cc:224] Handling call
0709 12:26:38.591832 (+680188us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b58000f5a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:26:38.592026 (+   194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.594103 (+  2077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.594157 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:38.647133 (+ 52976us) log.cc:844] Serialized 26 byte log entry
0709 12:26:38.940836 (+293703us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:39.063429 (+122593us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.098200 (+ 34771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.098283 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:39.305761 (+207478us) raft_consensus.cc:1685] finished
0709 12:26:39.310522 (+  4761us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.310786 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38431,"prepare.queue_time_us":253295,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":70109,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":8611,"spinlock_wait_cycles":12219264,"thread_start_us":398252,"threads_started":2,"wal-append.queue_time_us":398759}
I20260709 12:26:39.349547 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:39.260651 23649 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.312923 23531 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.342170 23623 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:39.339617 23628 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.350812 23642 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.423656 23620 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.424275 23620 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.337385 23592 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.427850 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:26:39.435245 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 296104us
I20260709 12:26:39.428942 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.435201 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.436080 22070 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:39.429865 23649 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.414139 23656 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:39.418613 23623 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.431623 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.280565 23632 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:39.427306 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.435689 22072 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:26:39.439692 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 99744.8us
I20260709 12:26:39.434722 23657 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.447307 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.455166 23654 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:39.460857 23654 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.451488 23656 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.369817 23655 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.439944 23620 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.439440 23594 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.471004 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.470376 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.444373 23663 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:39.475865 23663 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.477303 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.479301 23654 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.477648 23592 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:39.481346 23592 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.489650 23648 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:39.465837 23657 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.519460 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:39.490469 23648 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.522224 23657 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.511525 23619 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.523428 23619 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.524037 23656 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:39.465528 23623 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.525905 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.527064 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.528412 22069 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:39.531167 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:39.532210 23629 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:39.485405 23663 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:39.532775 23629 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.534399 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.522279 23648 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.532648 23619 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.537524 23592 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.529747 23614 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:39.538259 23614 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.540457 23614 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:39.542313 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:39.544368 23663 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.544998 23663 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.546831 23628 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.547987 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.549281 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.551479 23663 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.552340 23614 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:39.553088 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.553006 23642 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.554014 23614 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.556607 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.557794 23614 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:39.560213 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.580044 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:39.580435 23642 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.583575 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.583750 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.584400 22221 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:39.585016 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.585665 22218 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:26:39.585343 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.588107 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.589533 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.590240 22220 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:39.591223 23642 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.593977 23629 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.595026 23660 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:39.619596 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.619982 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.620808 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.621490 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.624053 22067 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:39.625001 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.626228 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.627414 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.628693 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.630045 22113 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:39.641079 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.642373 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.643409 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.644337 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.646124 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.722498 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:39.645648 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.644423 23620 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.738385 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:39.746663 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.748808 22113 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:39.754992 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.756337 23637 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:39.756842 23637 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.758268 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.705765 23654 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:39.761282 22188 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.761950 22805 raft_consensus.cc:1217] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:39.762143 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.762737 22188 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.763348 22038 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.767879 23639 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.769642 23638 raft_consensus.cc:993] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:39.769421 23592 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:26:39.770118 23638 raft_consensus.cc:1081] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:39.771142 23623 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.763911 23621 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:39.772516 23621 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.772922 23621 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.745538 23595 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.774171 23595 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.776736 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.767014 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.757253 23637 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.757527 23620 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:39.780491 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.772243 23658 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.784881 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.783774 22220 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:39.776396 23595 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:39.790289 22038 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.777166 23654 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.782982 23620 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.804917 23637 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.808110 23637 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.811497 23669 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.799497 22038 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.791667 23658 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.813535 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:39.814369 22219 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.815086 23658 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.816179 23620 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:39.820326 22773 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.821638 22773 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.822728 23527 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.823181 22038 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.825155 23658 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.826192 23654 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.827497 22038 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.828390 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:39.829079 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:39.826354 22219 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:26:39.830673 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:39.830228 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.827416 23620 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:39.832819 23658 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.789899 22221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf2d9646522845819383a8daea185649"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:39.833544 22221 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:39.833981 22221 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.787734 23397 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.835160 23657 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:39.835785 23657 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:39.858294 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.844905 23669 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.849187 23531 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.873482 22773 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.874487 23531 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.883515 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.884912 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.885917 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:39.886685 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.882355 23657 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.892733 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.895268 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:39.896278 22065 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.896435 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:39.906299 22185 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.893950 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.908512 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:39.910917 22185 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.913441 22185 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.916021 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:39.916761 22805 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Advancing to term 2
W20260709 12:26:39.916920 23676 log.cc:927] Time spent T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:26:39.913108 23639 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.940255 22776 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.940394 22805 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:39.942286 22185 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:39.943672 22776 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:39.836532 23621 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.948077 22806 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:26:39.952704 22185 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.961403 22065 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:26:39.966002 22142 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.966224 22185 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:39.950626 23639 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.951154 23629 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.969874 23642 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.965323 23527 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.967727 23592 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.951344 23567 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.984202 23527 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:39.987250 23527 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.949836 23605 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:26:39.993731 23621 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:39.949026 22221 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:39.987169 23622 consensus_queue.cc:1059] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:26:39.995402 23628 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.984443 21969 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 233) took 3141 ms. Trace:
I20260709 12:26:39.997295 23622 raft_consensus.cc:3055] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.997912 23622 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:39.999857 22221 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:40.000587 22809 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:40.008785 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:26:40.016737 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 77371.1us
I20260709 12:26:40.021055 22065 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:40.025045 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 44036.8us
I20260709 12:26:40.021198 22185 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:40.027068 22114 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.030246 22114 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.033741 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.035892 22215 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.996984 21969 rpcz_store.cc:276] 0709 12:26:36.837211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.837407 (+   196us) service_pool.cc:224] Handling call
0709 12:26:39.978548 (+3141141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:38.931405 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:38.932109 (+   704us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:38.932149 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:26:38.932170 (+    21us) tablet.cc:662] Decoding operations
0709 12:26:38.932807 (+   637us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:38.932871 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:38.932901 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:38.933317 (+   416us) tablet.cc:701] Row locks acquired
0709 12:26:38.933349 (+    32us) write_op.cc:260] PREPARE: finished
0709 12:26:39.071087 (+137738us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b2c00000448. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18afffa11 00007ff18b00ea0a 00007ff18b00e693 00007ff18b00e631 00007ff18c741902 00007ff18c7416dd 00007ff19013c243 00007ff19013bd58 00007ff1901409f1 00007ff1901409a9 00007ff190140939
0709 12:26:39.071166 (+    79us) write_op.cc:270] Start()
0709 12:26:39.071395 (+   229us) write_op.cc:276] Timestamp: P: 1783599998966703 usec, L: 0
0709 12:26:39.071421 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:26:39.072269 (+   848us) log.cc:844] Serialized 1317 byte log entry
0709 12:26:39.422837 (+350568us) op_driver.cc:464] REPLICATION: finished
0709 12:26:39.506274 (+ 83437us) write_op.cc:301] APPLY: starting
0709 12:26:39.506384 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:39.506555 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:39.506579 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:39.507204 (+   625us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:39.507397 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:26:39.507445 (+    48us) write_op.cc:312] APPLY: finished
0709 12:26:39.507710 (+   265us) log.cc:844] Serialized 35 byte log entry
0709 12:26:39.507922 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:39.508018 (+    96us) write_op.cc:454] Released schema lock
0709 12:26:39.508060 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:39.510294 (+  2234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:39.510329 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":454997,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":83106,"apply.run_cpu_time_us":2271,"apply.run_wall_time_us":3972,"num_ops":3,"prepare.queue_time_us":64637,"prepare.run_cpu_time_us":12330,"prepare.run_wall_time_us":205338,"raft.queue_time_us":189952,"raft.run_cpu_time_us":6936,"raft.run_wall_time_us":45436,"replication_time_us":351233,"spinlock_wait_cycles":44669184,"thread_start_us":243793,"threads_started":4,"wal-append.queue_time_us":118357}]]}
I20260709 12:26:40.039248 23649 raft_consensus.cc:993] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:40.039815 23649 raft_consensus.cc:1081] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:40.043386 22141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:40.036315 23637 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.035985 23657 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:40.046917 23657 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:40.047330 23657 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.047835 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:40.050081 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:39.999945 23527 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.058889 22141 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.061080 22141 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.034960 23622 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.071803 23620 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:40.072456 23620 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:40.072968 22188 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:40.072834 23620 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.077672 23602 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.060616 22037 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.083902 23658 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:40.088304 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 122256us
I20260709 12:26:40.061770 23623 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.072899 23527 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:40.083671 23620 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.098351 22065 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:40.100026 22188 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:40.098711 22185 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:40.101511 22114 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:26:40.104512 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 142048us
I20260709 12:26:40.108626 22185 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:40.116642 22114 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.136195 23648 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.106086 23620 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:40.139286 23648 raft_consensus.cc:697] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:40.140419 23648 consensus_queue.cc:237] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.138160 22776 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:26:40.103343 23681 log.cc:927] Time spent T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.057s	user 0.010s	sys 0.003s
I20260709 12:26:40.154655 23657 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.156013 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:26:40.208675 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 100197us
I20260709 12:26:40.134975 23602 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:40.106983 23683 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.109172 23662 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.107719 23497 raft_consensus.cc:993] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:40.122490 23622 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.180500 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:26:40.181620 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 85943.1us
I20260709 12:26:40.182794 23656 consensus_queue.cc:1059] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:40.188287 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 50361.8us
W20260709 12:26:40.205984 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 89464.9us
I20260709 12:26:40.223286 22810 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:40.221402 22141 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.226408 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:40.208561 23479 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.238468 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:40.208472 23620 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.106702 23614 consensus_queue.cc:1059] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
W20260709 12:26:40.247638 22038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.223201 23670 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.235518 23497 raft_consensus.cc:1081] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:40.267705 23614 raft_consensus.cc:3055] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:40.268153 23614 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:40.268970 23614 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.270329 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:40.271462 23662 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:40.273064 22114 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.274042 22809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44146
I20260709 12:26:40.275049 22809 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.275738 22809 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.278930 23657 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:40.272054 23662 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.283874 22809 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.287122 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:40.225107 23602 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.311098 23602 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:40.289811 23413 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:40.294335 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:40.296164 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:40.301925 22140 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:40.315079 22776 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.270385 23614 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.331789 22809 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:40.334299 22145 raft_consensus.cc:3055] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.335026 22145 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:40.298225 23653 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.345754 23658 raft_consensus.cc:1064] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:40.348769 23658 consensus_queue.cc:237] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.311928 23413 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.362671 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:40.365062 23592 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:40.330534 23567 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.366544 23602 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:40.370294 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.370995 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:40.381959 22067 raft_consensus.cc:3055] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.382258 22067 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:40.380941 23592 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.383813 23682 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.385579 23602 raft_consensus.cc:3055] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.386027 23602 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:40.354578 23404 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:26:40.386739 23404 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:40.386272 22067 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.388062 22067 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.389333 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:40.389941 22070 raft_consensus.cc:3055] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.390341 22070 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:40.400741 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:40.419265 22140 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:40.400038 22144 raft_consensus.cc:1240] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:40.387295 23404 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:40.385644 23592 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:40.431679 22067 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:40.436254 22141 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:40.469995 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:40.439303 23404 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.473413 22803 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:40.494727 23404 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.466820 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:40.485733 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:40.496155 22140 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.486311 22145 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.485606 22776 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:40.481769 22139 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:40.492086 22073 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:26:40.491302 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 192492us
I20260709 12:26:40.446839 23659 consensus_queue.cc:1059] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:26:40.449378 23629 consensus_queue.cc:1059] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:26:40.488457 23413 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:40.506914 22213 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:40.481427 23602 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.510670 22145 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.505734 21967 catalog_manager.cc:5697] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:40.514786 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:40.508842 23664 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.524027 22070 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.512617 23401 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:26:40.479439 23662 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:40.515478 23687 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:26:40.537642 23497 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:40.541360 22145 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:40.548372 23659 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:26:40.549018 23605 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:26:40.546097 23655 raft_consensus.cc:3055] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.551424 23655 raft_consensus.cc:740] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:40.552271 23655 consensus_queue.cc:260] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.553725 23655 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.554659 22038 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.558965 22214 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:40.560854 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:40.563040 22071 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.555192 23664 raft_consensus.cc:697] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:40.565038 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:40.565485 23664 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:40.567216 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:40.562095 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:40.575294 22140 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:40.577857 22070 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.557669 23659 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.580229 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:40.596423 22220 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.609547 22188 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:40.614061 22188 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:40.615382 22188 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:40.620085 23629 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.622732 23628 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:40.613407 23663 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.618144 23662 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.644057 22220 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:40.620661 23605 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:26:40.650111 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:40.677291 22070 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:40.656527 23602 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.683943 22139 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:40.680703 23413 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:26:40.663942 23653 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.691177 23653 raft_consensus.cc:697] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:40.701078 23404 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:40.703591 23653 consensus_queue.cc:237] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.706108 22809 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:40.705083 23658 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:40.744199 22072 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:40.757879 22221 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:40.765146 22114 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:40.770196 23618 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.770918 23618 raft_consensus.cc:697] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:40.773023 23618 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:40.776175 23701 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 12:26:40.779464 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:40.792346 23657 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.792934 23657 raft_consensus.cc:697] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:40.793939 23657 consensus_queue.cc:237] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:40.886533 22141 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:40.931484 21969 catalog_manager.cc:5697] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 3, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:26:40.933561 21969 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 3, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 3 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.951398 21968 catalog_manager.cc:5697] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:40.952030 21969 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 3, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:26:40.953522 21968 catalog_manager.cc:5697] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.959017 21969 catalog_manager.cc:5697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 2 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:26:40.960650 21969 catalog_manager.cc:5697] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.970314 22214 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:40.980906 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:40.978772 23701 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:26:41.021763 22140 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:41.023342 23527 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:41.062551 21970 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.101845 22064 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:41.103610 23567 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:41.139318 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4321547cceb341b9babe64debb9fb125"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:41.139976 22214 raft_consensus.cc:606] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:41.140309 22214 raft_consensus.cc:614] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:41.157990 22070 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:41.159987 23683 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:41.162551 22139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:41.163265 22139 raft_consensus.cc:606] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:41.163268 22072 consensus_queue.cc:237] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.169559 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:41.170197 22214 raft_consensus.cc:606] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:41.172392 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:41.174434 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:41.186059 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:41.187290 22803 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:41.189188 23413 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:41.178817 22064 consensus_queue.cc:237] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.199746 23413 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:41.203910 22214 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:41.209321 22803 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:41.211279 23622 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:41.203474 22809 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:41.213354 23622 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:41.213928 22073 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.216161 23683 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.234434 23655 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:41.234397 23622 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.235503 23655 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.235612 23622 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.238022 22221 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.240365 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:41.241107 22140 raft_consensus.cc:2393] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:41.239320 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:41.242053 23637 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:41.242136 22139 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:41.243643 23655 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:41.244536 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:41.244666 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:41.245464 22810 raft_consensus.cc:2393] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:41.246564 22186 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:41.246789 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:41.247431 23655 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.247869 23660 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:41.247488 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:41.249415 23622 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:41.247386 22810 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:41.251842 22037 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:41.252751 23614 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:41.253207 23614 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.253623 23614 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.265631 22139 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:41.267333 23622 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:41.249944 22806 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:41.299333 22139 raft_consensus.cc:2955] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:41.304415 22213 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.301812 21968 catalog_manager.cc:5697] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:41.311803 22214 raft_consensus.cc:2955] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:41.314663 22213 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:41.320401 23653 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:41.330058 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b155a7c146564fdbb5330057eca55fd8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:41.338933 23647 raft_consensus.cc:993] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:41.339947 23647 raft_consensus.cc:1081] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:41.343811 22070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:44992
I20260709 12:26:41.344429 22070 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:41.344789 22070 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.352082 21970 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 3, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.355659 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet b155a7c146564fdbb5330057eca55fd8 with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:41.356249 21970 catalog_manager.cc:5697] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.360296 21970 catalog_manager.cc:5697] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.362645 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b8326670393490f9fabe3827cd6d958 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:41.355109 23614 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.369025 22064 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.368721 22218 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.369920 22072 raft_consensus.cc:2368] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3.
I20260709 12:26:41.370880 23653 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.373705 22188 leader_election.cc:400] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Vote denied by peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979) with higher term. Message: Invalid argument: T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3.
I20260709 12:26:41.376765 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:41.377396 22139 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.384474 23655 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:41.386090 22139 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:41.391691 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:41.392526 23614 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:41.392658 22221 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:41.399832 22064 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.400851 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:41.400955 21969 catalog_manager.cc:5697] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 3 to 4, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.418187 22809 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Advancing to term 3
I20260709 12:26:41.416538 23723 tablet_replica.cc:333] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:41.433552 22809 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:41.365931 22070 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.435407 23723 raft_consensus.cc:2243] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.436189 22037 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:41.443974 23614 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:41.444511 23614 raft_consensus.cc:697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:41.445370 23614 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.450287 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:41.451032 22809 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.470373 23723 raft_consensus.cc:2272] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.474723 23723 ts_tablet_manager.cc:1916] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:41.487558 22809 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:41.440762 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b8326670393490f9fabe3827cd6d958 with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:41.476264 23605 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:41.477020 23637 raft_consensus.cc:993] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:41.499303 23637 raft_consensus.cc:1081] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:41.439656 22070 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:41.477576 21970 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65), VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66), VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67), VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:41.440615 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:41.503340 22217 raft_consensus.cc:3055] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:41.503710 22217 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:41.504463 22217 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.505650 22217 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.510985 23413 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:41.511584 23413 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.515802 23413 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:41.516338 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:41.516613 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:41.517607 22213 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:41.518719 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:41.519476 23614 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:41.519872 23614 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:41.520260 23614 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.517259 22803 raft_consensus.cc:2393] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 2: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:26:41.530115 22217 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:41.531302 22806 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:41.532560 22037 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:41.539444 23413 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:41.540840 23413 raft_consensus.cc:697] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:41.542155 23413 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.559173 23727 tablet_replica.cc:333] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:41.566681 23727 raft_consensus.cc:2243] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:41.588943 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 114174us
I20260709 12:26:41.580585 23727 raft_consensus.cc:2272] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.600010 23658 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:41.605799 22064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:45000
I20260709 12:26:41.605963 23658 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:41.606506 22064 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:41.606766 23727 ts_tablet_manager.cc:1916] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:41.620375 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:41.621251 22139 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:41.628293 23658 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:41.629418 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:41.630105 22213 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:41.631275 22038 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:41.637116 22064 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.633987 23614 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.638630 23720 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:41.639096 23720 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:41.639703 23720 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.651047 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:41.659935 23614 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:41.661115 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:41.661881 22217 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:41.663280 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:41.663419 21968 catalog_manager.cc:5697] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.668288 23614 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:41.661969 22806 raft_consensus.cc:2393] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 2: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:26:41.650345 23723 ts_tablet_manager.cc:1929] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:41.669523 23614 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:41.669996 23723 log.cc:1199] T b155a7c146564fdbb5330057eca55fd8 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/b155a7c146564fdbb5330057eca55fd8
I20260709 12:26:41.670545 23614 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.672435 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet b155a7c146564fdbb5330057eca55fd8 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:41.675099 22064 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:41.677726 22064 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:41.679296 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:41.680114 22139 raft_consensus.cc:3055] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:41.680562 22139 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:41.681609 22139 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:41.684041 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:41.684721 22217 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.685168 22139 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.689841 23720 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:41.692303 22139 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:41.692795 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:41.693542 22140 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:41.694741 22036 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:41.696379 23413 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:41.697103 23413 raft_consensus.cc:697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:41.698087 23413 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:41.712010 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:41.723567 22213 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:41.726974 22038 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:41.727458 22217 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:41.730315 23401 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:41.730899 23401 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:41.731750 23401 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:41.733412 23720 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:41.737342 23727 ts_tablet_manager.cc:1929] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:41.737823 23727 log.cc:1199] T 6b8326670393490f9fabe3827cd6d958 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/6b8326670393490f9fabe3827cd6d958
I20260709 12:26:41.747983 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 6b8326670393490f9fabe3827cd6d958 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:41.747973 21968 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.778232 21968 catalog_manager.cc:5697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 3 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.785912 21968 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 3 to 4, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.904016 22139 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:41.905759 23401 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:41.949388 23594 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.950013 23594 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:41.952936 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:41.958540 23594 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:41.960350 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:41.961110 22213 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:41.968158 22775 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:41.970153 22806 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:41.971972 23594 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:41.972855 23594 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.971879 23614 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:41.973277 23594 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.027529 22217 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.036931 22213 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:42.037242 22217 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:42.045550 23658 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:42.045970 23720 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:42.056944 22809 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:42.058956 23720 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:42.078959 23594 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:42.086560 22803 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:42.091262 23614 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:42.092350 23614 raft_consensus.cc:3055] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:42.092762 23614 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:42.097236 23605 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.098125 23605 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:42.102936 23658 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:42.110312 23605 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:42.111544 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:42.112424 22213 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:42.113792 22113 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:42.114605 23726 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:42.115051 23726 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.115376 23726 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.122126 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:42.094275 23614 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:42.115725 22809 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:42.200600 22141 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:42.202970 23622 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:42.210620 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 66615.2us
I20260709 12:26:42.220549 23726 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:42.232157 23726 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:42.261566 23614 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.263406 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:42.264052 22213 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.276364 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:42.325397 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:42.327795 22220 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:42.329090 22213 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:26:42.330402 22113 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:42.331658 22218 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:42.330703 22217 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:42.339958 23637 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:42.409778 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 76394.3us
I20260709 12:26:42.380748 23594 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:42.453670 23637 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:42.476042 23637 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:42.485528 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:42.486254 22218 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.542534 22218 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:26:42.565258 22141 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:42.585920 22071 raft_consensus.cc:2410] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:26:42.590204 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 83220.8us
W20260709 12:26:42.586866 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 95143.5us
I20260709 12:26:42.600644 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:42.612218 22140 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:42.670140 23733 log.cc:927] Time spent T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:26:42.693003 23614 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:42.693724 23614 consensus_queue.cc:1243] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:26:42.694140 23741 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:42.694480 23741 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:42.695356 23741 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:42.696825 23741 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:42.698035 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 278725us
I20260709 12:26:42.709824 23401 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:26:42.775231 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 310119us
I20260709 12:26:42.796260 21969 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65), VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66), VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67), VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:42.803879 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 296693us
W20260709 12:26:42.866533 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 90184.2us
I20260709 12:26:42.909986 22775 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:42.949251 22073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:42.949906 22073 raft_consensus.cc:606] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:42.950237 22073 raft_consensus.cc:614] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:42.957067 23734 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:42.970010 23734 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:42.971047 23734 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.020730 22071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:43.021871 22071 raft_consensus.cc:606] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:26:43.024888 23780 log.cc:927] Time spent T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:26:43.035509 22071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:43.036298 22071 raft_consensus.cc:606] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:43.040355 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:43.040967 22141 raft_consensus.cc:606] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:43.039412 22217 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:43.044473 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:43.045080 22141 raft_consensus.cc:606] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:43.047616 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:43.048784 23771 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.050132 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:43.051268 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:43.054296 22071 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:26:43.054768 22071 pending_rounds.cc:85] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Aborting all ops after (but not including) 2
I20260709 12:26:43.055012 22071 pending_rounds.cc:107] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:26:43.055258 22071 raft_consensus.cc:2889] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:43.057426 23771 raft_consensus.cc:993] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:43.058104 23653 raft_consensus.cc:1081] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:43.060371 22217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:43.062733 23771 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.086232 22217 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.094254 22217 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.108708 22217 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:43.112186 22217 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:43.112353 23743 raft_consensus.cc:993] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:43.112943 23743 raft_consensus.cc:1081] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:43.117010 22217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58424
I20260709 12:26:43.119612 22217 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.121353 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:43.122081 22064 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.122849 23748 raft_consensus.cc:993] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:43.123369 23748 raft_consensus.cc:1081] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:43.121306 22217 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.128422 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:43.128970 22141 raft_consensus.cc:3055] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.129194 22141 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:43.129842 22141 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:43.134481 22141 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.134877 22217 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.137290 22213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:43.137964 22213 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.138324 22213 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.144604 22141 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:26:43.150841 22185 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:43.152387 23623 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.152933 23623 raft_consensus.cc:697] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:43.154821 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:43.155450 23623 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:43.155494 22810 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.161468 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:43.162127 22071 raft_consensus.cc:3055] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:43.162417 22071 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:43.163827 22071 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.164929 22071 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.169518 22217 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:43.168653 22213 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:43.172101 22810 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:43.176294 22064 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:26:43.173513 22186 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:43.178122 23772 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:43.179399 23772 raft_consensus.cc:697] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:43.180285 23772 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.190263 22213 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:43.191771 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:43.195406 22141 raft_consensus.cc:3055] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:43.195755 22141 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:43.196594 22141 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:43.196955 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:43.197641 22064 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.197923 22141 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.194738 22071 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
W20260709 12:26:43.218065 21958 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 6 similar messages]
I20260709 12:26:43.221853 22141 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:43.224745 22185 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:43.226397 23767 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:43.226981 23767 raft_consensus.cc:697] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:43.227887 23767 consensus_queue.cc:237] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:43.232228 21967 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 5, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.224467 22064 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
W20260709 12:26:43.264019 21958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45991.2us
I20260709 12:26:43.293639 23743 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.294376 23743 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.294486 21969 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 3, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 3 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.298060 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:43.298923 22213 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:43.300279 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:43.302686 23763 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.303100 23763 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.303440 23763 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.308737 23743 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:43.308995 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:26:43.311081 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): ChangeConfig:REMOVE_PEER RPC failed for tablet 2601e033c5b34310a9d1582b3d94c3aa: Remote error: Service unavailable: leader transfer in progress
W20260709 12:26:43.371220 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 57060.8us
I20260709 12:26:43.372277 23763 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.374887 23763 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:43.378335 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:43.401760 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:43.402357 22213 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.413297 22213 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:43.420279 23763 raft_consensus.cc:993] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:43.422958 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:43.430015 23761 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.430578 23761 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:43.431701 23761 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.450872 23763 raft_consensus.cc:1081] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:43.453718 22220 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:43.460562 22145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:43.461194 22145 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.461544 22145 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.470484 22145 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.472448 22071 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:43.475297 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:43.475967 22810 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.486068 22810 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:43.488095 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:43.488763 22213 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.450414 21970 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 3 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.496440 21970 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.498386 21970 catalog_manager.cc:5697] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.499089 22213 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:43.506719 22145 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:43.517702 23781 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:43.530880 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:43.542832 23773 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:43.543318 22064 raft_consensus.cc:3055] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.543699 22064 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:43.544483 22064 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.545742 22113 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:43.546005 22064 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.545054 23773 consensus_queue.cc:1243] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer d465f3cb42174eb89615dcd747f9e682 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:43.547652 23749 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.548364 23749 raft_consensus.cc:697] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:43.549247 23749 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.554646 23781 raft_consensus.cc:3055] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.555105 23781 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:43.556130 23781 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:43.557451 23781 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.592612 22064 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:43.600919 21969 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 4, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:43.631810 21958 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2601e033c5b34310a9d1582b3d94c3aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d465f3cb42174eb89615dcd747f9e682 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:43.691869 22073 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:43.693944 23767 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:43.699545 22145 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:43.701865 23767 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:43.654079 21970 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 3 to 4, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.733450 22073 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:43.740036 23623 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:43.753614 22803 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:43.755751 23767 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:43.799569 22073 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:43.801231 23759 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:43.880719 22213 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:43.884234 23761 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:43.893257 22141 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:43.895128 23752 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:43.927007 22803 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:43.928802 23658 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:43.931928 23658 consensus_queue.cc:1243] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer 7ff8d9fd78c1454cacc77bbc1bfb992e log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:43.934772 22810 pending_rounds.cc:85] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting all ops after (but not including) 4
I20260709 12:26:43.935115 22810 pending_rounds.cc:107] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:26:43.935360 22810 raft_consensus.cc:2889] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:44.112133 22220 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:44.128173 23749 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:44.132582 22810 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:44.141933 23619 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:44.153172 22070 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:44.156875 23619 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:44.449966 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.569564 22220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "369b15e6e4254982a559940734df1656"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:44.570232 22220 raft_consensus.cc:606] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:44.589147 22139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:44.589845 22139 raft_consensus.cc:606] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:44.597376 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:44.598059 22141 raft_consensus.cc:606] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:44.599392 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:44.601404 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:44.602267 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.602126 22139 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:44.612665 22803 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:44.615329 22070 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:44.616019 23815 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:44.619417 23815 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:44.628582 23815 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:44.655622 22070 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:44.674646 21970 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 3 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.683482 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2601e033c5b34310a9d1582b3d94c3aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 12:26:44.693169 22803 raft_consensus.cc:2955] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:44.746714 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 2601e033c5b34310a9d1582b3d94c3aa with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:44.762866 23821 tablet_replica.cc:333] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:44.765447 23804 raft_consensus.cc:993] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:44.765949 23804 raft_consensus.cc:1081] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:44.767990 22141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "369b15e6e4254982a559940734df1656"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51452
I20260709 12:26:44.768443 22141 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:44.768721 22141 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.777644 23821 raft_consensus.cc:2243] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.779090 22141 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:44.778688 23821 raft_consensus.cc:2272] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.781358 22141 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:44.782287 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:44.783389 22220 raft_consensus.cc:3055] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:44.783705 22220 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:44.784451 22220 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:44.785863 22220 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.786828 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:44.787464 22803 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.787784 23821 ts_tablet_manager.cc:1916] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:44.792910 22220 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:44.794243 22113 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:44.795024 23816 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:44.795492 23816 raft_consensus.cc:697] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:44.796283 23816 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:44.801306 22803 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:44.817540 21969 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 4, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.819206 23821 ts_tablet_manager.cc:1929] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:26:44.824036 23821 log.cc:1199] T 2601e033c5b34310a9d1582b3d94c3aa P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/2601e033c5b34310a9d1582b3d94c3aa
I20260709 12:26:44.826655 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 2601e033c5b34310a9d1582b3d94c3aa (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:45.012130 23749 raft_consensus.cc:993] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:45.013185 23749 raft_consensus.cc:1081] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:45.025089 22070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:45000
I20260709 12:26:45.031258 22070 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:45.032086 22070 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.060346 22070 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:45.064500 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:45.065474 22141 raft_consensus.cc:3055] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:45.065858 22141 raft_consensus.cc:740] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:45.066987 22141 consensus_queue.cc:260] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:45.067870 23817 raft_consensus.cc:993] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:45.068588 22141 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.068804 23771 raft_consensus.cc:1081] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:45.071267 22073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:45000
I20260709 12:26:45.071972 22073 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:45.072417 22073 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.088245 22070 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:45.089437 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:45.093663 22803 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.110769 22073 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:45.091851 22141 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:45.113798 22803 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:45.114252 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:45.114965 22145 raft_consensus.cc:3055] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:45.115175 22036 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:45.115257 22145 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:45.116263 22073 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:45.116693 23813 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:45.116822 22145 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:45.120931 22145 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.122921 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:45.123605 22218 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.125952 23813 raft_consensus.cc:697] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:45.127267 23813 consensus_queue.cc:237] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:45.132274 22218 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:45.133927 22145 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:45.134007 22038 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:45.135435 23720 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:45.136020 23720 raft_consensus.cc:697] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:45.137384 23720 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:45.166972 21969 catalog_manager.cc:5697] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.171056 21969 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 3 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.338486 22803 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:45.339813 23749 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:45.357889 22220 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:45.360634 23749 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:45.600175 22218 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:45.601493 23720 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.604274 22803 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:45.606837 23814 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:45.648794 22145 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:45.701150 23814 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:26:45.719343 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 47421.3us
W20260709 12:26:45.723788 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 72828.2us
I20260709 12:26:45.731580 22145 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:45.768942 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:45.826548 23720 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:45.995910 22070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:45.996640 22070 raft_consensus.cc:606] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:46.001433 22145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:46.002099 22145 raft_consensus.cc:606] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:46.004247 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:46.006491 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:46.007658 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:46.056620 23720 raft_consensus.cc:993] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:46.057173 23720 raft_consensus.cc:1081] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:46.063263 22145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:46.064055 22145 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.067705 22145 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.074278 22139 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:46.085229 22112 consensus_peers.cc:597] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 161e19d23ae64fb1919e4e43e3e26bd3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.085688 22218 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:46.087255 22070 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:46.088989 23847 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:46.090934 23847 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:46.084959 22145 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:46.100069 23847 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.106967 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:46.107704 22070 raft_consensus.cc:3055] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:46.108250 22070 raft_consensus.cc:740] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:46.109838 22070 consensus_queue.cc:260] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:46.111004 22070 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.111863 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:46.112474 22220 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.115921 22218 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.132825 22070 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:46.134529 22114 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:46.135643 23844 raft_consensus.cc:2804] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:46.136170 23844 raft_consensus.cc:697] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:46.137216 23844 consensus_queue.cc:237] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:46.138947 22073 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.162443 21969 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 3, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.164806 22213 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:46.187108 22145 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:46.213438 22220 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:46.229632 22070 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:46.230335 22141 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:46.232335 23845 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:46.233646 23802 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:46.232256 22186 consensus_peers.cc:597] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cecfaeb2287f4f7db4bee651c8bc4a36. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.269013 23845 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.279441 22067 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.281014 21967 catalog_manager.cc:5697] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.283072 22145 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.337602 22073 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:46.356261 22037 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de6d6e7c5d4c484487206e2d8b43cebf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.358098 22141 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:46.358902 22220 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:46.356750 21967 catalog_manager.cc:5697] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.360514 23837 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:46.361472 23813 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:46.390636 23835 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.392308 22218 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.411882 23817 raft_consensus.cc:993] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:46.412484 23817 raft_consensus.cc:1081] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:46.415021 22213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:46.415642 22213 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.415971 22213 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:46.419809 22220 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:46.425341 22213 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:46.429327 22141 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.457911 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:46.460623 22067 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:46.459074 21970 catalog_manager.cc:5697] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.474452 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:46.475173 22145 raft_consensus.cc:3055] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:46.475466 22145 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:46.476245 22145 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:46.477337 22145 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:46.480736 22213 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:46.490293 22067 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:26:46.495046 22188 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:46.495934 23845 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:46.496430 23845 raft_consensus.cc:697] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:46.497339 23845 consensus_queue.cc:237] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:46.499503 22145 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
W20260709 12:26:46.502132 22186 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68d18246b3984c719bedcfe7da84c5c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.502420 22067 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:46.504572 23802 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:46.504861 22141 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:46.509750 23802 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:46.532696 22067 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.531229 23802 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.545305 21967 catalog_manager.cc:5697] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 3 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.555150 22220 raft_consensus.cc:1275] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:46.556711 23771 consensus_queue.cc:1048] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:46.574616 21970 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 5, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.590163 22145 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:46.633857 22067 raft_consensus.cc:1275] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:46.635792 23771 consensus_queue.cc:1048] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:46.682714 23872 ts_tablet_manager.cc:933] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:46.685791 23872 tablet_copy_client.cc:323] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:46.688081 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 161e19d23ae64fb1919e4e43e3e26bd3 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:46.688719 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 161e19d23ae64fb1919e4e43e3e26bd3 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-161e19d23ae64fb1919e4e43e3e26bd3
I20260709 12:26:46.697738 22158 tablet_copy_source_session.cc:215] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:46.701002 23872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161e19d23ae64fb1919e4e43e3e26bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:46.720374 23872 tablet_copy_client.cc:806] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:46.721069 23872 tablet_copy_client.cc:670] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:46.726387 23872 tablet_copy_client.cc:538] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:46.734328 23874 ts_tablet_manager.cc:933] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:46.737417 23872 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:46.738373 23874 tablet_copy_client.cc:323] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:46.740911 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet de6d6e7c5d4c484487206e2d8b43cebf from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:46.741539 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet de6d6e7c5d4c484487206e2d8b43cebf from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-de6d6e7c5d4c484487206e2d8b43cebf
I20260709 12:26:46.752419 22083 tablet_copy_source_session.cc:215] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:46.757759 23874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6d6e7c5d4c484487206e2d8b43cebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:46.784413 23874 tablet_copy_client.cc:806] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:46.785109 23874 tablet_copy_client.cc:670] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:46.794433 23872 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:46.795656 23872 tablet_bootstrap.cc:492] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:46.796469 23872 ts_tablet_manager.cc:1403] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.012s
I20260709 12:26:46.798033 23874 tablet_copy_client.cc:538] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:46.801000 23872 raft_consensus.cc:359] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:46.801882 23872 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:46.802929 23877 ts_tablet_manager.cc:933] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:46.802577 23872 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:46.805801 23872 ts_tablet_manager.cc:1434] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:26:46.811800 23874 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:46.814216 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-161e19d23ae64fb1919e4e43e3e26bd3 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:46.814850 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-161e19d23ae64fb1919e4e43e3e26bd3 on tablet 161e19d23ae64fb1919e4e43e3e26bd3 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:46.814416 23877 tablet_copy_client.cc:323] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:46.826038 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet cecfaeb2287f4f7db4bee651c8bc4a36 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:46.826730 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet cecfaeb2287f4f7db4bee651c8bc4a36 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-cecfaeb2287f4f7db4bee651c8bc4a36
I20260709 12:26:46.833833 23874 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:46.834915 23874 tablet_bootstrap.cc:492] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:46.835446 22232 tablet_copy_source_session.cc:215] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:46.835700 23874 ts_tablet_manager.cc:1403] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 12:26:46.839041 23874 raft_consensus.cc:359] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:46.839859 23874 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:46.840415 23874 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:46.843101 23874 ts_tablet_manager.cc:1434] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:26:46.845304 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-de6d6e7c5d4c484487206e2d8b43cebf received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:46.845688 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-de6d6e7c5d4c484487206e2d8b43cebf on tablet de6d6e7c5d4c484487206e2d8b43cebf with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:46.840390 23877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecfaeb2287f4f7db4bee651c8bc4a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:46.867164 23877 tablet_copy_client.cc:806] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:46.867950 23877 tablet_copy_client.cc:670] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:46.873693 23877 tablet_copy_client.cc:538] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:46.885653 23877 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:46.911127 22070 raft_consensus.cc:1275] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:46.913343 23877 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:46.914099 23846 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:46.914476 23877 tablet_bootstrap.cc:492] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:46.915488 23877 ts_tablet_manager.cc:1403] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.004s
I20260709 12:26:46.918928 23877 raft_consensus.cc:359] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:46.920032 23877 raft_consensus.cc:740] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:46.920748 23877 consensus_queue.cc:260] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:46.924441 23877 ts_tablet_manager.cc:1434] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:46.926771 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-cecfaeb2287f4f7db4bee651c8bc4a36 received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:46.927263 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-cecfaeb2287f4f7db4bee651c8bc4a36 on tablet cecfaeb2287f4f7db4bee651c8bc4a36 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:46.936137 22145 raft_consensus.cc:1275] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:46.937896 23832 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:46.976457 23877 ts_tablet_manager.cc:933] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:46.983263 23877 tablet_copy_client.cc:323] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:46.985960 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 68d18246b3984c719bedcfe7da84c5c5 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:46.986567 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 68d18246b3984c719bedcfe7da84c5c5 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-68d18246b3984c719bedcfe7da84c5c5
I20260709 12:26:46.995489 22232 tablet_copy_source_session.cc:215] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:46.999969 23877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d18246b3984c719bedcfe7da84c5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.016206 23877 tablet_copy_client.cc:806] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:47.016784 23877 tablet_copy_client.cc:670] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:47.020848 23877 tablet_copy_client.cc:538] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:47.032351 23877 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:47.065634 23877 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:47.066865 23877 tablet_bootstrap.cc:492] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:47.067682 23877 ts_tablet_manager.cc:1403] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.036s	user 0.032s	sys 0.002s
I20260709 12:26:47.071048 23877 raft_consensus.cc:359] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:47.072022 23877 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:47.073266 23877 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:47.074460 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:47.080201 23877 ts_tablet_manager.cc:1434] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:26:47.082345 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-68d18246b3984c719bedcfe7da84c5c5 received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:47.082864 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-68d18246b3984c719bedcfe7da84c5c5 on tablet 68d18246b3984c719bedcfe7da84c5c5 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:47.177984 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:47.178764 22141 raft_consensus.cc:606] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:47.181898 22070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "980127ed884f4554a2daf41b92732061"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:47.182658 22070 raft_consensus.cc:606] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:47.187654 23720 raft_consensus.cc:993] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:47.187592 22220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:47.188234 23837 raft_consensus.cc:1081] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:47.188301 22220 raft_consensus.cc:606] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:47.190234 22141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "980127ed884f4554a2daf41b92732061"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:47.190814 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:47.191318 22141 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.191763 22141 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.194662 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:47.195556 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:47.202628 22141 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:47.205641 22141 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:47.206355 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:47.207026 22070 raft_consensus.cc:3055] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:47.207340 22070 raft_consensus.cc:740] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:47.209498 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:47.212268 22220 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.218137 22070 consensus_queue.cc:260] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:47.221860 22220 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:47.224467 22113 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:47.226095 23771 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:47.226672 23771 raft_consensus.cc:697] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:47.227546 23771 consensus_queue.cc:237] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:47.237498 22810 raft_consensus.cc:1217] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:47.239297 22803 raft_consensus.cc:1217] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:47.243336 22070 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.253343 22803 raft_consensus.cc:1217] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:26:47.306491 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 51507.3us
I20260709 12:26:47.311474 23802 raft_consensus.cc:993] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:47.312144 23802 raft_consensus.cc:1081] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:47.319203 22145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51452
I20260709 12:26:47.319830 22145 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.320556 22145 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.323184 22070 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:47.345368 22145 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.347682 22145 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:47.355846 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:47.356627 22803 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.337702 21969 catalog_manager.cc:5697] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.355846 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:47.363942 22220 raft_consensus.cc:3055] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:47.364295 22220 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:47.365340 22220 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.370270 22220 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.373225 23817 raft_consensus.cc:993] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:47.373813 23771 raft_consensus.cc:1081] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:47.369163 22803 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:47.375658 22070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:45000
I20260709 12:26:47.379624 22070 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.380069 22070 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.380537 22112 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:47.381549 23771 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:47.382045 23771 raft_consensus.cc:697] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:47.383055 23771 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.388298 22070 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.396435 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:47.397106 22145 raft_consensus.cc:3055] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:47.397433 22145 raft_consensus.cc:740] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:47.398208 22145 consensus_queue.cc:260] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.402104 22145 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.404455 22220 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:47.409634 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:47.418159 22803 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.410218 22070 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:47.414028 22145 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:47.423364 22036 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:47.426046 22803 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:47.434135 21969 catalog_manager.cc:5697] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.439994 23889 raft_consensus.cc:2804] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:47.446698 23889 raft_consensus.cc:697] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:47.447877 23889 consensus_queue.cc:237] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.468739 21969 catalog_manager.cc:5697] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.535066 22803 raft_consensus.cc:1217] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:26:47.640615 23802 raft_consensus.cc:1064] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:47.642761 23802 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.656647 22803 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:47.659713 22067 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:47.658646 23832 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:47.661444 23846 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:47.662561 22145 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:47.665962 23832 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:47.687119 23887 raft_consensus.cc:1064] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:47.716162 23832 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:47.720201 22145 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:47.731112 23891 raft_consensus.cc:1064] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:47.734403 23887 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.733976 23891 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:47.755460 22803 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:47.757197 23720 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:47.769583 22213 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:47.769583 22145 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:47.789268 22064 raft_consensus.cc:1275] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:47.792028 22213 raft_consensus.cc:1275] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:47.795746 22810 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:47.797333 21969 catalog_manager.cc:5697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:47.803520 23771 consensus_queue.cc:1048] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:47.771299 23891 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:26:47.806964 23889 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:47.808727 23771 consensus_queue.cc:1048] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:47.831173 23720 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:47.842911 22217 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:47.906255 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 47559.8us
I20260709 12:26:47.902042 21967 catalog_manager.cc:5697] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.934655 22141 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:47.991567 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 54862.1us
W20260709 12:26:47.993996 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 122797us
I20260709 12:26:47.995777 23891 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:47.997717 22808 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:47.993081 23886 log.cc:927] Time spent T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:26:48.048197 22220 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:48.050961 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 51162.5us
I20260709 12:26:48.063865 22808 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:48.058378 22073 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:26:48.098384 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 45712us
W20260709 12:26:48.125738 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 68746.8us
W20260709 12:26:48.142352 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 50643.3us
I20260709 12:26:48.141443 23926 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 12:26:48.225883 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 69400.2us
I20260709 12:26:48.249233 22808 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:26:48.227974 23900 log.cc:927] Time spent T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:48.257272 23909 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:48.314069 22141 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.364130 22808 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:48.374244 22064 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:48.382254 23939 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:26:48.412122 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:48.427127 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 191152us
I20260709 12:26:48.454356 22217 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:48.472332 23720 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:48.540889 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 379942us
I20260709 12:26:48.568097 23945 raft_consensus.cc:1064] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
W20260709 12:26:48.578166 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 254183us
I20260709 12:26:48.581028 22067 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:48.610847 23909 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:48.627123 23945 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:48.642692 22806 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:48.650692 22217 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:48.653414 23911 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:48.668780 23914 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:48.671795 23889 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:48.673244 22221 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:48.687007 22139 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:48.686877 23888 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.688787 23923 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:48.699119 23923 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.699666 22808 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.707265 22139 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.731521 22806 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:48.734910 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cecfaeb2287f4f7db4bee651c8bc4a36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:48.745730 23943 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:48.748504 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de6d6e7c5d4c484487206e2d8b43cebf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:48.753908 22221 raft_consensus.cc:2955] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.754333 22810 raft_consensus.cc:2955] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.787662 22808 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:48.791993 23943 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:48.795172 22139 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:48.797683 22217 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.799242 22064 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:48.797753 23945 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:26:48.801990 23923 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:48.793311 23911 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.837059 21967 catalog_manager.cc:5697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.866564 22064 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.951712 23921 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.959338 22073 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.966470 22810 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:48.971701 22064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:48.972393 22064 raft_consensus.cc:606] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:48.975872 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:48.976528 22141 raft_consensus.cc:606] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:48.980139 22139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:48.981285 22139 raft_consensus.cc:606] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:48.983219 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:48.985229 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:48.986043 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:48.994765 23888 raft_consensus.cc:993] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:48.995540 23889 raft_consensus.cc:1081] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:48.997735 22140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:48.998436 22140 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.998855 22140 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.019557 22810 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.044410 22141 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.070755 22140 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:49.084002 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:49.084939 22140 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:49.084681 22064 raft_consensus.cc:3055] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:49.086551 22064 raft_consensus.cc:740] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:49.087493 22064 consensus_queue.cc:260] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:49.085747 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:49.088832 22064 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.089303 22808 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.097607 22064 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:49.099215 22114 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:49.100194 23927 raft_consensus.cc:2804] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:49.100692 23927 raft_consensus.cc:697] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:49.101497 23927 consensus_queue.cc:237] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:49.110329 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet cecfaeb2287f4f7db4bee651c8bc4a36 with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:49.115672 21970 catalog_manager.cc:5697] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.117333 22808 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:49.134635 23963 tablet_replica.cc:333] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:49.135910 23963 raft_consensus.cc:2243] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.147583 23963 raft_consensus.cc:2272] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.162753 23963 ts_tablet_manager.cc:1916] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:49.165793 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet de6d6e7c5d4c484487206e2d8b43cebf with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:49.170624 21967 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 3 to 4, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.188512 21967 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.203186 23927 raft_consensus.cc:993] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:49.204249 23887 raft_consensus.cc:1081] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:49.216635 22217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:49.217376 22217 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.217737 22217 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.221365 21968 catalog_manager.cc:5697] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 3, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.234951 23911 raft_consensus.cc:993] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:49.235802 23771 raft_consensus.cc:1081] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:49.238924 22064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:45000
I20260709 12:26:49.239476 22064 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.239826 22064 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.243003 22141 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:49.247900 22064 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:49.251677 22221 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:49.258786 22808 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:49.259255 22213 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:49.263600 22806 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:49.264207 23887 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:49.265102 22068 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:49.267501 23921 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:49.269330 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:49.269989 22141 raft_consensus.cc:3055] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:49.270287 22141 raft_consensus.cc:740] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:49.271173 22141 consensus_queue.cc:260] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:49.272215 22141 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.275090 22064 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:49.277245 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:49.277901 22213 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.278098 23923 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.278244 22806 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.294178 23963 ts_tablet_manager.cc:1929] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:49.302734 23963 log.cc:1199] T cecfaeb2287f4f7db4bee651c8bc4a36 P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/cecfaeb2287f4f7db4bee651c8bc4a36
I20260709 12:26:49.300469 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68d18246b3984c719bedcfe7da84c5c5 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:49.300689 23921 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:49.296528 22141 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:49.306648 23919 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.311578 21971 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 6 to 7, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.314170 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet cecfaeb2287f4f7db4bee651c8bc4a36 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:49.321871 22036 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:49.322870 23914 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:49.323360 23914 raft_consensus.cc:697] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:49.324204 23914 consensus_queue.cc:237] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:49.327224 22133 tablet_service.cc:1558] Processing DeleteTablet for tablet 68d18246b3984c719bedcfe7da84c5c5 with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:49.333590 22068 raft_consensus.cc:2955] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.333777 22221 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.381024 21971 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 4 to 5, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.383021 23887 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:49.405230 22217 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:49.411087 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:49.411698 22141 raft_consensus.cc:3055] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:49.411980 22141 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:49.412791 22141 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:49.413954 22141 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.416343 22213 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:49.418453 22808 raft_consensus.cc:2955] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:49.421334 22217 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:26:49.426400 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 82442.3us
I20260709 12:26:49.434844 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:49.435510 22072 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.436697 22141 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:26:49.438144 22185 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:49.441686 23921 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:49.442273 23921 raft_consensus.cc:697] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:26:49.453493 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 108750us
I20260709 12:26:49.456779 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 161e19d23ae64fb1919e4e43e3e26bd3 with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:49.457723 23963 tablet_replica.cc:333] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:49.462400 23964 tablet_replica.cc:333] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:49.461897 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 161e19d23ae64fb1919e4e43e3e26bd3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:49.465478 23963 raft_consensus.cc:2243] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.469374 23964 raft_consensus.cc:2243] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.469719 23963 raft_consensus.cc:2272] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.470122 23964 raft_consensus.cc:2272] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.461304 21970 catalog_manager.cc:5697] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 3, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.446098 23921 consensus_queue.cc:237] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:49.481211 23963 ts_tablet_manager.cc:1916] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:49.485591 21968 catalog_manager.cc:5697] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 2 to 3, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 3 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:49.461081 22072 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:26:49.504479 23964 ts_tablet_manager.cc:1916] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:49.509097 23963 ts_tablet_manager.cc:1929] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:49.509618 23963 log.cc:1199] T 161e19d23ae64fb1919e4e43e3e26bd3 P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/161e19d23ae64fb1919e4e43e3e26bd3
I20260709 12:26:49.511366 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 161e19d23ae64fb1919e4e43e3e26bd3 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:49.519030 23964 ts_tablet_manager.cc:1929] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:49.519461 23964 log.cc:1199] T de6d6e7c5d4c484487206e2d8b43cebf P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/de6d6e7c5d4c484487206e2d8b43cebf
I20260709 12:26:49.521132 23964 tablet_replica.cc:333] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:49.521100 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet de6d6e7c5d4c484487206e2d8b43cebf (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:49.522168 23964 raft_consensus.cc:2243] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.522874 23964 raft_consensus.cc:2272] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.525597 23964 ts_tablet_manager.cc:1916] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:49.539098 23964 ts_tablet_manager.cc:1929] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:26:49.539415 23964 log.cc:1199] T 68d18246b3984c719bedcfe7da84c5c5 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/68d18246b3984c719bedcfe7da84c5c5
I20260709 12:26:49.542025 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 68d18246b3984c719bedcfe7da84c5c5 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:49.576251 22808 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:49.577950 23919 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:49.594696 22070 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:49.596511 23917 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:49.744410 22213 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:49.745632 23889 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:49.758093 22140 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:49.760043 23967 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:49.886840 22072 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:49.888023 23921 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:49.898572 22140 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:49.900128 23802 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:50.221740 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:50.262806 22213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:50.263311 22213 raft_consensus.cc:606] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:50.266175 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:50.266675 22141 raft_consensus.cc:606] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:50.269413 22072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:50.269903 22072 raft_consensus.cc:606] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:50.271067 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:50.272225 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:50.272856 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:50.280290 23923 raft_consensus.cc:993] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:50.280824 23923 raft_consensus.cc:1081] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:50.282850 22072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:44992
I20260709 12:26:50.283413 22072 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:50.283663 23967 raft_consensus.cc:993] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:50.283756 22072 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.284334 23967 raft_consensus.cc:1081] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:50.286931 22140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:50.287618 22140 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:50.287972 22140 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.291790 22072 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.295020 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:50.295712 22141 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.296257 22072 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:50.296293 22140 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.297645 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:50.298243 22213 raft_consensus.cc:3055] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:50.298528 22213 raft_consensus.cc:740] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:50.299415 22213 consensus_queue.cc:260] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.300633 22213 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.304174 22141 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:50.305459 22036 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:50.306358 23914 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:50.306913 23914 raft_consensus.cc:697] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:50.308022 22213 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:50.308926 22140 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:50.310380 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:50.310915 22072 raft_consensus.cc:3055] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:50.311182 22072 raft_consensus.cc:740] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:50.311817 22072 consensus_queue.cc:260] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.312778 22072 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.307945 23914 consensus_queue.cc:237] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.310971 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:50.315375 22213 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.319839 22072 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:50.321498 22114 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:50.323081 22213 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:50.323331 23979 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:50.323899 23979 raft_consensus.cc:697] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:50.324750 23979 consensus_queue.cc:237] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.337867 21970 catalog_manager.cc:5697] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.344560 21968 catalog_manager.cc:5697] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.537943 22217 consensus_queue.cc:237] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:50.545019 22140 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:50.546001 22186 consensus_peers.cc:597] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee09151218d04cb69512d91f7b843c32. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.546659 23923 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.547802 22072 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:50.549484 23923 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.555696 23802 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.557601 22140 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.559360 22064 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.573060 22141 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:50.579303 21970 catalog_manager.cc:5697] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.590418 22072 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:50.592386 23938 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:50.593304 22217 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:50.596457 23938 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:26:50.603212 22112 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4321547cceb341b9babe64debb9fb125. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.606907 23938 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.608446 22217 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.617734 22072 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.631966 21971 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.648967 22213 consensus_queue.cc:237] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:50.670428 22186 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3c7f71fea4a4a6d815758ecce7a83cd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.673237 22140 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:50.675345 22064 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:50.675486 23802 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.676990 23943 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.690006 23921 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.692281 22064 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.692999 22140 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.699553 22213 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:50.701812 23914 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.707029 22141 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:50.724112 21970 catalog_manager.cc:5697] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.740981 22139 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:50.743309 23914 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:50.755034 22112 consensus_peers.cc:597] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d7ac68dfb384745935240b56803f52c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.757943 22213 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:50.758397 22064 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:50.760880 23979 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.768312 23979 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.788861 23979 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.791422 22072 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.796061 22213 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.817902 21970 catalog_manager.cc:5697] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 2, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:50.849880 23917 raft_consensus.cc:993] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:50.850422 23919 raft_consensus.cc:1081] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:50.852413 22064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:45000
I20260709 12:26:50.852979 22064 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:50.853341 22064 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.865919 22072 raft_consensus.cc:1275] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:50.867905 23919 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.878021 22064 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.904912 22064 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:50.905350 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:50.905997 22220 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.906267 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:50.906903 22142 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:50.907220 22142 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:50.908033 22142 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.909154 22142 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.913630 22213 raft_consensus.cc:1275] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:50.938146 22220 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:26:50.939873 23938 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:50.943435 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:50.951782 23967 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:50.952347 23967 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:50.953269 23967 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:50.962859 22142 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:26:50.979789 21968 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 6 to 7, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.029996 24008 ts_tablet_manager.cc:933] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:51.032912 24008 tablet_copy_client.cc:323] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:51.035053 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet ee09151218d04cb69512d91f7b843c32 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:51.035840 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet ee09151218d04cb69512d91f7b843c32 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-ee09151218d04cb69512d91f7b843c32
I20260709 12:26:51.040549 24009 ts_tablet_manager.cc:933] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:51.044800 22232 tablet_copy_source_session.cc:215] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:51.050664 24009 tablet_copy_client.cc:323] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:51.052964 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 4321547cceb341b9babe64debb9fb125 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:51.053577 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 4321547cceb341b9babe64debb9fb125 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-4321547cceb341b9babe64debb9fb125
I20260709 12:26:51.055231 24008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee09151218d04cb69512d91f7b843c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.065064 22158 tablet_copy_source_session.cc:215] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:51.070062 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4321547cceb341b9babe64debb9fb125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.120100 24009 tablet_copy_client.cc:806] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:51.120738 24009 tablet_copy_client.cc:670] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:51.125174 24009 tablet_copy_client.cc:538] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:51.130195 24008 tablet_copy_client.cc:806] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:51.130940 24008 tablet_copy_client.cc:670] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:51.138427 24008 tablet_copy_client.cc:538] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:51.140395 24013 ts_tablet_manager.cc:933] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:51.141462 24009 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:51.165844 24008 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:51.166412 24013 tablet_copy_client.cc:323] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:26:51.168324 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet f3c7f71fea4a4a6d815758ecce7a83cd from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:26:51.169016 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet f3c7f71fea4a4a6d815758ecce7a83cd from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-f3c7f71fea4a4a6d815758ecce7a83cd
I20260709 12:26:51.197168 24009 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:51.198695 24009 tablet_bootstrap.cc:492] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:51.199661 24009 ts_tablet_manager.cc:1403] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.058s	user 0.034s	sys 0.008s
I20260709 12:26:51.203168 24009 raft_consensus.cc:359] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:51.204097 24009 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:51.204818 24009 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:51.211531 24009 ts_tablet_manager.cc:1434] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:26:51.215505 22232 tablet_copy_source_session.cc:215] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:51.220830 24013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c7f71fea4a4a6d815758ecce7a83cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.224889 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-4321547cceb341b9babe64debb9fb125 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:51.225461 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-4321547cceb341b9babe64debb9fb125 on tablet 4321547cceb341b9babe64debb9fb125 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:51.239509 24008 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:51.240531 24008 tablet_bootstrap.cc:492] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:51.241856 24008 ts_tablet_manager.cc:1403] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.009s
I20260709 12:26:51.244876 24008 raft_consensus.cc:359] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:51.245743 24008 raft_consensus.cc:740] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:51.246896 24009 ts_tablet_manager.cc:933] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:51.246395 24008 consensus_queue.cc:260] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:51.253367 24008 ts_tablet_manager.cc:1434] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.006s
I20260709 12:26:51.257009 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-ee09151218d04cb69512d91f7b843c32 received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:51.257308 24013 tablet_copy_client.cc:806] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:51.258124 24013 tablet_copy_client.cc:670] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:51.257501 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-ee09151218d04cb69512d91f7b843c32 on tablet ee09151218d04cb69512d91f7b843c32 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:51.260800 24009 tablet_copy_client.cc:323] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:26:51.263054 24013 tablet_copy_client.cc:538] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:51.263126 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 4d7ac68dfb384745935240b56803f52c from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:51.263772 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 4d7ac68dfb384745935240b56803f52c from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-4d7ac68dfb384745935240b56803f52c
I20260709 12:26:51.271598 22158 tablet_copy_source_session.cc:215] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:51.276464 24013 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:51.276628 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7ac68dfb384745935240b56803f52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.295629 24009 tablet_copy_client.cc:806] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:51.296228 24009 tablet_copy_client.cc:670] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:51.311836 24009 tablet_copy_client.cc:538] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:51.322518 24009 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:51.326363 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:51.428769 22806 raft_consensus.cc:1217] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:51.518317 22072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:51.518937 22072 raft_consensus.cc:606] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:51.520882 24009 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:51.521973 24009 tablet_bootstrap.cc:492] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:51.522819 24009 ts_tablet_manager.cc:1403] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.201s	user 0.074s	sys 0.074s
I20260709 12:26:51.524781 24013 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:51.525851 24013 tablet_bootstrap.cc:492] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:51.525864 24009 raft_consensus.cc:359] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:51.526770 24013 ts_tablet_manager.cc:1403] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.251s	user 0.100s	sys 0.107s
I20260709 12:26:51.526907 24009 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:51.527733 24009 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:51.530170 24013 raft_consensus.cc:359] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:51.531154 24013 raft_consensus.cc:740] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:51.531883 24013 consensus_queue.cc:260] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:51.533703 22064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:51.534328 22064 raft_consensus.cc:606] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:51.536861 24009 ts_tablet_manager.cc:1434] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:26:51.537478 22141 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:51.538801 24013 ts_tablet_manager.cc:1434] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:26:51.539031 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-4d7ac68dfb384745935240b56803f52c received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:51.539623 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-4d7ac68dfb384745935240b56803f52c on tablet 4d7ac68dfb384745935240b56803f52c with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:51.540472 24004 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:51.541791 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:51.542505 22142 raft_consensus.cc:606] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:51.544134 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:51.546063 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:51.547115 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:51.546336 22806 raft_consensus.cc:1217] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:51.551095 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-f3c7f71fea4a4a6d815758ecce7a83cd received from {username='slave'} at 127.0.0.1:50756
I20260709 12:26:51.551756 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-f3c7f71fea4a4a6d815758ecce7a83cd on tablet f3c7f71fea4a4a6d815758ecce7a83cd with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:51.571228 23914 raft_consensus.cc:993] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:51.571730 23914 raft_consensus.cc:1081] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:51.573928 22146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:51.597594 22146 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:51.598048 22146 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:51.603084 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 63970us
I20260709 12:26:51.605923 22220 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:51.607123 22146 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.617272 22146 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:51.620100 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:51.621031 22064 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:51.621803 22064 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:51.622794 22064 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.624171 22064 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:51.621559 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 79263.2us
I20260709 12:26:51.636022 22806 raft_consensus.cc:1217] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 12:26:51.637145 22064 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:26:51.639693 22114 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:51.640801 23917 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:51.641670 23917 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:51.642743 23917 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.693450 21970 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 8, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 8 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.694430 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:51.695093 22220 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.703437 22220 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:26:51.736042 23979 raft_consensus.cc:993] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:51.738751 23917 raft_consensus.cc:1081] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:51.741139 22217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:51.741824 22217 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:51.742336 22217 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:51.743853 23967 raft_consensus.cc:993] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:51.744423 24004 raft_consensus.cc:1081] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:51.746301 22213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58424
I20260709 12:26:51.746840 22213 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:51.747164 22213 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.760354 22213 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.762055 22217 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.763489 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:51.763897 22217 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:51.764111 22141 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.768549 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:51.769182 22064 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:51.770891 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:51.771750 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:51.772286 22146 raft_consensus.cc:3055] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:51.772562 22146 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:51.773286 22146 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.773849 22072 raft_consensus.cc:3055] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:51.774191 22072 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:51.774482 22146 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:51.774897 22072 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.776120 22072 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.784118 22072 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:26:51.786027 22188 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:51.786949 23943 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:51.787443 23943 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:51.788270 23943 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.799337 22064 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:26:51.799494 22146 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:26:51.801235 22185 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:51.802068 23921 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:51.802563 23921 raft_consensus.cc:697] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:51.803440 23921 consensus_queue.cc:237] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:51.808838 22213 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:51.800673 22141 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:26:51.823696 24023 raft_consensus.cc:1064] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:51.826822 24023 consensus_queue.cc:237] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:51.850193 22064 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:51.850458 22806 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:51.850385 21968 catalog_manager.cc:5697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 4 to 5, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 5 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.851426 22141 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:51.852401 23943 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:51.853421 23921 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:51.855568 23921 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:51.876585 22808 raft_consensus.cc:1217] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:51.891242 21968 catalog_manager.cc:5697] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 3 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.900350 24023 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:51.906215 22806 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:51.916481 22070 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:51.929013 22141 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:51.935140 21968 catalog_manager.cc:5697] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:51.955870 22220 consensus_queue.cc:237] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:51.961367 22806 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:51.963197 24023 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:51.963606 22141 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:51.964936 23921 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:51.974987 23802 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:51.984745 22806 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:51.987310 22141 raft_consensus.cc:2955] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:51.999653 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee09151218d04cb69512d91f7b843c32 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:52.010468 21967 catalog_manager.cc:5697] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.027678 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet ee09151218d04cb69512d91f7b843c32 with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:52.063696 24034 tablet_replica.cc:333] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:52.072129 24034 raft_consensus.cc:2243] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.072939 24034 raft_consensus.cc:2272] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.075785 24034 ts_tablet_manager.cc:1916] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:52.087427 23802 raft_consensus.cc:1064] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:52.090101 23802 consensus_queue.cc:237] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.092098 24034 ts_tablet_manager.cc:1929] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:52.092522 24034 log.cc:1199] T ee09151218d04cb69512d91f7b843c32 P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/ee09151218d04cb69512d91f7b843c32
I20260709 12:26:52.094202 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet ee09151218d04cb69512d91f7b843c32 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:52.097272 22146 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:52.098102 22806 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:52.099303 23802 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:52.100905 22070 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:52.101895 23943 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:52.105587 24023 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:52.144198 22064 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:52.146400 23917 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:52.159953 23921 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.168784 23979 raft_consensus.cc:1064] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:52.170675 22070 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.171643 23979 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.176095 22213 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:52.178894 22146 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.186456 21967 catalog_manager.cc:5697] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.198169 23938 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:52.241209 22808 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:52.242784 23917 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:52.231956 22806 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.247502 22213 consensus_queue.cc:237] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.248706 22064 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:52.252384 23917 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:52.254339 22064 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:52.256253 23943 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.260555 22810 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:52.263818 23943 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.268296 22213 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:52.275909 23919 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:52.280824 22064 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.272579 23943 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.275228 22810 raft_consensus.cc:2955] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.320068 23917 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.330199 22146 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:52.331019 21970 catalog_manager.cc:5697] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 1 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.331857 24023 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:52.361464 22068 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:52.363384 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet f3c7f71fea4a4a6d815758ecce7a83cd with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51448
I20260709 12:26:52.365559 22141 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:52.377718 23943 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:52.382568 23979 raft_consensus.cc:1064] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:52.385393 23979 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.402361 21957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3c7f71fea4a4a6d815758ecce7a83cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:52.417011 22072 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:52.418088 23802 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:52.418473 24048 tablet_replica.cc:333] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:26:52.419742 24048 raft_consensus.cc:2243] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.427052 23802 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.430537 22220 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.442634 22806 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:52.447957 23979 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:52.452364 22064 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:52.420639 24048 raft_consensus.cc:2272] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.458503 23917 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:52.462221 22810 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.470124 22221 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:52.476497 24048 ts_tablet_manager.cc:1916] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:52.483474 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 61412.7us
I20260709 12:26:52.486884 23917 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:52.503950 21970 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.516161 23919 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.519697 22810 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.529918 22067 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.549535 22070 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.552794 21968 catalog_manager.cc:5697] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.555962 24048 ts_tablet_manager.cc:1929] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:52.556576 24048 log.cc:1199] T f3c7f71fea4a4a6d815758ecce7a83cd P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/f3c7f71fea4a4a6d815758ecce7a83cd
I20260709 12:26:52.568897 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet f3c7f71fea4a4a6d815758ecce7a83cd (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:52.576826 22220 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.580744 22141 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.595238 22070 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:52.597011 22810 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:52.603717 24049 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:52.607810 23919 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:52.616475 24049 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.623835 22141 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.625943 22070 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.632196 22221 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:52.632252 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4321547cceb341b9babe64debb9fb125 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:52.634121 22806 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:52.635543 23919 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.639429 23919 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.645752 23917 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.652547 22808 raft_consensus.cc:2955] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.657653 22810 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.657970 22221 raft_consensus.cc:2955] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.657774 21967 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 5 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.665092 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d7ac68dfb384745935240b56803f52c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:52.675282 21971 catalog_manager.cc:5697] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 3 to 4, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 1 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:52.678952 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:52.678880 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet 4321547cceb341b9babe64debb9fb125 with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:52.691478 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7ac68dfb384745935240b56803f52c with delete_type TABLET_DATA_TOMBSTONED (TS d465f3cb42174eb89615dcd747f9e682 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44986
I20260709 12:26:52.699827 24059 tablet_replica.cc:333] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:26:52.703711 24059 raft_consensus.cc:2243] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.704615 24059 raft_consensus.cc:2272] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.707162 24058 tablet_replica.cc:333] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:52.708374 24058 raft_consensus.cc:2243] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.709297 24058 raft_consensus.cc:2272] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.712013 24059 ts_tablet_manager.cc:1916] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:52.733713 24058 ts_tablet_manager.cc:1916] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:52.741083 24059 ts_tablet_manager.cc:1929] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:52.741668 24059 log.cc:1199] T 4d7ac68dfb384745935240b56803f52c P d465f3cb42174eb89615dcd747f9e682: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/wals/4d7ac68dfb384745935240b56803f52c
I20260709 12:26:52.743273 21958 catalog_manager.cc:5028] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): tablet 4d7ac68dfb384745935240b56803f52c (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:52.753134 24058 ts_tablet_manager.cc:1929] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 12:26:52.753671 24058 log.cc:1199] T 4321547cceb341b9babe64debb9fb125 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/4321547cceb341b9babe64debb9fb125
I20260709 12:26:52.755932 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet 4321547cceb341b9babe64debb9fb125 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:26:52.757138 22221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:52.757730 22221 raft_consensus.cc:606] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:52.760322 22146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:52.760792 22146 raft_consensus.cc:606] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:52.763103 22221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:52.763660 22221 raft_consensus.cc:606] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:52.764858 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:52.766908 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:52.767777 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:52.896817 23802 raft_consensus.cc:993] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:52.897331 23802 raft_consensus.cc:1081] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:52.898995 22146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51452
I20260709 12:26:52.899638 22146 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.900015 22146 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.906118 22146 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.908105 22146 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:52.909237 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:52.909896 22808 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.911129 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:52.911643 22213 raft_consensus.cc:3055] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:52.911931 22213 raft_consensus.cc:740] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:52.912729 22213 consensus_queue.cc:260] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.913975 22213 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.917249 22808 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:52.918694 22112 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:52.919421 23917 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.919871 23917 raft_consensus.cc:697] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:52.920656 23917 consensus_queue.cc:237] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.922430 22213 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:52.930665 21971 catalog_manager.cc:5697] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.953508 23943 raft_consensus.cc:993] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:52.953961 23802 raft_consensus.cc:1081] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:26:52.955590 22070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:44992
I20260709 12:26:52.956205 22070 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.956547 22070 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:52.963330 22070 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.965709 22070 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:52.966100 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:52.966207 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:52.966910 22213 raft_consensus.cc:3055] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:52.966979 22808 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:52.967213 22213 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:52.967949 22213 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.968977 22213 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:52.972332 22808 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:52.973459 22037 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:52.973795 22213 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:52.974265 23914 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:52.974772 23914 raft_consensus.cc:697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:52.975629 23914 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:52.986039 21971 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 3, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.163671 23917 raft_consensus.cc:993] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:53.164115 23979 raft_consensus.cc:1081] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer 7ff8d9fd78c1454cacc77bbc1bfb992e to start an election
I20260709 12:26:53.165812 22808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c"
dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
 from {username='slave'} at 127.0.0.1:44162
I20260709 12:26:53.166290 22808 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:53.166556 22808 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.172188 22808 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:53.174234 22808 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:53.175021 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:53.175173 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:53.175634 22146 raft_consensus.cc:3055] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:53.175690 22221 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.175958 22146 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:53.176663 22146 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:53.177781 22146 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.181972 22221 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:53.183312 22775 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:53.184218 24012 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.184762 24012 raft_consensus.cc:697] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:53.185736 24012 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:53.193140 22146 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:53.198027 21971 catalog_manager.cc:5697] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:53.336323 22808 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:53.337445 23979 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:53.360637 22213 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:53.362118 24067 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:53.547158 22810 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:53.548564 24061 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:53.560686 22221 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:53.563625 23967 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:53.724159 22213 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:53.725456 24012 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:53.736470 22141 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:53.738170 24062 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:53.776741 22070 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:53.788659 22221 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:26:53.789494 22037 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce0cbcda6ab94ef68d36321d19671059. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.788659 22141 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:53.791656 23967 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:53.792809 24061 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:53.801530 23967 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.804872 22141 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.805955 22221 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.808997 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:53.821681 21971 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.828917 22141 consensus_queue.cc:237] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:53.838951 22221 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:53.839221 22070 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:26:53.839399 22112 consensus_peers.cc:597] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2d181824b34483d8653c405c650ec94. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.840929 23979 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:53.842279 24067 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:53.861334 23979 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.867921 22221 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.869335 22070 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.875721 22146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:53.876415 22146 raft_consensus.cc:606] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:53.883340 22070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3726200783e487b9963f5fc73170d31"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:45688
I20260709 12:26:53.889364 21967 catalog_manager.cc:5697] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 3, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.892329 22070 raft_consensus.cc:606] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:53.894145 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:53.895889 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:53.897009 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:53.896998 22070 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:53.928148 22037 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43ce66af87f04e5db12d1d3b0ed6ffd5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.932641 22141 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:53.933133 22221 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:53.934677 23967 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:53.939045 23914 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:53.946033 24067 raft_consensus.cc:993] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:53.946833 24067 raft_consensus.cc:1081] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:53.950307 22221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:53.951332 22221 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:53.952288 22221 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.959220 24061 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.966420 22221 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:53.969642 22221 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:53.969085 22141 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.970202 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:53.972590 22070 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.980429 22070 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:53.983639 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:26:53.984614 22019 auto_rebalancer.cc:629] Failed to schedule move for tablet f3726200783e487b9963f5fc73170d31: Remote error: Service unavailable: leader transfer in progress
I20260709 12:26:53.987406 22146 raft_consensus.cc:3055] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:53.987857 22146 raft_consensus.cc:740] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:53.983134 22188 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:53.990475 23943 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.969143 22213 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:26:53.989231 22146 consensus_queue.cc:260] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:53.991080 21971 catalog_manager.cc:5697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index -1 to 5, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.003670 23943 raft_consensus.cc:697] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:54.004709 23943 consensus_queue.cc:237] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:53.992038 22146 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.006254 22070 raft_consensus.cc:1240] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.012259 22146 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:26:54.032028 21968 catalog_manager.cc:5697] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:54.040994 23914 raft_consensus.cc:993] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:54.041457 23967 raft_consensus.cc:1081] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:54.043304 22146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3726200783e487b9963f5fc73170d31"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51462
I20260709 12:26:54.043883 22146 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:54.044212 22146 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.064508 22146 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:54.067036 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:54.067209 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:54.067929 22213 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.067929 22070 raft_consensus.cc:3055] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.068506 22070 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:26:54.069445 22070 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:54.070994 22070 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.073479 22146 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:54.075727 22213 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:54.077608 22113 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:54.078502 24084 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.078536 22070 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:54.079183 24084 raft_consensus.cc:697] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:54.080158 24084 consensus_queue.cc:237] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:54.091740 21968 catalog_manager.cc:5697] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.261166 24093 ts_tablet_manager.cc:933] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:54.263055 24093 tablet_copy_client.cc:323] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:54.265314 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet ce0cbcda6ab94ef68d36321d19671059 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:54.265877 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet ce0cbcda6ab94ef68d36321d19671059 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-ce0cbcda6ab94ef68d36321d19671059
I20260709 12:26:54.273031 22083 tablet_copy_source_session.cc:215] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:54.276608 24093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0cbcda6ab94ef68d36321d19671059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.293529 24093 tablet_copy_client.cc:806] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:54.294222 24093 tablet_copy_client.cc:670] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:54.298241 24093 tablet_copy_client.cc:538] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:54.308061 24093 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:54.334182 24093 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.335233 24093 tablet_bootstrap.cc:492] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:54.335937 24093 ts_tablet_manager.cc:1403] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.028s	user 0.025s	sys 0.002s
I20260709 12:26:54.339459 24093 raft_consensus.cc:359] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:54.340332 24093 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:54.340999 24093 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:54.345408 24093 ts_tablet_manager.cc:1434] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:54.349061 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-ce0cbcda6ab94ef68d36321d19671059 received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:54.349529 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-ce0cbcda6ab94ef68d36321d19671059 on tablet ce0cbcda6ab94ef68d36321d19671059 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:54.355271 24093 ts_tablet_manager.cc:933] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
I20260709 12:26:54.366230 24093 tablet_copy_client.cc:323] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.65:38979
I20260709 12:26:54.367614 22083 tablet_copy_service.cc:140] P d465f3cb42174eb89615dcd747f9e682: Received BeginTabletCopySession request for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:49866)
I20260709 12:26:54.368094 22083 tablet_copy_service.cc:161] P d465f3cb42174eb89615dcd747f9e682: Beginning new tablet copy session on tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:49866: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-43ce66af87f04e5db12d1d3b0ed6ffd5
I20260709 12:26:54.376070 22083 tablet_copy_source_session.cc:215] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:54.378724 24093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.392216 24093 tablet_copy_client.cc:806] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:54.392745 24093 tablet_copy_client.cc:670] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:54.395768 24093 tablet_copy_client.cc:538] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:54.403208 24093 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:54.405153 22064 raft_consensus.cc:1275] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.409670 23943 consensus_queue.cc:1048] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.410534 24096 ts_tablet_manager.cc:933] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:54.567238 24096 tablet_copy_client.cc:323] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
W20260709 12:26:54.569698 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 92256.6us
I20260709 12:26:54.592212 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet a2d181824b34483d8653c405c650ec94 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:26:54.596657 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet a2d181824b34483d8653c405c650ec94 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-a2d181824b34483d8653c405c650ec94
I20260709 12:26:54.610934 22221 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.613739 24067 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.628106 24093 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.629282 24093 tablet_bootstrap.cc:492] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:54.631274 24093 ts_tablet_manager.cc:1403] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.228s	user 0.043s	sys 0.084s
I20260709 12:26:54.634892 22810 raft_consensus.cc:1217] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:26:54.773275 22146 raft_consensus.cc:1275] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:54.775183 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 55957.3us
I20260709 12:26:54.827927 23802 consensus_queue.cc:1048] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:54.862975 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 161364us
W20260709 12:26:54.884546 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 67538.6us
W20260709 12:26:54.906247 24110 log.cc:927] Time spent T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:26:54.927239 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 147676us
I20260709 12:26:54.929478 22064 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:54.937222 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 52757us
W20260709 12:26:54.938728 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 53417.5us
W20260709 12:26:54.940145 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 50342.9us
I20260709 12:26:54.954035 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:54.955544 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 47095.8us
I20260709 12:26:54.964241 22158 tablet_copy_source_session.cc:215] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:54.968317 24085 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:54.978823 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 59768.9us
I20260709 12:26:54.909749 24093 raft_consensus.cc:359] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:26:55.026522 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 87106.5us
W20260709 12:26:55.029757 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 96119.3us
I20260709 12:26:55.002106 24093 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
W20260709 12:26:55.194378 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 137703us
W20260709 12:26:55.194624 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 164165us
W20260709 12:26:55.198778 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 141863us
I20260709 12:26:55.061713 24093 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:55.240885 24093 ts_tablet_manager.cc:1434] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.609s	user 0.013s	sys 0.017s
W20260709 12:26:55.241242 24093 ts_tablet_manager.cc:1467] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Tablet startup took 609ms
I20260709 12:26:55.247712 24096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d181824b34483d8653c405c650ec94. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:55.327600 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 131358us
W20260709 12:26:55.241568 24093 ts_tablet_manager.cc:1469] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Trace:
0709 12:26:54.353091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.353237 (+   146us) service_pool.cc:224] Handling call
0709 12:26:54.355592 (+  2355us) ts_tablet_manager.cc:934] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979)
0709 12:26:54.377635 (+ 22043us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:54.385708 (+  8073us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:54.385822 (+   114us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:54.391473 (+  5651us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:54.391698 (+   225us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:54.391979 (+   281us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:54.392037 (+    58us) inbound_call.cc:177] Queueing success response
0709 12:26:54.402752 (+ 10715us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:54.631695 (+228943us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:54.632280 (+   585us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:54.739938 (+107658us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":241,"mutex_wait_us":22721,"raft.queue_time_us":18986,"tablet-copy.queue_time_us":1423,"tablet-download-pool.queue_time_us":118,"tablet-download-pool.run_cpu_time_us":824,"tablet-download-pool.run_wall_time_us":2471,"thread_start_us":11530,"threads_started":2}
I20260709 12:26:55.602016 24139 raft_consensus.cc:1064] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
W20260709 12:26:55.714435 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 47556.9us
I20260709 12:26:55.715309 22810 raft_consensus.cc:1217] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:26:55.759677 22083 tablet_copy_service.cc:342] P d465f3cb42174eb89615dcd747f9e682: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-43ce66af87f04e5db12d1d3b0ed6ffd5 received from {username='slave'} at 127.0.0.1:49866
I20260709 12:26:55.760437 22083 tablet_copy_service.cc:434] P d465f3cb42174eb89615dcd747f9e682: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-43ce66af87f04e5db12d1d3b0ed6ffd5 on tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:55.632886 24139 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:26:55.894733 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 126184us
I20260709 12:26:55.901695 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44162 (request call id 482) took 1491 ms. Trace:
I20260709 12:26:55.902191 24096 rpcz_store.cc:276] 0709 12:26:54.409752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.409915 (+   163us) service_pool.cc:224] Handling call
0709 12:26:54.410885 (+   970us) ts_tablet_manager.cc:934] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
0709 12:26:55.031719 (+620834us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:55.817717 (+785998us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:55.817918 (+   201us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:55.900512 (+ 82594us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:55.900984 (+   472us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:55.901327 (+   343us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:55.901454 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":288,"tablet-copy.queue_time_us":137,"thread_start_us":155282,"threads_started":1}
I20260709 12:26:55.934408 24096 tablet_copy_client.cc:806] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:55.935173 24096 tablet_copy_client.cc:670] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
W20260709 12:26:55.946437 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 48815.2us
I20260709 12:26:55.948030 22221 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:55.950204 23914 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:55.964993 22142 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:55.968061 23914 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:55.968801 24096 tablet_copy_client.cc:538] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:55.979178 22810 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:55.982165 24148 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:56.030181 24096 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:26:56.064024 24147 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.065793 22142 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.082878 23914 raft_consensus.cc:1064] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:26:56.086411 23914 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:56.106089 22810 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.117151 21968 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.127664 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:26:56.128520 22142 raft_consensus.cc:606] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Received request to transfer leadership to TS ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:56.128630 22221 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.133425 22218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:56.134145 22218 raft_consensus.cc:606] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:56.151362 22218 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:56.158730 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:56.166971 22806 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:56.168397 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:56.168274 23967 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:26:56.170588 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:56.178954 24147 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:56.185791 22140 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:56.187594 24147 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:56.279598 24061 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.283172 22221 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.283659 22806 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.316654 24131 raft_consensus.cc:993] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:56.319136 24067 raft_consensus.cc:1081] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Signalling peer ecc1814bfd604baa9cc66be8c02c5cfa to start an election
I20260709 12:26:56.371989 22218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
 from {username='slave'} at 127.0.0.1:58436
I20260709 12:26:56.372628 22218 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:56.372970 22218 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.403254 22218 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:56.406165 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:56.406865 22140 raft_consensus.cc:3055] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:56.407253 22140 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:56.406867 22142 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.408151 22140 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:56.409387 22140 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:56.413686 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56614.3us
I20260709 12:26:56.433172 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:26:56.433846 22810 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.447502 22218 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:56.461320 22140 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:26:56.467847 22185 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:56.469205 24108 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:56.469717 24108 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:56.470628 24108 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:56.460708 22810 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:26:56.466050 24096 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.492200 24096 tablet_bootstrap.cc:492] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:26:56.493100 24096 ts_tablet_manager.cc:1403] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.486s	user 0.028s	sys 0.006s
I20260709 12:26:56.498725 24096 raft_consensus.cc:359] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:56.499625 24096 raft_consensus.cc:740] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:26:56.500298 24096 consensus_queue.cc:260] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:56.505960 24096 ts_tablet_manager.cc:1434] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:26:56.527558 24119 raft_consensus.cc:993] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: : Instructing follower 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:56.528165 24119 raft_consensus.cc:1081] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Signalling peer 67742f291ab04f8b8335d3919cf2d1f7 to start an election
I20260709 12:26:56.578680 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-a2d181824b34483d8653c405c650ec94 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:26:56.579227 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-a2d181824b34483d8653c405c650ec94 on tablet a2d181824b34483d8653c405c650ec94 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:26:56.581249 24164 log.cc:927] Time spent T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:56.588820 21970 catalog_manager.cc:5697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 5 to 6, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:56.608248 22140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:51452
I20260709 12:26:56.608927 22140 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:56.609295 22140 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.621716 22068 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:56.634721 22810 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:56.639212 24139 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:56.646112 22140 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:56.651654 24148 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.653381 22810 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:56.695842 22139 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:56.705596 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:56.706198 22068 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.713809 22068 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:26:56.716008 22114 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:56.717042 24117 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:56.717567 24117 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:26:56.718511 24117 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:56.726961 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce0cbcda6ab94ef68d36321d19671059 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:56.731540 24147 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:56.732614 21968 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: config changed from index 5 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:56.735278 21971 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 2 to 3, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 3 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:56.770742 21958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43903.5us
W20260709 12:26:57.499047 22114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.009s	sys 0.006s
W20260709 12:26:57.499445 22114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.009s	sys 0.006s
W20260709 12:26:57.764884 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:57.765781 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:57.872447 22002 debug-util.cc:398] Leaking SignalData structure 0x7b0800039d40 after lost signal to thread 20920
W20260709 12:26:57.873679 22002 debug-util.cc:398] Leaking SignalData structure 0x7b0800038600 after lost signal to thread 22005
I20260709 12:26:57.904768 24170 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:57.905521 24170 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:57.928906 24170 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:57.929538 24170 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:57.930039 24170 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:57.952854 24170 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:57.953502 24170 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:57.961241 24169 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:57.961990 24169 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:57.954051 24170 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:57.997123 24170 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.044468 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 413) took 1231 ms. Trace:
I20260709 12:26:58.045074 22142 rpcz_store.cc:276] 0709 12:26:56.812750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.043521 (+1230771us) service_pool.cc:224] Handling call
0709 12:26:58.043916 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.044122 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.044149 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:58.044192 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:58.044222 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.044275 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.044400 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.053622 24171 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.057516 24173 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.058224 24173 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.060900 24173 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.061410 24173 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.061897 24173 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.064003 24173 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.064525 24173 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.065044 24173 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.067312 24173 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.067842 24173 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.068364 24173 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:58.070889 24173 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.071439 24173 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.071908 24173 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.074052 24173 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.080336 24168 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.081126 24168 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.084187 24170 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.084951 24170 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.087118 24172 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.087249 24170 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.084313 24173 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.090936 24173 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.091743 24170 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.092336 24170 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.093191 24173 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.093768 24173 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.119966 24170 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.120600 24170 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.121096 24170 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.087965 24172 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.126037 24169 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.126711 24169 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.127192 24169 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.127815 24172 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.128291 24172 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.128706 24172 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.094278 24173 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.054414 24171 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.131503 24168 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.134626 24168 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.129179 24169 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.132299 24170 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.135386 24173 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.135258 24171 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.132573 24172 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.135283 24168 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.135855 24170 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.136801 24170 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.138049 24168 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.138629 24168 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.138896 24170 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.139498 24170 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.130018 24148 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.140019 24170 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.140859 24148 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.141263 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 414) took 1322 ms. Trace:
I20260709 12:26:58.141682 22139 rpcz_store.cc:276] 0709 12:26:56.818485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.140149 (+1321664us) service_pool.cc:224] Handling call
0709 12:26:58.140453 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.140847 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.140879 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:58.141001 (+   122us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:58.141046 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.141103 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.141211 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.139132 24168 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.143309 24148 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.143316 24170 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.150560 24170 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.151192 24170 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.154407 24148 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.155004 24148 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.156908 24168 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.158006 24148 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.159688 24115 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.160280 24115 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.162814 24115 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.167047 24170 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.168113 24173 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.168725 24173 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:58.170246 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.171981 24173 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.172547 24139 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.173179 24139 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.176824 24180 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.178046 24180 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.179003 24174 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.182441 24174 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.185588 24174 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.183175 24139 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.182196 24172 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.189867 24172 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:57.568120 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:58.192286 24172 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.169942 24177 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.193903 24177 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.196563 24177 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.189054 22065 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.188091 24180 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.186401 21971 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46396 (request call id 325) took 1566 ms. Trace:
W20260709 12:26:58.215327 22113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.260s	user 0.012s	sys 0.019s
W20260709 12:26:58.215690 22113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.012s	sys 0.019s
I20260709 12:26:58.216867 24174 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.217448 24174 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.215161 24114 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.218865 24114 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.220018 24170 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.220245 24169 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.220552 24170 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.220723 24169 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.221640 24168 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.222651 24170 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.223937 24170 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.207597 21971 rpcz_store.cc:276] 0709 12:26:56.619580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.622618 (+  3038us) service_pool.cc:224] Handling call
0709 12:26:58.186327 (+1563709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:56.738356 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:56.738902 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:56.738935 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:26:56.738955 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:56.739271 (+   316us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:56.739321 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:56.739350 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:56.739536 (+   186us) tablet.cc:701] Row locks acquired
0709 12:26:56.739552 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:56.739693 (+   141us) write_op.cc:270] Start()
0709 12:26:56.739805 (+   112us) write_op.cc:276] Timestamp: P: 1783600016739638 usec, L: 0
0709 12:26:56.739830 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:26:56.740444 (+   614us) log.cc:844] Serialized 536 byte log entry
0709 12:26:56.743967 (+  3523us) op_driver.cc:464] REPLICATION: finished
0709 12:26:56.782067 (+ 38100us) write_op.cc:301] APPLY: starting
0709 12:26:56.782160 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:56.782257 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:56.788558 (+  6301us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:56.788832 (+   274us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:56.789407 (+   575us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:56.789457 (+    50us) write_op.cc:312] APPLY: finished
0709 12:26:56.791605 (+  2148us) log.cc:844] Serialized 23 byte log entry
0709 12:26:56.796781 (+  5176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:56.796868 (+    87us) write_op.cc:454] Released schema lock
0709 12:26:56.796917 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:56.800211 (+  3294us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:56.800244 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11829,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":37894,"apply.run_cpu_time_us":1862,"apply.run_wall_time_us":18076,"num_ops":1,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2347,"prepare.run_wall_time_us":2346,"replication_time_us":4037}]]}
I20260709 12:26:58.225675 24170 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.226946 24169 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.227701 24174 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.222215 24168 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.228284 24170 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.228343 24174 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.229117 24174 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.228055 24114 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.256865 24114 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.257392 24114 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.259281 24175 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.259684 24114 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.259869 24175 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.262013 24174 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.262131 24175 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.260246 24114 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.246141 24139 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.246060 24170 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.266618 24172 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.276690 24172 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.278132 24178 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.279253 24109 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.279553 24178 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.252242 24169 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.280553 24139 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.282090 24173 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.282078 24180 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.271864 24114 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.344019 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.283459 24109 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.283195 24170 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.308713 24169 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.345579 24139 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.322722 22140 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.343565 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.323714 24172 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.351408 22067 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:58.365432 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:51452 (request call id 1541) took 1835 ms. Trace:
I20260709 12:26:58.342779 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.343369 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.358415 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.343108 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.337918 24126 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.339244 24168 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.368685 24139 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.375363 22073 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:58.375516 24168 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.367280 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.375926 24183 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.376368 22068 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.376720 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.376946 24168 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.377364 22064 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.378098 24182 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.383428 24139 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.367480 22070 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.366036 22140 rpcz_store.cc:276] 0709 12:26:56.530094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.608122 (+ 78028us) service_pool.cc:224] Handling call
0709 12:26:58.365365 (+1757243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.367446 22069 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.368432 24174 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.373169 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.374886 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.375550 24176 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.383683 24168 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.317301 24177 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.386453 24184 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.390842 24174 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.392377 24178 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.392724 24160 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.392844 24170 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.376475 24183 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.413777 24185 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.346172 24180 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.410063 24169 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.422376 24109 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.422937 24190 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.389389 22071 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.384701 24126 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.400472 24176 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.423514 24190 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.424847 24139 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.425279 24176 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.394464 24061 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.425817 24190 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.426076 24061 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.415614 24115 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.427310 24115 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.428212 24061 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.378662 24182 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.366534 24173 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.405056 24114 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.407517 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.412670 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.413221 24175 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.412946 24184 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.393874 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.417603 24183 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.418879 24181 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.419008 24174 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.413884 24160 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.419988 24185 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.431173 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.434896 24189 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.435768 24186 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.437800 24126 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.432274 24178 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.414278 24172 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.439718 24191 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.433142 22067 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.472844 22071 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:26:58.482566 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.425817 24176 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.501005 22069 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.429301 24115 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.502280 24174 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.502429 24178 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.502873 24183 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.502319 24172 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.503746 24185 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.504393 24114 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.523398 24114 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.524367 24172 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.524878 24160 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.483340 24186 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.525774 24114 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.505610 24182 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.526078 24174 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.528230 24174 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.506922 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.439846 24175 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.529449 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.530375 24175 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.508466 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.530671 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.509104 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.442373 24124 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.451515 24190 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.442663 24181 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.509583 24191 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.514658 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.515486 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.522944 24183 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.440675 24179 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.543498 24124 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.544384 24179 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.545722 24183 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.545817 24124 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.546373 24124 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.517115 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.429616 24177 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.518889 24178 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.541872 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.488519 24126 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.537865 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.543677 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.442667 24108 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.548200 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.547410 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.568384 22806 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:58.569236 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.515524 24184 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.551457 22146 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:26:58.563241 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.564298 22142 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:26:58.549553 24181 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.549991 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.547840 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.547017 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.546624 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.549891 24186 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.568533 22805 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.541850 24195 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.508153 24189 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.576947 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.572630 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.578145 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.578543 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.578771 22221 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:58.579403 22806 raft_consensus.cc:2410] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:26:58.550151 24177 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.577572 22217 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:58.577586 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.548511 22807 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:58.581228 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.581357 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.586519 22220 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:58.587302 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.578904 24178 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.588053 24178 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.581588 24173 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.585975 22114 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:58.590116 24178 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.590226 22114 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:58.591468 24169 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:58.591912 24169 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.592291 24169 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.592538 24170 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.592949 24170 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.593278 24170 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.591115 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:58.578291 22066 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:26:58.547202 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.581789 24195 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.602970 22801 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:58.584271 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.550763 24190 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.603861 22112 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:58.605093 22112 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:58.606314 24129 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:58.584178 24168 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.572322 24108 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.607151 24168 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.606827 24160 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.608923 24160 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.584847 24117 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.585320 24193 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.570399 24183 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.546569 24179 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.516624 24176 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.609659 24117 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.586565 22145 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:26:58.594937 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.611343 22065 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:26:58.612167 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.595855 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.582195 24191 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.572888 24126 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.546861 24124 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.599732 24180 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.586340 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.606753 24129 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:58.609316 24160 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.610083 21970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 327) took 1948 ms. Trace:
I20260709 12:26:58.614882 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.628931 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.630021 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.609727 24193 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.609881 24183 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.632447 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.638890 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.642041 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.644107 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.640534 22145 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:58.639818 21970 rpcz_store.cc:276] 0709 12:26:56.661365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.662701 (+  1336us) service_pool.cc:224] Handling call
0709 12:26:58.610008 (+1947307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14350,"reported_tablets":3}
I20260709 12:26:58.648654 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.672945 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:26:58.675961 22002 debug-util.cc:398] Leaking SignalData structure 0x7b0800382360 after lost signal to thread 22097
I20260709 12:26:58.670922 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.600700 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.697111 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.705885 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.711798 22066 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:26:58.711004 22802 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:26:58.698679 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:58.698097 22002 debug-util.cc:398] Leaking SignalData structure 0x7b08003821a0 after lost signal to thread 22098
I20260709 12:26:58.699067 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.715619 22139 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:58.703473 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.716199 22065 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:26:58.716820 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.703691 24124 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.703971 24183 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:58.713444 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 122387us
I20260709 12:26:58.646526 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.705874 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.701828 24179 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:58.724220 24179 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.717905 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.700292 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.727061 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.727875 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.728642 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.729316 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.729456 22221 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:58.718758 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.639922 24129 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.705536 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.724390 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.717432 24132 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.734799 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.734547 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.737257 24189 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.734242 24179 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.721079 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.704984 24126 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.730700 22213 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:26:58.738919 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.695291 24191 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.735177 24132 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.740542 24193 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.740859 24132 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.731339 22140 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:58.731256 22147 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:58.734422 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.734484 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.742259 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.740065 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.742717 22214 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:58.728430 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.745878 22114 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:58.747673 24195 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.748340 24193 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:58.747714 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.748888 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.749414 22215 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:58.749783 22222 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:26:58.758172 24168 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.759281 24170 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:58.760530 22139 raft_consensus.cc:2393] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:58.760264 24168 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.776244 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.776954 22221 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:58.777936 22213 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:58.770828 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.759549 22114 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:58.743920 22148 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:26:58.820237 24108 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.745339 24191 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:58.778977 24168 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:58.910264 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.904973 21967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38180 (request call id 206) took 2114 ms. Trace:
I20260709 12:26:58.826313 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.951974 22038 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:26:58.978230 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 218782us
I20260709 12:26:58.893481 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.868628 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:58.823378 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.980611 22038 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:58.869787 24188 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:26:58.870499 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 264551us
I20260709 12:26:58.921892 21970 catalog_manager.cc:5697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 6, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 6 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:58.822898 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.924930 24170 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:26:58.920897 22002 debug-util.cc:398] Leaking SignalData structure 0x7b08003777a0 after lost signal to thread 22172
I20260709 12:26:58.895678 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:58.904820 21968 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46372 (request call id 297) took 2175 ms. Trace:
I20260709 12:26:58.930840 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:58.922675 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.980614 22773 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:58.982575 22038 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:58.984344 22220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:59562
W20260709 12:26:59.039218 22002 debug-util.cc:398] Leaking SignalData structure 0x7b0800333fa0 after lost signal to thread 22246
I20260709 12:26:59.042340 22140 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
W20260709 12:26:59.043066 22002 debug-util.cc:398] Leaking SignalData structure 0x7b08001009e0 after lost signal to thread 22834
I20260709 12:26:58.977012 21967 rpcz_store.cc:276] 0709 12:26:56.786303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.786433 (+   130us) service_pool.cc:224] Handling call
0709 12:26:58.588895 (+1802462us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b54003f70d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c670090 00007ff18c70ef3a 00007ff1924c4e9c 00007ff1925c304e 00007ff190a842a4 00007ff190a84232 00007ff190a84161 00007ff190a840dc 00007ff190a83392 00007ff18aa4148c 00007ff18aa408c6
0709 12:26:58.700737 (+111842us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b54002e0090. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e2640 00007ff1924b9846 00007ff1925c390e 00007ff190a842a4 00007ff190a84232 00007ff190a84161 00007ff190a840dc 00007ff190a83392 00007ff18aa4148c 00007ff18aa408c6
0709 12:26:58.900510 (+199773us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30981,"reported_tablets":1,"spinlock_wait_cycles":221646976}
I20260709 12:26:59.039882 22220 raft_consensus.cc:606] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
W20260709 12:26:59.044162 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 64700.5us
I20260709 12:26:58.836853 22146 raft_consensus.cc:2955] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:26:59.040082 22808 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
W20260709 12:26:59.046348 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 63839.6us
I20260709 12:26:59.044448 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:58.937800 24195 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.955042 24190 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:58.938218 24186 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:58.824741 24117 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:58.936582 24189 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:59.052899 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.051373 24187 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:59.068589 24187 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.068982 24187 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.069802 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.070555 24061 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.070955 24061 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.071305 24061 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.041968 24172 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:59.074302 24172 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.074692 24172 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:59.076356 22036 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.077313 22036 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.078039 24194 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.078403 24177 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:59.078826 24177 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.079228 24177 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.081036 24196 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.081833 24181 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:59.082242 24181 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:59.082610 24181 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:59.078425 24194 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.083207 24194 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.083770 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.072079 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.085192 22036 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:58.895568 24114 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.089617 22036 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:58.982800 24193 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.052802 22802 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:59.078743 24124 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:26:59.055367 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 282536us
I20260709 12:26:59.103628 22773 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:58.980219 24168 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.057405 22141 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:59.054059 24126 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:59.059832 24195 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.063464 24160 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.052313 24188 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:59.066336 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 158481us
I20260709 12:26:59.066713 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.066875 24189 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.067476 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.067622 24186 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.142006 24186 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:58.938172 24178 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:26:59.048777 22002 debug-util.cc:398] Leaking SignalData structure 0x7b0800100a20 after lost signal to thread 22835
W20260709 12:26:59.143077 22002 debug-util.cc:398] Leaking SignalData structure 0x7b080032e060 after lost signal to thread 24137
I20260709 12:26:59.142871 24178 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.144407 24061 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.144821 24178 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.117271 24126 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.147892 24188 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.148094 24126 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.037847 24197 raft_consensus.cc:2804] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.095322 22806 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:59.096063 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.150586 22810 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:26:59.045347 22114 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.100047 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.038960 21968 rpcz_store.cc:276] 0709 12:26:56.729612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.729781 (+   169us) service_pool.cc:224] Handling call
0709 12:26:58.904753 (+2174972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:56.743946 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:56.744422 (+   476us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:56.782266 (+ 37844us) write_op.cc:435] Acquired schema lock
0709 12:26:56.782285 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:56.782684 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:56.782728 (+    44us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:56.782750 (+    22us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:56.782934 (+   184us) tablet.cc:701] Row locks acquired
0709 12:26:56.782950 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:56.783106 (+   156us) write_op.cc:270] Start()
0709 12:26:56.783227 (+   121us) write_op.cc:276] Timestamp: P: 1783600016783056 usec, L: 0
0709 12:26:56.783253 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:26:58.136170 (+1352917us) log.cc:844] Serialized 536 byte log entry
0709 12:26:58.137459 (+  1289us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003f70d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c701e28 00007ff19013c581 00007ff19013bd58 00007ff1901409f1 00007ff1901409a9 00007ff190140939 00007ff190140901 00007ff19013fb2d 0000000000388634 0000000000388479
0709 12:26:58.668067 (+530608us) op_driver.cc:464] REPLICATION: finished
0709 12:26:58.718961 (+ 50894us) write_op.cc:301] APPLY: starting
0709 12:26:58.719082 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:58.719187 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:58.719206 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:58.719405 (+   199us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:58.719576 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:58.719616 (+    40us) write_op.cc:312] APPLY: finished
0709 12:26:58.719846 (+   230us) log.cc:844] Serialized 23 byte log entry
0709 12:26:58.720025 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:58.721788 (+  1763us) write_op.cc:454] Released schema lock
0709 12:26:58.721834 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:58.722175 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:58.722202 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":22668,"apply.run_cpu_time_us":1567,"apply.run_wall_time_us":3191,"num_ops":1,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":29881,"prepare.run_wall_time_us":1393650,"replication_time_us":1853852,"spinlock_wait_cycles":3103181696}]]}
I20260709 12:26:59.106245 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.090585 24148 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:59.104838 22773 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:26:59.164561 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 59790.9us
I20260709 12:26:59.102732 22037 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:59.116019 22213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:26:59.165681 22213 raft_consensus.cc:606] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:59.116324 24176 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.116822 22207 tablet_service.cc:1558] Processing DeleteTablet for tablet ce0cbcda6ab94ef68d36321d19671059 with delete_type TABLET_DATA_TOMBSTONED (TS ecc1814bfd604baa9cc66be8c02c5cfa not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58410
I20260709 12:26:59.117345 24122 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:59.175839 24199 log.cc:927] Time spent T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:26:59.175868 24122 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:59.176590 24122 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.133654 24195 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.178920 24203 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:59.135757 24160 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.119432 22776 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.140156 24189 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:26:59.152243 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 107003us
I20260709 12:26:59.179630 24203 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.180292 24203 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:59.171756 24131 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.148798 22142 raft_consensus.cc:2393] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:26:59.181824 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 62456.1us
I20260709 12:26:59.099771 24196 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.146399 24061 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.169595 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:59.170362 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 67877.9us
I20260709 12:26:59.181269 22114 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.097827 24193 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:26:59.182088 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 94534.3us
W20260709 12:26:59.148423 24169 consensus_meta.cc:287] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.556s	user 0.015s	sys 0.002s
I20260709 12:26:59.184382 22776 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:59.173496 24190 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.196082 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:59.185057 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 90534.2us
I20260709 12:26:59.186151 22773 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:59.195413 22776 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.151891 24197 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.190634 22037 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:59.191495 22114 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.191865 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:59.163394 24148 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.200800 24148 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.200922 24170 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.201215 24188 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.195039 24182 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.201359 24170 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.202162 24170 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.202368 24183 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:59.202857 24183 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.203243 24183 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:59.185904 24131 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.163086 24171 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.197575 22114 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.198412 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:59.193301 24160 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:59.109969 24124 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.196327 24169 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.209959 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.207410 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.205426 22776 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:59.193472 24193 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.210242 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:59.186043 24176 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:59.195228 24190 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:59.239197 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.214144 22145 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:26:59.214444 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.094625 24114 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.199481 24197 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.215160 22776 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.199368 24175 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:59.209187 24131 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.272450 24114 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.218329 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.213398 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.213984 24171 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.196985 24132 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.224021 22143 raft_consensus.cc:2393] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:59.206732 22038 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:26:59.220012 24160 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.181630 24129 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.264431 24190 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.230777 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.224603 24176 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.219740 24174 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:59.252872 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:26:59.265205 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 64361.3us
I20260709 12:26:59.265666 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.271358 24124 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:26:59.276292 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 61214.5us
I20260709 12:26:59.283759 24171 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.305207 22144 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:59.278057 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 80741.6us
I20260709 12:26:59.305831 22148 raft_consensus.cc:1240] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:59.284855 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 84031.9us
I20260709 12:26:59.231469 24191 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.249791 24117 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.324335 24169 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.294436 24176 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.327855 24129 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.331387 22036 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:59.332873 24061 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.333410 24177 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.333600 24148 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.289816 24180 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.287889 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.238978 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.238879 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.291258 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.336930 22222 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:26:59.294445 22037 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:59.296213 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.299211 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.300855 22147 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:59.286888 24184 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:59.340662 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 46291.6us
I20260709 12:26:59.338457 22140 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:26:59.343366 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:59.345937 22037 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:59.347193 24173 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:59.347581 24173 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.347965 24173 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:59.348747 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 74354.9us
I20260709 12:26:59.353897 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.347401 22037 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:59.286103 24205 tablet_replica.cc:333] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:26:59.310493 24196 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.313408 24172 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.315719 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.289346 24160 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.318569 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.319574 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.321460 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.381348 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.348594 24184 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.339406 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.360917 22037 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:59.361160 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.384961 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.336436 24117 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:59.340935 24180 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:59.367518 24188 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.368546 24061 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.390739 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.391368 22804 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:26:59.281517 24187 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:26:59.387118 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.371667 24177 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.372447 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:59.375675 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.376171 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.377056 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.377696 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:26:59.379175 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 181662us
I20260709 12:26:59.380144 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.390486 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.348670 24202 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.323096 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:26:59.433774 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 110772us
I20260709 12:26:59.434187 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.434499 22038 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:59.435461 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.435680 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:59.436662 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.437254 22213 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:59.387272 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.439282 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.439366 22214 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:26:59.388902 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.389547 24180 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.390019 22807 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:59.390132 24188 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:59.380729 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:26:59.430367 22114 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:26:59.394408 22144 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:59.385293 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.438338 24210 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:26:59.442237 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 57915.9us
I20260709 12:26:59.463083 22037 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:26:59.435022 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 131186us
I20260709 12:26:59.384675 24184 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:59.466622 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:59.467793 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.478431 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:26:59.479241 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 185477us
I20260709 12:26:59.480423 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.481042 22217 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:59.484993 22144 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:59.394155 24117 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.393575 24147 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:59.499508 22808 raft_consensus.cc:1217] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:26:59.499396 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.501942 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.436606 24131 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.503134 22773 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:59.503458 22148 raft_consensus.cc:2393] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:59.504618 24131 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.506114 22147 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:59.485507 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.508963 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.442255 24193 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.484298 24177 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.462762 24210 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:26:59.532516 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 69519.7us
I20260709 12:26:59.496263 24202 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.529083 24183 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.530748 24187 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.533053 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:59.536315 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.543000 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.538887 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.550469 22142 raft_consensus.cc:1240] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:59.509759 24139 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:59.496034 24203 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.556953 22773 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:59.537792 24114 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:59.525625 24177 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.538067 24132 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.516999 24206 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.534791 24210 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:59.515890 24170 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.553785 24139 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.577901 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:26:59.577973 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 142363us
I20260709 12:26:59.571331 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.580293 22038 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:59.550936 24122 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.581152 24174 consensus_queue.cc:1059] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:26:59.563967 24148 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.592286 22146 raft_consensus.cc:1240] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:59.566056 24177 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.566725 24207 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:59.601099 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.595698 22038 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:26:59.596582 24061 raft_consensus.cc:2804] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.599270 24117 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.611027 24061 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.562075 24194 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.613204 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.614491 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:59.614809 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:26:59.591657 24174 raft_consensus.cc:3055] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:59.617928 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:59.579092 24139 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.640568 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.571180 24206 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:26:59.641754 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 77036.9us
I20260709 12:26:59.644182 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.646250 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.651691 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.653328 22146 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:59.655493 22775 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:59.661471 22145 raft_consensus.cc:1240] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:59.663817 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.622287 24147 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:59.620052 24061 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.593170 24183 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.671475 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:59.712782 22073 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:59.600749 24207 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.672183 24182 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.724782 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:26:59.645650 24213 raft_consensus.cc:2804] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:59.731254 24213 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:26:59.731678 24213 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.654263 24206 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.662987 24174 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:26:59.672631 24147 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:26:59.697484 24203 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.731814 24194 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.723270 24205 raft_consensus.cc:2243] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:59.762452 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 107040us
I20260709 12:26:59.729671 24172 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.566880 24211 consensus_queue.cc:1059] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:26:59.764747 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:59.765024 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:59.765900 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:26:59.765923 22775 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:59.768702 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:59.768891 22068 raft_consensus.cc:2393] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:26:59.769904 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:26:59.770318 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 155583us
W20260709 12:26:59.769614 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 103673us
I20260709 12:26:59.758980 24147 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:59.759346 24122 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:26:59.735564 24207 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.775550 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:59.758679 24193 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.776207 22112 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:59.775061 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.778659 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:26:59.778205 22113 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.531s (SENT) [suppressed 2 similar messages]
I20260709 12:26:59.791465 24117 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:26:59.792762 24117 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.793526 24170 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.793882 24160 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.795342 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:59.796391 22215 raft_consensus.cc:3055] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:59.796761 22215 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:26:59.795343 24205 raft_consensus.cc:2272] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.800307 24205 ts_tablet_manager.cc:1916] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:59.812752 22068 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:26:59.774083 24208 consensus_queue.cc:1059] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:26:59.832572 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 54393.2us
I20260709 12:26:59.833709 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:59.834527 22112 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:26:59.856292 22147 raft_consensus.cc:2393] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:26:59.830577 22215 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:26:59.832406 24174 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.938825 22073 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:26:59.938946 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:59.940599 22215 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:59.834787 24182 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:59.938825 24177 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:59.940827 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 175003us
I20260709 12:26:59.940984 22069 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.941010 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:59.940606 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:26:59.934070 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 99599.7us
I20260709 12:26:59.949519 22112 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:26:59.943953 24182 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:26:59.944859 24174 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:59.943758 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 168693us
W20260709 12:26:59.945732 24183 consensus_queue.cc:1175] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d465f3cb42174eb89615dcd747f9e682" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 12:26:59.837455 24210 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:26:59.948230 24176 consensus_meta.cc:287] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.622s	user 0.000s	sys 0.018s
I20260709 12:26:59.952185 22112 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:26:59.943145 24168 consensus_meta.cc:287] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.824s	user 0.013s	sys 0.008s
I20260709 12:26:59.952872 24202 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.882145 24216 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:59.952811 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.950959 22073 raft_consensus.cc:2393] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:26:59.954734 24160 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:26:59.969657 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:26:59.964943 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 230127us
I20260709 12:26:59.965782 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:59.968886 22219 raft_consensus.cc:1803] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: voting while tombstoned based on last-logged opid 4.5
I20260709 12:26:59.972450 24203 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:59.972652 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.973245 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:26:59.971462 22219 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:26:59.974764 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:26:59.951397 24193 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:59.953588 24182 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.992556 24218 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:59.972494 24221 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:26:59.977600 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:26:59.978711 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:59.979400 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:26:59.999089 22217 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:26:59.981547 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:59.984457 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:00.000209 22220 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.986824 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:59.988346 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:26:59.996024 22071 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:00.005246 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:00.007472 22073 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:59.990537 24193 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:26:59.969512 24216 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:00.000614 24160 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:00.017283 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 181197us
I20260709 12:26:59.968890 24176 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:26:59.969244 24168 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:00.033679 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.037815 21970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 328) took 1154 ms. Trace:
W20260709 12:27:00.009199 24181 consensus_meta.cc:287] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.926s	user 0.016s	sys 0.006s
I20260709 12:27:00.047536 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:00.067772 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.017993 24193 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.105973 22144 raft_consensus.cc:1240] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.115386 22140 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:00.046643 24216 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.125335 22114 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:00.070736 21970 rpcz_store.cc:276] 0709 12:26:58.883468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.883623 (+   155us) service_pool.cc:224] Handling call
0709 12:27:00.037737 (+1154114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:59.224800 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:59.315174 (+ 90374us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:59.315211 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:26:59.315229 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:59.315551 (+   322us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:59.315633 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:59.315666 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:59.319522 (+  3856us) tablet.cc:701] Row locks acquired
0709 12:26:59.319543 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:26:59.319704 (+   161us) write_op.cc:270] Start()
0709 12:26:59.319838 (+   134us) write_op.cc:276] Timestamp: P: 1783600019319653 usec, L: 0
0709 12:26:59.319861 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:26:59.320558 (+   697us) log.cc:844] Serialized 541 byte log entry
0709 12:26:59.502188 (+181630us) op_driver.cc:464] REPLICATION: finished
0709 12:26:59.938093 (+435905us) write_op.cc:301] APPLY: starting
0709 12:26:59.938179 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:59.938270 (+    91us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:59.938402 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:59.938821 (+   419us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:59.939009 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:59.939056 (+    47us) write_op.cc:312] APPLY: finished
0709 12:26:59.939306 (+   250us) log.cc:844] Serialized 23 byte log entry
0709 12:26:59.962389 (+ 23083us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:59.974516 (+ 12127us) write_op.cc:454] Released schema lock
0709 12:26:59.983413 (+  8897us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:00.011412 (+ 27999us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.013418 (+  2006us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":435634,"apply.run_cpu_time_us":2086,"apply.run_wall_time_us":66625,"num_ops":1,"prepare.queue_time_us":149086,"prepare.run_cpu_time_us":3371,"prepare.run_wall_time_us":113336,"replication_time_us":182180,"thread_start_us":419648,"threads_started":2}]]}
I20260709 12:27:00.126724 22776 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:00.082851 24181 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:00.160174 22801 raft_consensus.cc:1240] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:00.161281 24181 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:00.163390 24175 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:00.212141 22072 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:00.171715 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45122.2us
W20260709 12:27:00.242017 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 289913us
I20260709 12:27:00.246905 22776 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:00.171968 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 46784.1us
W20260709 12:27:00.180328 22037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.011s	sys 0.021s
W20260709 12:27:00.248468 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.014s	sys 0.028s
W20260709 12:27:00.248906 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 695620us
I20260709 12:27:00.265741 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:00.269821 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:00.271086 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:00.271865 22068 raft_consensus.cc:2393] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:00.272462 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:00.272796 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:00.267911 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:00.273643 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 325560us
I20260709 12:27:00.275403 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:00.274345 22775 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:00.276203 22068 raft_consensus.cc:1240] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.276930 22144 raft_consensus.cc:1240] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.278330 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:00.282496 22112 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:00.234740 24061 consensus_meta.cc:287] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.506s	user 0.029s	sys 0.036s
I20260709 12:27:00.283102 22068 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:00.146062 24214 raft_consensus.cc:3055] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:00.291317 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.291797 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:00.215193 24169 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:00.236658 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 586) took 1174 ms. Trace:
I20260709 12:27:00.297381 22775 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:00.275758 24122 consensus_queue.cc:1059] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:27:00.250016 24210 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:00.281641 24188 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:00.323930 24213 consensus_meta.cc:287] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.015s
I20260709 12:27:00.285254 24117 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:00.303162 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:00.228866 24176 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:00.283139 24175 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:00.287545 24214 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:00.299943 22215 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:00.291244 24061 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:00.267640 24204 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:27:00.306483 24180 consensus_meta.cc:287] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.009s
I20260709 12:27:00.331475 22775 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:00.325350 22801 rpcz_store.cc:276] 0709 12:26:59.061814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.106139 (+ 44325us) service_pool.cc:224] Handling call
0709 12:26:59.118153 (+ 12014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.160672 (+1042519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.236377 (+ 75705us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54006a0254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:00.236571 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395814784}
W20260709 12:27:00.336634 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 86587us
I20260709 12:27:00.303460 24211 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:00.329098 24171 consensus_meta.cc:287] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.995s	user 0.011s	sys 0.012s
I20260709 12:27:00.342656 22773 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:00.344659 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56474.2us
I20260709 12:27:00.423933 22185 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:00.426257 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 94859.1us
W20260709 12:27:00.398945 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.427153 22775 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:00.427399 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.323316 24183 consensus_queue.cc:1059] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:27:00.432382 22069 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:00.483933 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 56845.1us
I20260709 12:27:00.487469 22775 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:00.483857 22065 raft_consensus.cc:1240] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.492583 22069 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:00.493752 22069 raft_consensus.cc:1240] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:00.388778 24169 raft_consensus.cc:697] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:00.495625 24183 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.499301 22775 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:00.500440 22775 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:00.490357 22213 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:00.512274 24117 consensus_queue.cc:1059] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:00.513689 24117 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:00.514039 24117 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:00.526136 22220 consensus_meta.cc:287] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.522s	user 0.004s	sys 0.024s
I20260709 12:27:00.526670 22220 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:00.527376 22215 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:00.528118 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.532467 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.348901 24188 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:00.343570 24230 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:00.535439 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 92383.2us
I20260709 12:27:00.501969 24203 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:00.424471 24180 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:00.428920 24171 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:00.490309 24170 consensus_queue.cc:1059] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:27:00.482543 24216 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:00.389659 24213 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:00.572301 22114 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:00.584750 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:00.572721 24206 consensus_meta.cc:287] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.006s
I20260709 12:27:00.837131 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.812913 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:00.711879 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:00.924566 22219 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:00.925179 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:00.808678 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.574142 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 231578us
I20260709 12:27:00.564141 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:00.923321 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 422869us
I20260709 12:27:00.641659 22068 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.642019 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:00.929497 22072 raft_consensus.cc:2393] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 9: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:00.929587 22775 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:00.639361 22037 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:00.923974 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:00.873282 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:00.849114 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1902) took 1070 ms. Trace:
I20260709 12:27:00.931883 22065 rpcz_store.cc:276] 0709 12:26:59.778675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.970737 (+192062us) service_pool.cc:224] Handling call
0709 12:26:59.971830 (+  1093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.488496 (+516666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.848825 (+360329us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400265a54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:00.849039 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177087744}
W20260709 12:27:00.841161 24147 consensus_meta.cc:287] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.058s	user 0.010s	sys 0.009s
I20260709 12:27:00.933593 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:00.933696 24147 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:00.934712 22066 raft_consensus.cc:1240] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:00.934939 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:00.860355 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.936033 22217 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:00.936266 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1899) took 1166 ms. Trace:
I20260709 12:27:00.936280 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:00.936714 22066 rpcz_store.cc:276] 0709 12:26:59.769515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.772092 (+  2577us) service_pool.cc:224] Handling call
0709 12:26:59.772354 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.935078 (+1162724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.936052 (+   974us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003cb254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:00.936212 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672767232}
I20260709 12:27:00.937933 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:00.938287 22066 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:00.939404 22065 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:00.719470 24235 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:00.950716 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 308142us
W20260709 12:27:00.952675 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.726465 24169 consensus_queue.cc:237] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:00.962951 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 323681us
W20260709 12:27:00.963222 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 390995us
I20260709 12:27:00.965840 22072 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:00.965890 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:00.640946 24173 consensus_meta.cc:287] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.293s	user 0.016s	sys 0.011s
W20260709 12:27:00.560652 24184 consensus_meta.cc:287] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.076s	user 0.007s	sys 0.004s
W20260709 12:27:00.588408 24207 consensus_meta.cc:287] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.009s
W20260709 12:27:00.640767 24197 consensus_meta.cc:287] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.366s	user 0.014s	sys 0.016s
I20260709 12:27:00.523064 24168 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:00.957242 22775 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:00.958920 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:00.644188 24139 consensus_meta.cc:287] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.932s	user 0.014s	sys 0.006s
W20260709 12:27:00.576200 24190 consensus_meta.cc:287] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.271s	user 0.007s	sys 0.012s
I20260709 12:27:00.716745 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:00.914747 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:00.541510 24219 consensus_queue.cc:1059] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.526s
W20260709 12:27:00.992017 24122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.007s	sys 0.004s
I20260709 12:27:00.992679 24188 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:00.541898 24227 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:00.911850 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:00.582685 24226 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.500s
I20260709 12:27:00.592527 24117 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:01.085989 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:01.123797 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:01.066715 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 111631us
I20260709 12:27:01.086659 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:01.140961 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:01.085777 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:01.509932 22112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.030s	sys 0.044s
I20260709 12:27:01.598007 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.538246 24211 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:01.065122 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:01.608385 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44992 (request call id 1414) took 1116 ms. Trace:
I20260709 12:27:01.608880 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:01.608794 22068 rpcz_store.cc:276] 0709 12:27:00.491736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.494439 (+  2703us) service_pool.cc:224] Handling call
0709 12:27:00.641454 (+147015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.928939 (+287485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.608200 (+679261us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400314550. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:01.608330 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337419136}
I20260709 12:27:01.609903 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:01.084641 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:01.607790 21970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 329) took 1322 ms. Trace:
I20260709 12:27:01.086941 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:01.137809 22185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.085s	sys 0.103s
W20260709 12:27:01.066905 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 71126.7us
I20260709 12:27:01.065536 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:01.611320 22185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.091s	sys 0.131s
W20260709 12:27:01.611970 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 1.18807e+06us
I20260709 12:27:01.612583 22185 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:01.087298 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.996224 22071 raft_consensus.cc:1240] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.047132 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:00.914988 24228 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:00.534308 24231 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:00.588589 24230 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:01.622934 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:00.994511 22067 raft_consensus.cc:1240] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.623952 22217 raft_consensus.cc:1803] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: voting while tombstoned based on last-logged opid 4.5
I20260709 12:27:01.624465 22217 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:01.625281 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:01.292694 24170 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:01.628953 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:01.419899 24171 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:01.075974 24239 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:01.598408 22112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.031s	sys 0.051s
I20260709 12:27:01.642961 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:01.643298 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 768527us
I20260709 12:27:00.704641 24175 raft_consensus.cc:697] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:00.842458 24177 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:01.078747 24213 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:01.602191 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 645021us
I20260709 12:27:01.656839 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:01.659192 22775 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:01.660501 22775 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:00.970016 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:01.626889 24227 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:01.610687 21970 rpcz_store.cc:276] 0709 12:27:00.285007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.285151 (+   144us) service_pool.cc:224] Handling call
0709 12:27:01.607707 (+1322556us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":326016}
W20260709 12:27:01.480171 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.955354 24147 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:01.613358 22213 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:01.714543 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:01.475824 24182 consensus_meta.cc:287] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.470s	user 0.008s	sys 0.007s
I20260709 12:27:01.065873 24207 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:01.329413 24174 consensus_meta.cc:287] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.367s	user 0.010s	sys 0.008s
I20260709 12:27:01.712621 24171 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:01.716276 24171 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.717208 24207 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:01.617304 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:01.278667 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 335035us
I20260709 12:27:01.718385 24171 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:01.471789 24193 consensus_meta.cc:287] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.326s	user 0.009s	sys 0.000s
W20260709 12:27:01.329135 24183 consensus_meta.cc:287] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.833s	user 0.006s	sys 0.000s
I20260709 12:27:01.719136 24183 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:01.621368 24201 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:01.720158 24201 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:00.970501 24234 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:01.582746 22218 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:01.639937 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 537) took 1349 ms. Trace:
I20260709 12:27:01.330103 24129 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:01.626415 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:01.307355 24232 raft_consensus.cc:3055] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:01.416775 24222 raft_consensus.cc:3055] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:01.627249 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:01.729110 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 116607us
I20260709 12:27:01.730878 22214 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:27:01.586292 22216 raft_consensus.cc:2376] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6. Re-sending same reply.
I20260709 12:27:01.585105 22221 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:27:01.627802 22217 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:01.420485 24216 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:01.414983 24236 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:01.462911 24180 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:01.303053 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 596) took 1027 ms. Trace:
I20260709 12:27:01.086217 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:01.644313 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:01.653911 22219 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:01.495877 24205 ts_tablet_manager.cc:1929] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:27:01.075502 24194 consensus_queue.cc:1059] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.566s
I20260709 12:27:01.663123 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 428) took 1394 ms. Trace:
I20260709 12:27:01.064971 24173 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.609970 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:01.772583 22068 raft_consensus.cc:2393] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 2: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:01.773625 22068 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.692529 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:01.047901 24203 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.066427 24184 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.663690 24228 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:01.696058 24245 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:01.704114 24061 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:00.720939 24214 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.707832 24117 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:01.711427 24231 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:01.668187 24211 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:01.712885 22065 raft_consensus.cc:1240] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.956883 24206 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:01.596783 24122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.009s	sys 0.021s
I20260709 12:27:01.598841 24197 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:01.596514 24190 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.599188 24139 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.728760 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 422) took 2063 ms. Trace:
W20260709 12:27:01.729478 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.664565 24239 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:01.734975 22808 raft_consensus.cc:1240] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:01.738538 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:01.694842 24227 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:01.817420 22067 rpcz_store.cc:276] 0709 12:26:59.665681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.666133 (+   452us) service_pool.cc:224] Handling call
0709 12:26:59.728717 (+ 62584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.626622 (+1897905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.728554 (+101932us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400094554. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:01.728707 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910689024}
I20260709 12:27:01.755741 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:01.728044 24183 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:01.766530 22071 rpcz_store.cc:276] 0709 12:27:00.269163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.269281 (+   118us) service_pool.cc:224] Handling call
0709 12:27:00.269538 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.623252 (+1353714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.662884 (+ 39632us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54001874d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:01.663062 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670818176}
I20260709 12:27:01.719036 24193 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.730377 24232 raft_consensus.cc:740] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:01.779839 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 162809us
I20260709 12:27:01.836318 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:01.836436 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:01.753901 24132 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:01.763708 24222 raft_consensus.cc:740] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:01.715718 24182 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.766786 24205 log.cc:1199] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/wals/ce0cbcda6ab94ef68d36321d19671059
W20260709 12:27:01.811540 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 180266us
I20260709 12:27:01.770565 24249 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:01.812543 22066 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.813855 22114 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:01.814402 22064 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:01.762573 24170 raft_consensus.cc:697] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:01.733270 24129 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.822305 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:01.725835 22802 rpcz_store.cc:276] 0709 12:27:00.279254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.281866 (+  2612us) service_pool.cc:224] Handling call
0709 12:27:00.914521 (+632655us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:27:01.628754 (+714233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7845632}
I20260709 12:27:01.827797 24239 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.779397 24114 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:01.832021 22809 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:01.808351 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:01.781213 24247 raft_consensus.cc:3055] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:01.837363 22070 raft_consensus.cc:1240] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.812667 24231 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:01.838660 22073 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:01.769455 24236 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:01.863134 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:01.869313 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:01.838680 22810 raft_consensus.cc:1240] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.832702 24227 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:01.871688 22038 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:01.918222 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 46614.3us
I20260709 12:27:01.919363 22038 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:01.921149 22038 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:01.872438 24266 consensus_queue.cc:1059] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:27:01.872536 24218 consensus_queue.cc:1059] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:01.928423 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 114654us
W20260709 12:27:01.928647 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 53423.5us
I20260709 12:27:01.872978 24205 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58410 (request call id 82) took 2820 ms. Trace:
I20260709 12:27:01.873165 24257 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:01.875051 24180 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:01.775410 24254 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:01.827272 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:01.928296 24194 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:01.941020 24180 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.941184 24254 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.887832 24249 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:01.887127 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 55102.7us
I20260709 12:27:01.839531 24252 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.836863 24183 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.040349 24252 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.849771 24176 raft_consensus.cc:3055] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:01.838728 24174 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:01.893029 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:01.826838 24061 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.850642 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:01.895128 24170 consensus_queue.cc:237] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:01.870798 24258 consensus_queue.cc:1059] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:27:01.909359 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:01.864953 24122 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:01.875960 24221 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:02.056141 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 243529us
W20260709 12:27:02.059736 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 56893.8us
I20260709 12:27:01.926959 22806 raft_consensus.cc:1240] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:27:02.061703 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:02.062295 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.047413 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:01.818256 24175 consensus_queue.cc:237] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.755460 22804 rpcz_store.cc:276] 0709 12:27:00.275243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.281228 (+  5985us) service_pool.cc:224] Handling call
0709 12:27:01.302129 (+1020901us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:01.302378 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.302628 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.302658 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:01.302716 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:01.302754 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.302820 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.302949 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8137600}
W20260709 12:27:01.938143 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 112518us
I20260709 12:27:01.937830 24255 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:01.938432 24260 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:01.886888 24256 consensus_queue.cc:1059] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:27:01.870291 24132 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:01.999105 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 69499.9us
I20260709 12:27:02.001387 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:02.002803 22145 raft_consensus.cc:1240] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:02.003340 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:01.906267 24247 raft_consensus.cc:740] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:01.906682 24231 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:02.048007 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 591) took 2412 ms. Trace:
I20260709 12:27:02.042367 24252 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:02.050323 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 115583us
I20260709 12:27:02.053850 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:02.055883 22808 raft_consensus.cc:1813] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Handling vote request from an unknown peer ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:01.887600 24222 consensus_queue.cc:260] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:01.906405 24114 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.038162 24147 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:01.932835 22038 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:02.065549 22066 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:02.063983 24122 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.070550 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.051045 24201 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.048285 24176 raft_consensus.cc:740] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:02.071280 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:02.072100 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 241881us
I20260709 12:27:02.081784 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1897) took 2313 ms. Trace:
I20260709 12:27:02.086971 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:02.093779 24259 consensus_queue.cc:1059] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:27:02.095039 24273 consensus_queue.cc:1059] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:27:02.062309 24177 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.062898 24221 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:01.934924 24232 consensus_queue.cc:260] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:02.073176 24160 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.052378 24174 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.055300 24061 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:02.052791 22188 connection.cc:256] RPC call timeout handler was delayed by -1.0417838839998694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 12:27:02.054404 24257 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.481442 22141 raft_consensus.cc:2393] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:02.285118 24249 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.482613 24249 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.246963 24206 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:02.143008 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.214214 24197 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:02.104748 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 593) took 1830 ms. Trace:
I20260709 12:27:02.259271 24180 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.143864 24129 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:01.931766 24205 rpcz_store.cc:276] 0709 12:26:59.097614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.116501 (+ 18887us) service_pool.cc:224] Handling call
0709 12:26:59.285735 (+169234us) ts_tablet_manager.cc:1151] Deleting tablet ce0cbcda6ab94ef68d36321d19671059
0709 12:26:59.285815 (+    80us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:27:00.747454 (+1461639us) tablet_metadata.cc:665] Metadata flushed
0709 12:27:01.495710 (+748256us) tablet_metadata.cc:665] Metadata flushed
0709 12:27:01.872910 (+377200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139411,"tablet-delete.queue_time_us":98828,"thread_start_us":84818,"threads_started":1}
I20260709 12:27:02.295451 24239 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.296093 24236 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.245925 24243 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.263s
I20260709 12:27:02.228154 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.574085 22804 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:02.482767 24277 raft_consensus.cc:3055] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:02.574772 24277 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:02.145419 24260 raft_consensus.cc:697] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:02.487646 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.486541 24177 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.488550 24221 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.485656 24206 raft_consensus.cc:3055] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:02.492169 24222 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.603423 24206 raft_consensus.cc:740] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:02.490504 24168 consensus_queue.cc:1059] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:27:02.492714 24061 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.493395 24278 raft_consensus.cc:3055] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:02.489248 24231 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.610283 24278 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:02.494050 24257 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.486688 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.323318 24210 consensus_queue.cc:1059] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
W20260709 12:27:02.495026 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 562270us
I20260709 12:27:02.286934 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.616860 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.616411 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:02.617466 22801 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:27:02.604285 24206 consensus_queue.cc:260] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:02.495662 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.493830 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:02.484460 22070 rpcz_store.cc:276] 0709 12:26:59.768675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.768897 (+   222us) service_pool.cc:224] Handling call
0709 12:26:59.779686 (+ 10789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.906098 (+2126412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.081494 (+175396us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54000708d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:02.081714 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4731929472}
I20260709 12:27:02.618988 22065 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.492821 22144 raft_consensus.cc:2393] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:02.105001 22810 rpcz_store.cc:276] 0709 12:26:59.535448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.535555 (+   107us) service_pool.cc:224] Handling call
0709 12:26:59.535844 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.908244 (+2372400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.947361 (+ 39117us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b540027a954. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:01.947607 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5295758080}
I20260709 12:27:02.497222 22805 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.498339 24114 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.178180 22113 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:02.132370 24269 consensus_queue.cc:1059] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.434s
I20260709 12:27:02.499603 24147 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.131860 24262 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:02.501952 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 422244us
I20260709 12:27:02.624850 24210 raft_consensus.cc:3055] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:02.625289 24210 raft_consensus.cc:740] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:02.496417 24174 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.499594 24280 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:27:02.626102 24210 consensus_queue.cc:260] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.627568 24210 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.627738 24280 consensus_queue.cc:1059] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:02.628754 24280 raft_consensus.cc:3055] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:02.629053 24280 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:02.503577 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.506521 24117 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.507135 24249 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.496237 22806 rpcz_store.cc:276] 0709 12:27:00.274412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.276582 (+  2170us) service_pool.cc:224] Handling call
0709 12:27:00.277035 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.061426 (+1784391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.104436 (+ 43010us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54007652d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:02.104690 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3746104704}
I20260709 12:27:02.635035 22070 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:02.635068 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.614357 24214 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.611286 24278 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.132068 24263 consensus_queue.cc:1059] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.463s
I20260709 12:27:02.640002 24278 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.153936 24193 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.132489 24272 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:02.640282 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.510739 24247 consensus_queue.cc:260] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.513499 24254 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.127269 24212 raft_consensus.cc:3055] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:02.514422 24173 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.140565 24203 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:02.515564 24227 consensus_meta.cc:287] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 12:27:02.516604 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.648563 24129 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:02.126845 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:02.132982 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.120476 22148 raft_consensus.cc:2393] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:02.649150 24129 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.649539 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:02.649653 24168 consensus_queue.cc:1059] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:02.489269 24132 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.650528 24132 raft_consensus.cc:3055] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:02.644163 24202 consensus_queue.cc:1059] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:27:02.525570 24122 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.526196 24183 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:02.651059 24227 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.651880 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.652120 24269 raft_consensus.cc:3055] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:02.652581 22802 raft_consensus.cc:2393] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:02.632547 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:02.529985 22073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1904) took 2750 ms. Trace:
W20260709 12:27:02.549831 22809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 536) took 2271 ms (client timeout 2080 ms). Trace:
I20260709 12:27:02.551753 24234 raft_consensus.cc:3055] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:27:02.655061 22809 rpcz_store.cc:269] 0709 12:27:00.277994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.278104 (+   110us) service_pool.cc:224] Handling call
0709 12:27:02.549594 (+2271490us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54006a1154. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:02.549725 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3305642752}
I20260709 12:27:02.654356 22073 rpcz_store.cc:276] 0709 12:26:59.779024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.008208 (+229184us) service_pool.cc:224] Handling call
0709 12:27:00.020003 (+ 11795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.903252 (+1883249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.529688 (+626436us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54000b31d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:02.529912 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4182189312}
W20260709 12:27:02.558936 22066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1914) took 1593 ms (client timeout 1788 ms). Trace:
W20260709 12:27:02.664963 22066 rpcz_store.cc:269] 0709 12:27:00.965543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.965655 (+   112us) service_pool.cc:224] Handling call
0709 12:27:02.558699 (+1593044us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54000712d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:02.558859 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939842944}
I20260709 12:27:02.555756 24271 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:02.559975 24184 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:02.563397 22064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 430) took 2293 ms (client timeout 1779 ms). Trace:
I20260709 12:27:02.563880 22069 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:02.562057 24176 consensus_queue.cc:260] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.681191 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:02.571719 24274 raft_consensus.cc:3055] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:02.575659 24277 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.590909 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:02.132210 24248 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:02.607161 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.593588 24260 consensus_queue.cc:237] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:02.689319 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.491109 22188 connection.cc:256] RPC call timeout handler was delayed by -1.0354838839998592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:27:02.613894 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:02.615510 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.615376 22038 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:02.690536 22221 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
W20260709 12:27:02.690994 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 75690.5us
I20260709 12:27:02.495515 24197 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:02.640870 24249 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.622798 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.695781 22810 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:27:02.626124 22185 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:02.633252 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.509724 22808 raft_consensus.cc:2393] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:02.636574 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.640944 22065 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
W20260709 12:27:02.641440 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 488828us
I20260709 12:27:02.642040 22067 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:02.643814 24253 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:02.720290 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 630) took 1020 ms. Trace:
I20260709 12:27:02.720082 24253 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.720810 22804 rpcz_store.cc:276] 0709 12:27:01.700027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.606859 (+906832us) service_pool.cc:224] Handling call
0709 12:27:02.720223 (+113364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.620736 24190 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.633633 24206 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.648994 24212 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:02.513659 24201 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.727901 24201 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:02.729178 24259 raft_consensus.cc:3055] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:02.729591 24259 raft_consensus.cc:740] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:02.730094 24201 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.651371 24129 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.692245 24202 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:02.653065 24227 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:02.649166 22807 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:02.652508 24269 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:02.663210 24272 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.650882 24132 raft_consensus.cc:740] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:02.681838 22809 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:02.681207 22064 rpcz_store.cc:269] 0709 12:27:00.269738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.272226 (+  2488us) service_pool.cc:224] Handling call
0709 12:27:02.563199 (+2290973us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001d60d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:02.563335 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3544177920}
I20260709 12:27:02.634248 24117 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.683765 24271 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.664116 24170 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:02.686725 22036 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:02.640421 24262 consensus_queue.cc:1059] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 12:27:02.754947 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 68323.1us
I20260709 12:27:02.755198 22809 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:02.756523 22037 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:02.556879 24275 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.691118 22186 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:02.664088 24234 raft_consensus.cc:740] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:02.692373 22188 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:02.760604 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 69571.6us
I20260709 12:27:02.620764 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:02.685221 24235 consensus_queue.cc:1059] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:27:02.737884 24147 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.743748 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:02.755549 24182 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:02.696877 22038 connection.cc:256] RPC call timeout handler was delayed by -1.1516875320003237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 12:27:02.696856 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.697590 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:02.684650 24114 consensus_queue.cc:1059] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:27:02.719462 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 613) took 1051 ms. Trace:
I20260709 12:27:02.718852 22113 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:02.723284 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.724056 22803 raft_consensus.cc:2393] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 2: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:02.763136 22186 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:02.770126 22072 raft_consensus.cc:1240] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:02.770251 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.722344 22806 raft_consensus.cc:2393] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:02.769295 22808 rpcz_store.cc:276] 0709 12:27:01.667547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.909077 (+241530us) service_pool.cc:224] Handling call
0709 12:27:02.719392 (+810315us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:02.725522 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 79066.8us
W20260709 12:27:02.767514 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 75233.2us
I20260709 12:27:02.720185 24177 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:02.690626 24274 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:02.538482 24139 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:02.726023 22185 raft_consensus.cc:2686] T ce0cbcda6ab94ef68d36321d19671059 P ecc1814bfd604baa9cc66be8c02c5cfa: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:02.737876 24203 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.738435 24197 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:02.738654 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44992 (request call id 1416) took 2233 ms. Trace:
I20260709 12:27:02.740557 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.697847 24277 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.696147 24247 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.695089 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 601) took 1080 ms. Trace:
I20260709 12:27:02.744408 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.745265 24212 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.746939 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 614) took 1079 ms. Trace:
I20260709 12:27:02.695147 24248 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.629861 24280 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.751233 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:02.700778 24273 consensus_queue.cc:1059] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:27:02.746833 24232 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:02.758852 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:02.761493 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.772413 22188 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:02.859228 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 86906.8us
I20260709 12:27:02.860531 22188 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:02.772851 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 54058.4us
I20260709 12:27:02.767760 22071 raft_consensus.cc:2393] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:02.764906 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:02.768160 22810 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:27:02.774875 22775 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:02.763536 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:02.754330 24170 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:02.861460 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:02.698772 24236 consensus_queue.cc:1059] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 12:27:02.815500 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 189442us
I20260709 12:27:02.788645 22072 raft_consensus.cc:1240] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:02.806316 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:02.864182 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.864441 22806 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.864106 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.864403 22216 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:02.810361 24114 raft_consensus.cc:3055] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:02.783982 22186 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:02.811875 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:02.810904 24282 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:02.817598 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:02.786303 22805 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:02.815618 22069 rpcz_store.cc:276] 0709 12:27:00.505253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.506748 (+  1495us) service_pool.cc:224] Handling call
0709 12:27:02.563729 (+2056981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.681387 (+117658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.738397 (+ 57010us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54001d60d0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:02.738564 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4730076416}
I20260709 12:27:02.866043 22067 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:27:02.866775 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.866900 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:02.763590 24281 log.cc:927] Time spent T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:02.868770 22072 raft_consensus.cc:1240] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:02.777977 24201 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:02.850313 22073 raft_consensus.cc:1240] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:02.762290 24235 raft_consensus.cc:3055] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:02.765065 22804 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
W20260709 12:27:02.852319 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 133840us
W20260709 12:27:02.906968 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 46505.6us
W20260709 12:27:02.908270 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 124335us
I20260709 12:27:02.908967 22186 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:02.911870 22112 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:02.852766 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.762863 24262 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.808462 24271 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:02.730521 24259 consensus_queue.cc:260] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.849195 22807 rpcz_store.cc:276] 0709 12:27:01.667790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.941825 (+274035us) service_pool.cc:224] Handling call
0709 12:27:02.516443 (+574618us) spinlock_profiling.cc:243] Waited 95.9 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:27:02.746867 (+230424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220466944}
I20260709 12:27:02.868319 24266 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:02.762991 24117 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.809532 24257 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:02.763023 24180 raft_consensus.cc:3055] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:27:02.862514 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 87710.3us
I20260709 12:27:02.858238 22148 raft_consensus.cc:2393] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:02.805408 24254 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:02.806504 24147 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:02.868260 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:02.869819 22072 raft_consensus.cc:1240] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:02.779426 22803 raft_consensus.cc:2393] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 2: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:02.870304 22808 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
W20260709 12:27:02.874280 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.877334 22113 connection.cc:256] RPC call timeout handler was delayed by -1.16651050199971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 12:27:02.863698 24170 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.805183 24234 consensus_queue.cc:260] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.823577 22801 rpcz_store.cc:276] 0709 12:27:01.614468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.618198 (+1003730us) service_pool.cc:224] Handling call
0709 12:27:02.695018 (+ 76820us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.851666 24129 consensus_queue.cc:1059] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:27:02.824564 24203 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.869500 24122 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:02.868706 24219 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:02.989390 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.971156 22806 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:02.972779 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:02.884218 24201 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:02.869410 24114 raft_consensus.cc:740] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:02.970291 24253 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.764483 24132 consensus_queue.cc:260] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:02.884627 24235 raft_consensus.cc:740] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:02.853976 24197 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:02.921868 24258 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:02.923161 24193 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:02.919456 24256 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.982409 22776 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:02.984630 22113 connection.cc:256] RPC call timeout handler was delayed by -1.149608213999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:27:02.870138 24282 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:02.983122 22810 raft_consensus.cc:2376] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3. Re-sending same reply.
I20260709 12:27:02.975735 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:02.942807 24280 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.936669 24276 raft_consensus.cc:3055] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:27:03.011062 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 102162us
I20260709 12:27:03.022792 22222 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:02.999588 22064 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
W20260709 12:27:03.011775 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 88602.8us
I20260709 12:27:03.012933 24132 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.014743 22067 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:03.012269 24114 consensus_queue.cc:260] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.011234 22073 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:02.974411 24236 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.016039 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:02.818969 24275 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:03.027521 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.028115 22188 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:03.028759 22114 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:03.065907 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.029194 24245 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.025591 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:03.017030 24282 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:03.056775 22113 connection.cc:256] RPC call timeout handler was delayed by -1.0696718259996487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 12:27:03.021590 24122 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:03.013769 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 146971us
I20260709 12:27:03.059621 22148 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:02.979825 24180 raft_consensus.cc:740] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:03.015044 24197 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:02.993714 24190 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.021142 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 608) took 1354 ms. Trace:
I20260709 12:27:03.015949 24193 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:03.070973 24219 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:03.071523 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:03.067797 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:03.073647 24114 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:03.042127 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.011459 24201 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.082269 22222 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:03.085345 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:03.113826 22147 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.086485 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:03.086686 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 63621us
I20260709 12:27:03.086627 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.114707 22148 raft_consensus.cc:2393] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:03.114931 22776 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:03.115442 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.088071 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:03.079646 22070 raft_consensus.cc:2376] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3. Re-sending same reply.
I20260709 12:27:03.014917 24258 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:03.116135 22142 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:03.115492 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:03.092876 24245 raft_consensus.cc:697] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:03.069716 22188 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:03.055763 24259 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:03.093560 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.103240 24219 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.094933 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.026292 24147 raft_consensus.cc:697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:03.099248 24272 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:03.101609 22141 raft_consensus.cc:1240] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.101482 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:03.101918 24193 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.995692 24277 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:27:03.090413 24122 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:03.106108 22113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.068907 24249 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:03.027061 24266 consensus_queue.cc:1059] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:27:02.766278 24269 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:03.116340 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 252201us
I20260709 12:27:03.090617 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:03.133226 22185 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:03.130990 22113 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.602s (SENT)
I20260709 12:27:03.026353 24276 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:03.127317 22114 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:03.125223 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 55584.7us
I20260709 12:27:03.129840 24248 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:03.122140 24221 consensus_meta.cc:287] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 12:27:03.120159 24258 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:03.134260 22113 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.632s (SENT)
I20260709 12:27:03.126579 24219 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:03.097954 24190 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.029721 24274 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:03.140875 22113 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.635s (SENT)
I20260709 12:27:03.095584 22802 rpcz_store.cc:276] 0709 12:27:01.666263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.286624 (+620361us) service_pool.cc:224] Handling call
0709 12:27:03.020895 (+734271us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b540055fad4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:03.021045 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82395008}
I20260709 12:27:03.142623 22185 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:03.134934 22188 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:03.144476 22113 leader_election.cc:336] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.662s (SENT)
I20260709 12:27:03.146308 22073 raft_consensus.cc:1275] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:03.143348 24248 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.147034 24257 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.149917 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:03.156369 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:03.152709 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 46859.7us
W20260709 12:27:03.159399 22113 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.797s (SENT)
I20260709 12:27:03.013232 24235 consensus_queue.cc:260] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.159914 22113 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:03.162401 22113 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.829s (SENT)
W20260709 12:27:03.163372 22113 leader_election.cc:336] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.896s (SENT)
W20260709 12:27:03.164218 22113 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.920s (SENT)
I20260709 12:27:03.164631 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:03.166235 22113 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.939s (SENT)
W20260709 12:27:03.167431 22113 leader_election.cc:336] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.961s (SENT)
I20260709 12:27:03.167922 22113 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:03.170001 22185 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:03.170586 22113 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.975s (SENT)
I20260709 12:27:03.171134 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:03.172433 22113 leader_election.cc:336] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.976s (SENT)
W20260709 12:27:03.173619 22113 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.032s (SENT)
W20260709 12:27:03.174749 22113 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.097s (SENT)
I20260709 12:27:03.175137 22113 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:03.176447 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.176656 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.177160 22142 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:03.177287 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.179628 22142 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.179877 22188 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:03.194736 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:03.197247 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 82390.3us
I20260709 12:27:03.199052 22142 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.199616 24246 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.158733 24248 raft_consensus.cc:697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:03.207427 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.136420 24289 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.212141 22141 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.127859 24180 consensus_queue.cc:260] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.179296 24117 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.214526 22143 raft_consensus.cc:1240] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.180567 24277 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.179143 24160 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:03.157573 24276 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.214818 24147 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.179333 24247 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.215750 24287 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:03.231503 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.216115 24234 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.217216 24190 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:03.169339 24249 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.221422 22112 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:03.181190 24254 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.155728 24243 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:27:03.227833 22216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:27:03.201941 24252 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.219116 22804 raft_consensus.cc:2393] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:03.230358 22214 raft_consensus.cc:1240] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:27:03.231947 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.246788 22219 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.218940 24256 consensus_queue.cc:1059] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:27:03.234948 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.237865 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.144047 24221 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:03.251187 22218 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.235090 24203 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:03.211802 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:03.241875 22216 raft_consensus.cc:606] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:03.242471 22112 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:03.234853 24190 consensus_queue.cc:1059] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:27:03.255578 24190 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:03.256070 24190 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.258536 22185 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:03.214262 24288 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:03.246464 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 85149.2us
W20260709 12:27:03.263435 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.250527 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.240813 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.243950 24276 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.275151 22219 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:03.277578 22141 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:03.214257 24291 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:03.260856 22218 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:03.245993 24160 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.251704 22068 raft_consensus.cc:1240] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.278689 24292 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.283946 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.266381 24248 consensus_queue.cc:237] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:03.268117 24210 consensus_meta.cc:287] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.003s
I20260709 12:27:03.260993 24249 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.269624 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:03.261942 24190 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:03.272272 22147 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:03.264659 24293 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.296381 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.298970 22145 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:03.284590 22218 raft_consensus.cc:2376] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2. Re-sending same reply.
I20260709 12:27:03.261019 24173 raft_consensus.cc:3055] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:03.303067 22065 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:03.288303 24296 raft_consensus.cc:2764] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:03.289561 22185 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:03.292239 24160 raft_consensus.cc:697] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:03.301887 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 127164us
I20260709 12:27:03.305291 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:03.307807 22113 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.116s (SENT)
I20260709 12:27:03.308254 22113 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:03.201009 24245 consensus_queue.cc:237] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.312057 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:03.314198 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.315641 24294 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:03.315821 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 136043us
I20260709 12:27:03.304371 22802 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:03.316855 24132 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.318446 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 545) took 1672 ms. Trace:
I20260709 12:27:03.318851 22802 rpcz_store.cc:276] 0709 12:27:01.645523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.317516 (+1671993us) service_pool.cc:224] Handling call
0709 12:27:03.317843 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.318075 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.318106 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.318155 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:03.318201 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.318266 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.318381 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:03.321065 22113 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.141s (SENT)
I20260709 12:27:03.321882 22188 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:03.322425 22037 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:03.321328 22805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 546) took 1667 ms (client timeout 1618 ms). Trace:
W20260709 12:27:03.323777 22113 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.183s (SENT)
I20260709 12:27:03.324165 22806 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:03.323145 22188 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:03.323277 22805 rpcz_store.cc:269] 0709 12:27:01.654409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.842534 (+188125us) service_pool.cc:224] Handling call
0709 12:27:03.321126 (+1478592us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54008a02d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:03.321260 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034577664}
I20260709 12:27:03.328775 22805 raft_consensus.cc:1240] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.329444 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 616) took 1660 ms. Trace:
I20260709 12:27:03.329732 22805 rpcz_store.cc:276] 0709 12:27:01.668837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.328250 (+1659413us) service_pool.cc:224] Handling call
0709 12:27:03.328584 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.329209 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.329391 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:03.324689 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 544) took 1679 ms. Trace:
I20260709 12:27:03.330907 22806 rpcz_store.cc:276] 0709 12:27:01.645254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.323737 (+1678483us) service_pool.cc:224] Handling call
0709 12:27:03.324018 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.324500 (+   482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.324641 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:03.331600 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 617) took 1662 ms. Trace:
I20260709 12:27:03.332083 22806 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:03.332196 22805 rpcz_store.cc:276] 0709 12:27:01.669246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.330481 (+1661235us) service_pool.cc:224] Handling call
0709 12:27:03.331111 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.331309 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.331333 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.331372 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:03.331409 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.331458 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.331553 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:03.332695 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 618) took 1635 ms. Trace:
I20260709 12:27:03.333678 22805 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.333534 22806 rpcz_store.cc:276] 0709 12:27:01.696982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.331600 (+1634618us) service_pool.cc:224] Handling call
0709 12:27:03.331918 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.332463 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.332630 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:03.334327 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 619) took 1637 ms. Trace:
I20260709 12:27:03.334844 22805 rpcz_store.cc:276] 0709 12:27:01.697295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.333187 (+1635892us) service_pool.cc:224] Handling call
0709 12:27:03.333519 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.334068 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.334272 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:03.303448 24173 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:03.336688 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 603) took 1591 ms. Trace:
I20260709 12:27:03.342374 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.344655 22220 raft_consensus.cc:2376] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4. Re-sending same reply.
I20260709 12:27:03.345698 22806 rpcz_store.cc:276] 0709 12:27:01.745104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.335505 (+1590401us) service_pool.cc:224] Handling call
0709 12:27:03.335844 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.336019 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.336042 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.336153 (+   111us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:03.336187 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.336534 (+   347us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.336628 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:03.307862 24249 raft_consensus.cc:697] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:03.352768 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:03.341220 24285 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.338410 24294 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.363767 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.364425 22220 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.366328 24221 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:03.388861 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 65800.4us
W20260709 12:27:03.392223 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 52790.2us
I20260709 12:27:03.399108 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:03.375027 24285 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:03.347124 24293 consensus_queue.cc:1059] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:27:03.408427 24293 consensus_queue.cc:1243] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer 7ff8d9fd78c1454cacc77bbc1bfb992e log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:03.410708 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.411353 22222 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.416226 24287 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:03.410892 22773 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:03.388809 24289 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.425151 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:03.386284 24239 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:03.426023 24239 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:03.426579 24300 consensus_queue.cc:1059] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:27:03.433923 24301 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:03.434782 24301 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:03.421671 24288 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.427567 24176 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.438298 22217 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:03.439148 22806 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:03.443532 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.443813 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 631) took 1498 ms. Trace:
I20260709 12:27:03.414165 24285 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.439610 24287 raft_consensus.cc:3055] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:27:03.443985 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.446314 22806 rpcz_store.cc:276] 0709 12:27:01.945102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.375284 (+1430182us) service_pool.cc:224] Handling call
0709 12:27:03.438967 (+ 63683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.443445 (+  4478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.443699 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:03.325469 24292 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:03.441300 24232 consensus_meta.cc:287] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.006s
I20260709 12:27:03.449429 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:03.438126 24301 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:03.471781 22810 raft_consensus.cc:2376] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2. Re-sending same reply.
I20260709 12:27:03.474758 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:03.456729 22220 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:03.426520 24239 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.396477 24294 consensus_queue.cc:1059] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:27:03.397017 24160 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.390457 24173 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.464710 22222 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:03.399523 22188 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:03.486506 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 94666.1us
W20260709 12:27:03.482479 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 148821us
I20260709 12:27:03.477886 22112 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:03.480432 22113 leader_election.cc:336] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.693s (SENT)
I20260709 12:27:03.479835 22142 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:03.488391 22113 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:03.431119 24249 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:03.492126 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.492192 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:03.466836 24291 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:03.493968 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:03.497942 22220 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:03.457813 24259 consensus_queue.cc:1059] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:27:03.499631 22188 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:03.465222 24287 raft_consensus.cc:740] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:03.456296 24170 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.502646 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:03.479343 24301 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:03.505033 22806 raft_consensus.cc:1240] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.483484 24231 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:03.492738 24288 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.499604 24173 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.513614 22140 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.519531 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.505266 24232 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.504439 24247 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.503307 24246 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.497303 24300 consensus_queue.cc:1059] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:27:03.539755 24206 consensus_meta.cc:287] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.805s	user 0.009s	sys 0.002s
I20260709 12:27:03.541074 24273 raft_consensus.cc:3055] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.541491 24273 raft_consensus.cc:740] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:03.542403 22148 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:03.540725 24193 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.517998 24237 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.545626 22222 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:03.545925 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:03.547526 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.542455 24273 consensus_queue.cc:260] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.549912 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:03.554445 22808 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.536369 24246 raft_consensus.cc:697] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:03.550586 24273 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.564939 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:03.557477 24294 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.532794 24219 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:03.562858 24231 consensus_queue.cc:1059] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:27:03.569080 24258 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.615829 22808 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:03.585116 22806 raft_consensus.cc:1240] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:03.607005 24219 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:03.608655 24122 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.610430 24201 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.610905 24239 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:03.611409 24298 consensus_queue.cc:1059] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:27:03.580775 24294 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:03.619107 24299 consensus_queue.cc:1059] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:27:03.510485 24291 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.576432 24246 consensus_queue.cc:237] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.645697 22805 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:03.646786 22069 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
W20260709 12:27:03.642870 24214 consensus_meta.cc:287] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.999s	user 0.006s	sys 0.011s
I20260709 12:27:03.641502 24294 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.558032 24237 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.613016 24282 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.650322 24170 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:03.641027 24193 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:03.558816 24287 consensus_queue.cc:260] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:03.673691 22114 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:03.647658 24280 consensus_meta.cc:287] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.617s	user 0.004s	sys 0.008s
I20260709 12:27:03.667727 24278 raft_consensus.cc:3055] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:03.669255 24174 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.677042 24193 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.677539 22221 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.676836 24174 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.968082 24294 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.027837 24234 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:03.703233 22113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.709239 22808 raft_consensus.cc:1240] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:27:04.009999 22220 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
W20260709 12:27:03.767359 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 228886us
I20260709 12:27:03.712558 22139 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:04.029037 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 603913us
I20260709 12:27:04.051894 22773 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:04.026980 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.712740 22218 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
W20260709 12:27:04.030115 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 529433us
I20260709 12:27:04.055390 22185 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:03.896409 22038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.011s	sys 0.039s
W20260709 12:27:04.056671 22038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.015s	sys 0.039s
I20260709 12:27:04.035773 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 615) took 1214 ms. Trace:
I20260709 12:27:04.057303 22806 rpcz_store.cc:276] 0709 12:27:02.812678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.617318 (+804640us) service_pool.cc:224] Handling call
0709 12:27:04.026583 (+409265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.026807 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.026834 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:04.026875 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:04.026903 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.026954 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.027071 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:04.057082 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 798685us
W20260709 12:27:04.060513 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.061060 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:04.061968 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.964248 24176 consensus_meta.cc:287] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
W20260709 12:27:03.814985 24262 consensus_meta.cc:287] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.847s	user 0.009s	sys 0.004s
I20260709 12:27:03.880775 24215 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.050638 24234 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:03.711619 24218 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:04.023355 24201 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.065627 22809 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:03.696705 24182 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:04.065568 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.072268 22143 raft_consensus.cc:2376] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4. Re-sending same reply.
I20260709 12:27:03.781210 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 554) took 1115 ms. Trace:
I20260709 12:27:03.762917 24214 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.066387 24262 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.063308 24299 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:27:04.068293 24276 consensus_queue.cc:1059] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:27:04.073460 22801 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:04.068368 24215 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.074164 24276 raft_consensus.cc:3055] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:04.074443 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:04.070994 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.068356 24280 raft_consensus.cc:2764] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:04.072899 22804 rpcz_store.cc:276] 0709 12:27:02.665674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.022771 (+357097us) service_pool.cc:224] Handling call
0709 12:27:03.780964 (+758193us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b5400764654. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:03.781141 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97244032}
I20260709 12:27:04.076587 24215 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:04.019515 24285 consensus_meta.cc:287] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 12:27:04.071887 24182 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:03.746049 24114 consensus_meta.cc:287] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.003s
I20260709 12:27:04.077898 22808 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:03.696648 24122 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:04.070487 24234 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:03.678336 24258 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.080776 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:04.080892 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.081194 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.085222 22213 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:27:04.081914 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 608) took 1516 ms. Trace:
I20260709 12:27:04.006498 24282 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.076876 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:04.086010 22810 rpcz_store.cc:276] 0709 12:27:02.565251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.483953 (+918702us) service_pool.cc:224] Handling call
0709 12:27:03.484239 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.496745 (+ 12506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.496776 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.496818 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:03.496848 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.081679 (+584831us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b540073f854. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:04.081726 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.081859 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28269440}
I20260709 12:27:04.060832 24227 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.726734 24291 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:04.077502 24276 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:03.740309 24237 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:03.782109 24275 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:04.087638 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.088752 22038 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:04.083235 22188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.003s	sys 0.011s
W20260709 12:27:04.100415 22188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.003s	sys 0.011s
W20260709 12:27:04.101007 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 567398us
I20260709 12:27:04.092595 24173 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.103313 24258 consensus_queue.cc:1059] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:03.680226 24278 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:04.069120 24218 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.105934 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1924) took 1290 ms. Trace:
I20260709 12:27:04.106236 24218 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.106372 22069 rpcz_store.cc:276] 0709 12:27:02.816036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.866429 (+ 50393us) service_pool.cc:224] Handling call
0709 12:27:04.105763 (+1239334us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b5400315454. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.105871 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792562048}
W20260709 12:27:04.091383 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.110455 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.113385 22073 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.113763 24272 raft_consensus.cc:3055] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:04.114142 24272 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:04.114979 24272 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.116418 24272 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.001238 24301 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.117914 24294 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:04.119064 24301 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:04.079456 24285 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.095255 24276 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.120379 24276 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.121649 24285 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.103245 24203 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:04.135699 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:04.139550 22073 raft_consensus.cc:1813] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Handling vote request from an unknown peer 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.140377 22073 raft_consensus.cc:2410] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:04.093786 22773 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:04.073233 24214 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.136976 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.143193 22142 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:04.129848 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:04.144659 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 617) took 1129 ms. Trace:
I20260709 12:27:04.144817 22803 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:04.145123 22801 rpcz_store.cc:276] 0709 12:27:03.015708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.055250 (+ 39542us) service_pool.cc:224] Handling call
0709 12:27:04.144470 (+1089220us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b540054d3d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.144592 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221380864}
I20260709 12:27:04.148707 24203 raft_consensus.cc:697] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:04.148123 24294 consensus_queue.cc:1059] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:04.149700 24294 raft_consensus.cc:3055] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:04.149605 24203 consensus_queue.cc:237] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.124027 22069 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.155174 22073 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:04.129935 22185 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:04.130487 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.156407 24214 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:04.156868 24258 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:04.157259 24258 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.157580 24258 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.157398 24275 consensus_queue.cc:1059] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:04.158028 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.158200 24275 consensus_queue.cc:1243] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:27:04.155208 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 800565us
W20260709 12:27:04.159228 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:04.161267 22065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 442) took 1472 ms (client timeout 1895 ms). Trace:
W20260709 12:27:04.161700 22065 rpcz_store.cc:269] 0709 12:27:02.688840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.722973 (+ 34133us) service_pool.cc:224] Handling call
0709 12:27:04.161111 (+1438138us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400147654. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.161212 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1226733312}
I20260709 12:27:04.144896 22072 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:04.163209 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1925) took 1343 ms. Trace:
I20260709 12:27:04.163579 22067 rpcz_store.cc:276] 0709 12:27:02.819929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.866698 (+ 46769us) service_pool.cc:224] Handling call
0709 12:27:04.163066 (+1296368us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000d5a54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.163156 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338514688}
I20260709 12:27:04.164166 24212 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.166836 24197 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.167337 24197 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.167814 24117 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:04.168377 24117 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.169651 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:04.169962 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 605) took 2401 ms. Trace:
I20260709 12:27:04.170356 22805 rpcz_store.cc:276] 0709 12:27:01.768675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.336321 (+1567646us) service_pool.cc:224] Handling call
0709 12:27:03.336573 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.646139 (+309566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.169758 (+523619us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400690354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:04.169905 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710459776}
I20260709 12:27:04.172672 22147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:27:04.173076 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:04.173246 22147 raft_consensus.cc:606] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:04.124953 24278 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.175230 24278 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.176293 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.176456 24288 raft_consensus.cc:3055] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:04.176875 24288 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:04.177704 24288 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.178146 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:04.179142 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:04.181512 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.138877 22188 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:04.183079 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:04.180367 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.083472 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.183975 22803 raft_consensus.cc:2393] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:04.102766 22038 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:04.184017 22147 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:04.189194 22143 raft_consensus.cc:2393] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:04.189765 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:04.191112 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:04.191588 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:04.192911 22072 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 10.
I20260709 12:27:04.194667 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:04.195566 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:04.201907 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 108771us
I20260709 12:27:04.207825 22073 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
W20260709 12:27:04.208084 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 105418us
W20260709 12:27:04.208808 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 70018.7us
I20260709 12:27:04.208873 22038 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.210089 22038 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:04.150063 24294 raft_consensus.cc:740] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:04.212724 22141 raft_consensus.cc:3055] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:04.213899 22038 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.213320 22141 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:04.170480 24117 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.214920 24203 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:04.192560 24288 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.220000 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.221572 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.222231 22067 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:04.222432 22112 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:04.224385 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.218683 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.217089 24203 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.222009 22141 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.213747 24271 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:04.216152 24293 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.228401 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.217206 24218 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:04.218237 24260 consensus_queue.cc:1059] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:27:04.216814 24231 consensus_queue.cc:1059] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:27:04.229637 24117 consensus_queue.cc:1059] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:27:04.235390 24289 raft_consensus.cc:3055] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.244057 24117 raft_consensus.cc:3055] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:04.244073 24289 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:04.244611 24117 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:04.215229 24303 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.245297 24289 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.217461 24285 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.243163 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1918) took 1626 ms. Trace:
I20260709 12:27:04.228664 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.246786 22071 raft_consensus.cc:1813] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Handling vote request from an unknown peer ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:04.255350 22068 rpcz_store.cc:276] 0709 12:27:02.616344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.618433 (+  2089us) service_pool.cc:224] Handling call
0709 12:27:02.620096 (+  1663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.284246 (+664150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.242903 (+958657us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54003cc654. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:04.243093 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452216576}
I20260709 12:27:04.256592 22071 raft_consensus.cc:2410] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:27:04.248257 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.257423 22141 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.252280 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 461) took 1167 ms. Trace:
I20260709 12:27:04.258862 22140 rpcz_store.cc:276] 0709 12:27:03.085306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.085775 (+   469us) service_pool.cc:224] Handling call
0709 12:27:03.086032 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.524675 (+438643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.252032 (+727357us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400067054. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:04.252215 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983041408}
I20260709 12:27:04.220104 22801 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:04.232412 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.248456 22213 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:04.246433 24285 raft_consensus.cc:697] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:04.248903 22219 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:04.261953 22803 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:27:04.278622 22188 connection.cc:256] RPC call timeout handler was delayed by -1.1199843520003014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 12:27:04.346736 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 177648us
I20260709 12:27:04.326717 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.321916 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.289178 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:04.349578 22148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1584) took 1173 ms. Trace:
I20260709 12:27:04.355050 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.353952 22143 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:04.356312 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.350270 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1579) took 1175 ms. Trace:
I20260709 12:27:04.356348 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.355422 22148 rpcz_store.cc:276] 0709 12:27:03.176600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.177050 (+   450us) service_pool.cc:224] Handling call
0709 12:27:04.349401 (+1172351us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400066654. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.349514 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838179712}
I20260709 12:27:04.350196 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.345824 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2247) took 1088 ms. Trace:
I20260709 12:27:04.359944 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.236941 24180 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.360414 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.357437 22145 rpcz_store.cc:276] 0709 12:27:03.175143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.175473 (+   330us) service_pool.cc:224] Handling call
0709 12:27:03.298794 (+123321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.299307 (+   513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.350077 (+1050770us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400066b50. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.350215 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282826496}
I20260709 12:27:04.352394 22037 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.231364 24306 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.252717 22802 raft_consensus.cc:1240] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:04.246533 24289 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.360710 22185 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:04.253402 24269 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.359356 22073 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:04.231217 24203 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.245476 24117 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.253877 24197 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:04.251911 24235 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.237540 24262 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:04.297453 24271 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:04.360625 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.232556 24292 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:04.343077 24202 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.366667 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:04.367782 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 153952us
I20260709 12:27:04.368363 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.232605 24263 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 12:27:04.457621 22142 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:04.468434 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.471416 22038 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.473325 24117 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.473762 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.474954 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.475440 22220 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:04.475097 24202 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.355899 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 635) took 1275 ms. Trace:
I20260709 12:27:04.478788 22807 rpcz_store.cc:276] 0709 12:27:03.080294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.779836 (+699542us) service_pool.cc:224] Handling call
0709 12:27:03.780257 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.095670 (+315413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.095711 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:04.095756 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:04.095801 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.352868 (+257067us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54006b30d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:04.352913 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.355847 (+  2934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714829056}
I20260709 12:27:04.481032 24285 consensus_queue.cc:237] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.483667 21957 catalog_manager.cc:5028] TS ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): tablet ce0cbcda6ab94ef68d36321d19671059 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
W20260709 12:27:04.484460 21957 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 128040us
I20260709 12:27:04.369181 22773 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:04.486011 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:04.488900 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 119788us
I20260709 12:27:04.492056 22221 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:04.493252 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.248102 24174 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:04.355070 22140 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:27:04.359310 22218 rpcz_store.cc:276] 0709 12:27:03.257708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.301100 (+ 43392us) service_pool.cc:224] Handling call
0709 12:27:04.345577 (+1044477us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400117954. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.345745 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915384064}
W20260709 12:27:04.504029 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.356840 24129 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.368611 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:04.402868 22143 raft_consensus.cc:2393] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:04.366467 24293 raft_consensus.cc:2764] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:27:04.446437 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.373935 24182 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:04.497967 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.501268 24292 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:04.560073 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.566440 22114 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:04.557550 22776 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.366941 24218 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:04.501166 22214 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:04.450089 24300 raft_consensus.cc:3055] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.576788 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.577376 22067 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:04.579288 22068 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:04.580238 22141 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:04.581187 22776 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:04.581982 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.579334 22069 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:04.362556 24259 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 12:27:04.508420 24290 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:04.519793 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:04.435770 22113 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.560s (SENT)
W20260709 12:27:04.591034 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 155326us
I20260709 12:27:04.234217 24258 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:04.591998 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:04.555795 24202 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.525405 24129 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.527195 24180 raft_consensus.cc:2804] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:04.568555 24292 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:04.528612 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 57297.1us
I20260709 12:27:04.606972 24292 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.607335 22038 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.607870 24214 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:04.608405 24214 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:04.608565 22038 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.609323 24214 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.530776 22064 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:04.610507 24197 raft_consensus.cc:2804] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:27:04.527815 22066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 440) took 1839 ms (client timeout 2119 ms). Trace:
W20260709 12:27:04.611100 22066 rpcz_store.cc:269] 0709 12:27:02.688476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.740287 (+ 51811us) service_pool.cc:224] Handling call
0709 12:27:04.527599 (+1787312us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54000b31d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.527753 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316544896}
I20260709 12:27:04.535161 22147 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
W20260709 12:27:04.535633 22071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1438) took 1746 ms (client timeout 1796 ms). Trace:
I20260709 12:27:04.611425 24139 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:04.612103 22071 rpcz_store.cc:269] 0709 12:27:02.789306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.863870 (+ 74564us) service_pool.cc:224] Handling call
0709 12:27:04.535401 (+1671531us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400185bd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.535562 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3177384192}
W20260709 12:27:04.590785 24253 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:27:04.544152 22804 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:04.544572 24187 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.544730 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.635442 22070 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:04.546962 24132 raft_consensus.cc:3055] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:04.550473 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.551440 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:04.500355 22809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 607) took 1994 ms (client timeout 2096 ms). Trace:
W20260709 12:27:04.644620 22809 rpcz_store.cc:269] 0709 12:27:02.506325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.761236 (+254911us) service_pool.cc:224] Handling call
0709 12:27:04.500199 (+1738963us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002323d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.500298 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775797120}
I20260709 12:27:04.364562 24114 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 12:27:04.553434 22072 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:04.500507 22220 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 10.
I20260709 12:27:04.647739 22215 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:04.648403 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.561810 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.504352 24117 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:04.580166 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 77828.8us
I20260709 12:27:04.579759 24218 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:04.654947 22775 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.583899 24295 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:04.584017 24206 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:27:04.585989 22065 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:04.506883 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 468) took 1408 ms. Trace:
W20260709 12:27:04.658020 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 65668.7us
I20260709 12:27:04.587495 22776 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:04.587947 22214 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
W20260709 12:27:04.659598 22113 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.709s (SENT)
I20260709 12:27:04.659998 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.660241 22775 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:04.588411 22114 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:04.232667 24294 consensus_queue.cc:260] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.663553 24294 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.524211 22217 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:04.597012 22221 raft_consensus.cc:2410] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:04.663784 24183 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:04.664700 22217 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:04.656349 24218 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.665879 22217 raft_consensus.cc:1240] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:04.527654 24262 raft_consensus.cc:697] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:04.606402 24180 raft_consensus.cc:697] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:04.667609 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.667321 24180 consensus_queue.cc:237] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.668177 22215 raft_consensus.cc:2376] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 10. Re-sending same reply.
W20260709 12:27:04.668661 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 80355.4us
I20260709 12:27:04.669797 24249 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.670187 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:04.643949 24132 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:04.671418 24132 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.672524 24263 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:04.673044 24263 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.647490 24187 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.673430 24263 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.609728 22038 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:04.675218 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 65561.5us
I20260709 12:27:04.663458 24175 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:04.676179 24175 raft_consensus.cc:697] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:04.676671 24172 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.677461 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.542363 24215 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:04.529940 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.679078 22213 raft_consensus.cc:1240] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:04.679987 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:04.680527 24215 raft_consensus.cc:3055] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:04.680908 24160 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:04.667327 24262 consensus_queue.cc:237] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:04.670486 24249 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:27:04.607429 24129 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.580011 24300 raft_consensus.cc:740] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:04.686183 22114 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:04.587859 24270 raft_consensus.cc:2764] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:27:04.591233 24207 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:04.640839 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 141271us
I20260709 12:27:04.612370 24139 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:04.652087 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:04.689352 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.611112 24197 raft_consensus.cc:697] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:04.660853 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:04.658149 22139 rpcz_store.cc:276] 0709 12:27:03.098306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.101224 (+  2918us) service_pool.cc:224] Handling call
0709 12:27:04.506684 (+1405460us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400224cd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.506816 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346181760}
I20260709 12:27:04.661366 22775 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.658181 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.693717 22113 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:04.661917 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:04.694522 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.672631 24132 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.677110 24175 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.702864 24203 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.703182 24300 consensus_queue.cc:260] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.704452 24300 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.705732 24203 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:04.692241 24139 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.707778 22113 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:04.708551 24247 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.709054 24247 raft_consensus.cc:697] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:04.709961 24247 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:04.710786 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.711011 22801 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:04.553761 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 615) took 2885 ms. Trace:
I20260709 12:27:04.711537 24187 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:04.683130 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:04.680455 22213 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.713433 22140 raft_consensus.cc:1240] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:04.596261 24290 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.604637 24316 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 12:27:04.687312 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 99892.4us
I20260709 12:27:04.720728 22776 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:04.543279 22037 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:04.721812 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 178619us
I20260709 12:27:04.688449 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.722949 22141 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:04.695206 22214 raft_consensus.cc:2393] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:04.694358 22218 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.697553 24183 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:04.682790 24274 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.700197 24206 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:04.734999 24206 raft_consensus.cc:697] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:04.735966 24206 consensus_queue.cc:237] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.700016 24197 consensus_queue.cc:237] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.693894 24129 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:04.657483 24117 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.747575 24174 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.748430 24117 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:04.714773 22213 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.748813 24287 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.716334 22038 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.656209 24295 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:04.754235 24295 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.724628 22036 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:04.755350 24258 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:04.755465 24183 raft_consensus.cc:697] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:04.756446 24183 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.756733 24292 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.757055 24139 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.757501 24173 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:04.757880 24173 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.758226 24173 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.759783 24292 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:04.726305 22114 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:04.685848 24212 raft_consensus.cc:2764] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:27:04.680946 24215 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:04.727280 24202 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.727783 22809 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:04.729866 24260 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:27:04.734040 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.740033 22775 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:04.677884 24172 consensus_queue.cc:1059] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:27:04.718874 24187 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:04.743314 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:04.712858 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:04.808041 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 95271.3us
I20260709 12:27:04.763345 24129 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:04.745038 22776 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:04.811512 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 66565.6us
I20260709 12:27:04.812242 22776 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:04.766919 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.814124 22141 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.711638 22802 rpcz_store.cc:276] 0709 12:27:01.668359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.319926 (+1651567us) service_pool.cc:224] Handling call
0709 12:27:03.320240 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.370078 (+1049838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.553482 (+183404us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54006220d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:04.553686 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094551808}
I20260709 12:27:04.713658 24259 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.692317 24114 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:04.834625 24114 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.834995 24114 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:04.773015 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 48466.2us
I20260709 12:27:04.655470 24271 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.836038 24190 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:04.836465 24190 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:04.837427 24190 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.718168 24231 consensus_queue.cc:1059] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:27:04.718492 24232 consensus_queue.cc:1059] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:27:04.783416 22775 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:04.800078 24290 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:04.801415 24295 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.843902 24290 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.844679 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.845232 24295 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.770920 24258 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:04.845460 24303 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.845794 24258 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.845940 24303 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:04.772780 24246 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:04.849577 24246 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:04.850015 24246 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.851787 24243 consensus_queue.cc:1059] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.852826 24243 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.854257 24249 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.745096 22218 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:04.784555 24203 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:04.855865 24203 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.856228 24203 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.857908 24190 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.847962 24258 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.862452 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.863056 22218 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:04.863818 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.865315 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.865803 22218 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.866654 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.867272 22219 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:04.867450 22146 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:27:04.867574 24139 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:04.868448 22146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1583) took 1692 ms (client timeout 1750 ms). Trace:
W20260709 12:27:04.868790 22146 rpcz_store.cc:269] 0709 12:27:03.176325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.176427 (+   102us) service_pool.cc:224] Handling call
0709 12:27:04.868313 (+1691886us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400330c54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:04.868397 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3887310208}
I20260709 12:27:04.870010 22185 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:04.869571 24168 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.789736 24302 raft_consensus.cc:2804] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:04.873304 22218 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:04.805925 24187 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.829655 24129 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.823623 24169 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:04.831907 24236 raft_consensus.cc:3055] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:04.833446 24173 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.823789 24207 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:04.891925 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 296220us
I20260709 12:27:04.841243 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:04.894124 22221 raft_consensus.cc:1240] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:04.843078 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.843298 24276 raft_consensus.cc:3055] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.855505 24249 raft_consensus.cc:3055] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:04.874568 22113 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:04.903760 22773 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:04.902324 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:04.879019 24298 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:04.875506 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:04.875468 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 150903us
I20260709 12:27:04.878119 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:04.777283 24117 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:27:04.825207 24202 raft_consensus.cc:3055] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.883038 24269 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.839711 24292 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:04.826269 22804 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:04.953078 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:04.879245 24187 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.875926 24302 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:04.839936 24245 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:27:04.919559 22146 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:04.919068 22219 raft_consensus.cc:2376] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4. Re-sending same reply.
I20260709 12:27:04.920720 22037 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:04.924571 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 141243us
I20260709 12:27:04.828729 22141 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:04.922008 24303 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:04.824935 24255 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.884567 24236 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:04.905292 24306 consensus_meta.cc:287] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 12:27:04.873174 24270 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:27:04.877162 24168 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.901291 24276 raft_consensus.cc:740] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:04.904662 24249 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:04.919025 24253 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:04.922086 24160 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:04.967262 22036 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:04.918886 24298 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:04.922006 24180 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.922379 24207 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:04.976305 22775 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:05.005224 22186 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:04.931335 24202 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:05.007944 24231 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.948240 24292 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.008803 24292 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:04.982547 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 168889us
W20260709 12:27:04.985159 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.922580 24252 consensus_queue.cc:1059] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:27:04.991528 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.988523 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.992741 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.968600 24302 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.996266 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:04.996902 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.979398 24255 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.997926 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:04.998725 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.998973 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.999317 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:04.975221 24212 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:27:05.058310 22113 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.067s (SENT) [suppressed 49 similar messages]
I20260709 12:27:05.015339 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:05.061991 22219 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:05.062131 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:05.063498 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:05.064587 22071 raft_consensus.cc:2410] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:05.066083 22066 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:05.068148 22065 raft_consensus.cc:2393] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 2: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:05.069432 22776 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:04.982331 24306 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.954404 24269 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:04.909452 24215 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.097564 22185 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:05.098353 22065 raft_consensus.cc:1240] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:05.098835 22072 raft_consensus.cc:1240] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:05.099478 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:05.100272 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.100570 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:04.993616 24160 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.170706 22775 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:05.130224 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.171769 22143 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
W20260709 12:27:05.171947 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.112828 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:05.172334 22064 raft_consensus.cc:1813] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Handling vote request from an unknown peer ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:05.172941 22064 raft_consensus.cc:2410] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:05.003646 24298 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.175122 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:05.017094 24207 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:05.181432 24326 log.cc:927] Time spent T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:27:05.182327 24255 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.002470 24253 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:05.170461 24212 raft_consensus.cc:697] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:04.987824 24271 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 12:27:05.015695 24175 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:05.103024 24289 consensus_meta.cc:287] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.733s	user 0.005s	sys 0.003s
I20260709 12:27:05.175598 24160 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.169976 24258 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:05.229221 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 267936us
I20260709 12:27:05.018543 24218 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.236227 22037 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:05.223285 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 153931us
I20260709 12:27:04.999991 24260 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.073696 24180 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.205237 24207 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.217311 24215 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.205711 24214 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:05.264074 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.217792 24328 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.239249 24255 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:05.272372 22073 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
W20260709 12:27:05.258112 24300 consensus_meta.cc:287] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.001s
W20260709 12:27:05.255193 24235 consensus_meta.cc:287] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.800s	user 0.006s	sys 0.002s
I20260709 12:27:05.238139 24330 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.249223 24327 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:05.258373 24173 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.284850 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:05.226835 24203 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.293001 22219 raft_consensus.cc:2410] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:27:05.294982 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 175283us
I20260709 12:27:05.278385 24255 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.232664 24246 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:05.282152 24285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.016s
I20260709 12:27:05.302502 22220 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:05.293463 24330 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.289451 24290 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.318974 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:05.290789 24334 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:27:05.224516 24236 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.289301 24328 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:05.257726 24260 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.341490 22066 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 5. Ops: []
I20260709 12:27:05.289651 24174 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.275823 24214 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.251596 24276 consensus_queue.cc:260] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.333911 24173 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:05.338240 24285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.001s	sys 0.016s
I20260709 12:27:05.334237 24255 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.340541 24290 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.368335 24174 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:05.374807 24333 log.cc:927] Time spent T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:27:05.375384 24335 log.cc:927] Time spent T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:27:05.376078 24319 log.cc:927] Time spent T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:27:05.365422 24300 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.295393 24327 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.381235 24340 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.381705 24132 consensus_meta.cc:287] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.001s
I20260709 12:27:05.382910 24260 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.408846 24290 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.385289 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:05.438854 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:05.385915 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:05.441284 22071 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:05.386201 24180 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.386782 24269 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.387665 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:05.390013 24330 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:05.390321 24332 log.cc:927] Time spent T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:27:05.390888 24322 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 12:27:05.394073 24263 consensus_meta.cc:287] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.000s
W20260709 12:27:05.395303 24321 log.cc:927] Time spent T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:27:05.362001 24292 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.348417 24253 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.363024 24328 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.351027 24289 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:05.347229 22801 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:05.369728 24173 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:05.404222 24294 consensus_meta.cc:287] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.714s	user 0.008s	sys 0.000s
W20260709 12:27:05.374840 24325 log.cc:927] Time spent T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 12:27:05.458621 24287 consensus_meta.cc:287] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.003s
W20260709 12:27:05.412529 24114 consensus_meta.cc:287] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.002s
I20260709 12:27:05.480271 24114 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.481441 24168 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.482261 24114 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:05.441499 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:05.412878 24258 raft_consensus.cc:697] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:05.341915 24212 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.447975 24246 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:05.438868 24340 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:05.438452 24274 consensus_meta.cc:287] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.695s	user 0.004s	sys 0.005s
I20260709 12:27:05.450048 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:05.430467 24349 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.404170 24214 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.456444 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1806) took 1096 ms. Trace:
I20260709 12:27:05.431778 24300 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.464679 24173 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.465503 24295 raft_consensus.cc:3055] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:05.378798 24187 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.469575 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:05.469861 24259 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:05.470824 24207 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.465517 24235 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.473242 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1800) took 1115 ms. Trace:
I20260709 12:27:05.473707 24327 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.473871 22214 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:05.473598 24298 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.475256 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:05.475559 24302 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.454551 24263 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.486796 22213 raft_consensus.cc:2393] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 3: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:05.464010 24218 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:05.488665 22804 raft_consensus.cc:2368] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3.
I20260709 12:27:05.721550 24292 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:05.463593 24289 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:05.733692 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 233511us
I20260709 12:27:05.734309 24263 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:05.733273 22801 raft_consensus.cc:1240] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:05.727154 22215 rpcz_store.cc:276] 0709 12:27:04.363248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.668805 (+305557us) service_pool.cc:224] Handling call
0709 12:27:04.669120 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:04.669470 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.669509 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:04.669934 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:27:04.876058 (+206124us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:05.274513 (+398455us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.416691 (+142178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.416767 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:05.456195 (+ 39428us) raft_consensus.cc:1685] finished
0709 12:27:05.456218 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.456373 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":569340,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":15234,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":2926,"thread_start_us":715405,"threads_started":3,"wal-append.queue_time_us":347300}
I20260709 12:27:05.533324 24290 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.723565 24300 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:05.587775 24319 log.cc:927] Time spent T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:27:05.724237 24207 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.529280 24328 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:05.490058 24258 consensus_queue.cc:237] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:05.564697 24202 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.759639 24202 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:05.656177 24320 log.cc:927] Time spent T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.485s	user 0.002s	sys 0.000s
I20260709 12:27:05.732746 24236 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.561739 24287 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:05.764279 24287 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.726349 24235 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.659773 24249 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.743749 24203 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.746414 24348 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.770533 24348 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.750171 24298 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:05.733129 24302 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.727311 24295 raft_consensus.cc:740] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:05.772908 24295 consensus_queue.cc:260] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.744517 24349 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.598583 24248 raft_consensus.cc:3055] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:05.754153 24289 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:05.726069 24340 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.701327 24255 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.774425 24295 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.779572 24255 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:05.768867 24287 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:05.777623 24248 raft_consensus.cc:740] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:05.781442 24248 consensus_queue.cc:260] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:05.788092 24290 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:05.832674 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:05.833973 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.384481 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:05.841957 22072 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:05.442432 22071 raft_consensus.cc:1240] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:27:05.596177 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.491562 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:05.728020 22220 rpcz_store.cc:276] 0709 12:27:04.358170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.648171 (+290001us) service_pool.cc:224] Handling call
0709 12:27:05.473069 (+824898us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54001f4354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:05.473188 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384850176}
W20260709 12:27:05.643455 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.601492 22221 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:05.493187 22222 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:05.842564 22068 raft_consensus.cc:1240] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 1. Current term is 3. Ops: []
I20260709 12:27:05.853184 22216 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:05.854324 22218 raft_consensus.cc:2468] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 1.
I20260709 12:27:05.855721 22219 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:27:05.852077 22144 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:05.866817 22219 pending_rounds.cc:85] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting all ops after (but not including) 5
W20260709 12:27:05.860105 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:05.860137 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.868052 22219 pending_rounds.cc:107] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:27:05.868578 22219 raft_consensus.cc:2889] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:05.871496 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:05.872713 22145 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:05.875077 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:05.876303 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:05.876659 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:05.877218 22218 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:05.877457 22221 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.661257 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:05.727591 22809 raft_consensus.cc:2393] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:05.726873 22810 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:05.531926 24160 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:05.769685 24235 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:05.777169 24349 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:05.879308 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:05.947300 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:05.933614 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:05.866888 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.767915 24249 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.683320 24175 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:05.987161 24294 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.987812 24274 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.987437 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 150147us
W20260709 12:27:05.987814 22067 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.002s	sys 0.012s
I20260709 12:27:05.988471 24287 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.989173 24246 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:05.989498 24160 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:06.006791 24252 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.046543 24252 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.047755 22069 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:27:06.049372 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1449) took 1049 ms. Trace:
I20260709 12:27:06.032153 24298 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:06.051153 24274 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.051784 24298 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.052362 24129 consensus_queue.cc:1059] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:06.008024 24248 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:06.011020 22143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51462 (request call id 2140) took 1454 ms (client timeout 1791 ms). Trace:
I20260709 12:27:06.002718 24187 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:06.031257 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 268606us
I20260709 12:27:06.031883 22139 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:06.032395 24289 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:06.060570 24289 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.032910 24300 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.031340 22220 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.042076 24294 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.072542 24276 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.076798 22807 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:06.043435 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.043018 24246 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.044718 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 485) took 1131 ms. Trace:
I20260709 12:27:06.011569 24206 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:06.049847 22069 rpcz_store.cc:276] 0709 12:27:04.999510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.063237 (+ 63727us) service_pool.cc:224] Handling call
0709 12:27:06.049096 (+985859us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54000d5f54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:06.049263 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790797696}
W20260709 12:27:06.042104 22067 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.003s	sys 0.012s
I20260709 12:27:06.057785 22803 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:06.069576 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:06.080502 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.086119 22064 consensus_meta.cc:287] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.012s
I20260709 12:27:06.086742 22064 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:06.089072 24206 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.081904 22144 rpcz_store.cc:276] 0709 12:27:04.913330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.913426 (+    96us) service_pool.cc:224] Handling call
0709 12:27:06.044405 (+1130979us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b540039fb54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:06.044625 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2063804160}
I20260709 12:27:06.049657 24252 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:06.054242 22143 rpcz_store.cc:269] 0709 12:27:04.556746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.561489 (+  4743us) service_pool.cc:224] Handling call
0709 12:27:06.010479 (+1448990us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54000023d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:06.010743 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201729408}
I20260709 12:27:06.042461 24287 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.103951 24173 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.108994 24173 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:06.112416 22073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 456) took 1644 ms (client timeout 2026 ms). Trace:
W20260709 12:27:06.113034 22073 rpcz_store.cc:269] 0709 12:27:04.468018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.468161 (+   143us) service_pool.cc:224] Handling call
0709 12:27:06.112059 (+1643898us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54000d5a54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:06.112225 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847024512}
I20260709 12:27:06.125785 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:06.130060 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:06.115952 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44992 (request call id 1448) took 1116 ms. Trace:
I20260709 12:27:06.143005 24349 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.143922 24349 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.143669 24287 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:06.137187 22068 rpcz_store.cc:276] 0709 12:27:04.999218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.999724 (+   506us) service_pool.cc:224] Handling call
0709 12:27:04.999987 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.863979 (+863992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.115619 (+251640us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400094a54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:06.115868 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936147200}
I20260709 12:27:06.097046 24206 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:06.163885 22221 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:06.169838 24348 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:06.161182 24287 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.172240 24287 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.173890 22141 raft_consensus.cc:1240] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:06.195410 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:06.179382 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:06.179744 24351 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.199810 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:06.203706 22220 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:06.179322 24349 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:06.208292 24357 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.208644 22112 leader_election.cc:400] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3.
I20260709 12:27:06.228327 22112 leader_election.cc:403] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:27:06.210718 22037 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:06.189112 24300 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.233918 24336 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:06.235163 24294 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:06.212508 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:06.235517 24300 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:06.213013 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:06.236517 22809 raft_consensus.cc:2368] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4.
I20260709 12:27:06.235816 22147 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:06.180437 24246 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:06.214985 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:06.217250 22072 raft_consensus.cc:1240] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:06.217836 22139 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:06.213987 24287 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:06.218562 22775 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:06.219133 24351 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.220744 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:06.222607 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:06.224681 22143 raft_consensus.cc:2368] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4.
I20260709 12:27:06.223037 24255 consensus_queue.cc:1059] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.230441 22145 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
W20260709 12:27:06.237504 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.220495 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:06.248154 22146 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.251636 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:06.269747 24255 raft_consensus.cc:3055] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:06.270810 22807 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:06.271555 22805 raft_consensus.cc:1240] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:27:06.269434 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 93659.9us
I20260709 12:27:06.264464 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:06.277113 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 573) took 1028 ms. Trace:
I20260709 12:27:06.270278 24255 raft_consensus.cc:740] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:06.277486 22805 rpcz_store.cc:276] 0709 12:27:05.249089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.249203 (+   114us) service_pool.cc:224] Handling call
0709 12:27:06.270715 (+1021512us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:06.271041 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.275056 (+  4015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.277045 (+  1989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9392000}
I20260709 12:27:06.260306 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:06.286196 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.288092 24160 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:06.297539 24160 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.299194 24255 consensus_queue.cc:260] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.300155 24160 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:06.300784 24255 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.302719 24262 consensus_queue.cc:1059] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:27:06.304121 24262 raft_consensus.cc:3055] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:06.304520 24262 raft_consensus.cc:740] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:06.305754 24262 consensus_queue.cc:260] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.306849 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:06.306680 24357 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.307709 22804 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:06.308471 24289 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:06.308911 24357 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:06.312642 22148 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:06.284039 24174 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:06.283406 24287 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:06.293607 24246 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.310860 24294 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.384955 24262 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.385731 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1817) took 2016 ms. Trace:
I20260709 12:27:06.389415 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:06.391393 22216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2244) took 3134 ms (client timeout 2756 ms). Trace:
I20260709 12:27:06.410459 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:06.395105 24263 raft_consensus.cc:3055] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:06.395262 22142 raft_consensus.cc:1275] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:06.397007 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:06.331593 22037 leader_election.cc:400] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4.
I20260709 12:27:06.403550 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:06.490338 22217 raft_consensus.cc:1275] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:06.762849 22037 leader_election.cc:403] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:06.614888 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1947) took 1231 ms. Trace:
I20260709 12:27:06.763698 24302 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.764262 22140 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:06.761539 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:06.759191 22070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.021s	sys 0.031s
I20260709 12:27:06.765878 22148 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
W20260709 12:27:06.491714 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.766152 22070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.022s	sys 0.031s
I20260709 12:27:06.398886 22214 rpcz_store.cc:276] 0709 12:27:04.369223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.728304 (+359081us) service_pool.cc:224] Handling call
0709 12:27:05.473562 (+745258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.728199 (+254637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.385293 (+657094us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54001f4350. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:06.385537 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713264000}
I20260709 12:27:06.769404 22146 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:06.493458 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1949) took 1109 ms. Trace:
I20260709 12:27:06.581821 22036 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:06.771230 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.568845 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 350377us
I20260709 12:27:06.569339 24336 raft_consensus.cc:2804] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:06.773001 24336 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:06.770766 22065 rpcz_store.cc:276] 0709 12:27:05.384038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.840129 (+456091us) service_pool.cc:224] Handling call
0709 12:27:05.841158 (+  1029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.995428 (+154270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.995475 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.002110 (+  6635us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.239083 (+236973us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:06.239126 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.239200 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.493118 (+253918us) raft_consensus.cc:1685] finished
0709 12:27:06.493140 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.493284 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150280,"raft.queue_time_us":165618,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":265,"thread_start_us":236216,"threads_started":1,"wal-append.queue_time_us":488364}
I20260709 12:27:06.773470 24336 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:06.640551 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 425875us
I20260709 12:27:06.541817 24349 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:06.782938 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 490980us
W20260709 12:27:06.623031 24248 consensus_meta.cc:287] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
W20260709 12:27:06.786064 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.437134 24357 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.436010 22068 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
W20260709 12:27:06.734673 24367 log.cc:927] Time spent T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:27:06.781073 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 535599us
I20260709 12:27:06.783228 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:06.783949 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.410851 22216 rpcz_store.cc:269] 0709 12:27:03.257221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.671988 (+414767us) service_pool.cc:224] Handling call
0709 12:27:04.110301 (+438313us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b58000f5a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:27:06.391134 (+2280833us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540031bfd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:06.391284 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4011459584}
I20260709 12:27:06.495154 24258 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:06.762141 24263 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:06.784935 24215 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.408896 24287 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.769932 24351 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:06.438470 24294 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.765166 22067 rpcz_store.cc:276] 0709 12:27:05.383594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.445633 (+ 62039us) service_pool.cc:224] Handling call
0709 12:27:05.445907 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.446095 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:06.093447 (+647352us) log.cc:844] Serialized 14 byte log entry
0709 12:27:06.487221 (+393774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.534197 (+ 46976us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:06.581771 (+ 47574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.593421 (+ 11650us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.614804 (+ 21383us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":660311,"prepare.run_cpu_time_us":165,"prepare.run_wall_time_us":7695,"raft.queue_time_us":15314,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":22846,"thread_start_us":959132,"threads_started":2,"wal-append.queue_time_us":516262}
W20260709 12:27:06.793620 22064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.042s	sys 0.050s
I20260709 12:27:06.800719 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:06.413054 24289 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:06.799886 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:06.802778 22064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.043s	sys 0.050s
I20260709 12:27:06.805600 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:06.787247 24349 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.806574 24173 raft_consensus.cc:2764] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:06.800662 24187 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:06.788868 24174 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.814188 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:06.764397 24302 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.832582 22068 raft_consensus.cc:2410] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:06.794070 24160 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.827400 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1815) took 2459 ms. Trace:
W20260709 12:27:06.814692 22807 consensus_meta.cc:287] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.004s
W20260709 12:27:06.827267 22222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2233) took 3577 ms (client timeout 2207 ms). Trace:
I20260709 12:27:06.836587 22066 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:06.837389 22222 rpcz_store.cc:269] 0709 12:27:03.252264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.549679 (+297415us) service_pool.cc:224] Handling call
0709 12:27:06.826917 (+3277238us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54001f5254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:06.827079 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4451195136}
I20260709 12:27:06.838068 24295 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:06.838156 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:06.838691 24295 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.839079 24295 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.839323 22140 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:06.839495 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:06.840096 22067 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.840920 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:06.841588 22066 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:06.842739 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:06.835150 22217 rpcz_store.cc:276] 0709 12:27:04.367612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.714577 (+346965us) service_pool.cc:224] Handling call
0709 12:27:06.437240 (+1722663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.768584 (+331344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.827158 (+ 58574us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540031bfd0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:06.827304 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3805222272}
I20260709 12:27:06.845744 22775 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:06.846380 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:06.823385 24236 consensus_meta.cc:287] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 1.024s	user 0.012s	sys 0.004s
I20260709 12:27:06.819617 24351 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:06.821144 24187 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.823699 24175 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:06.830219 24258 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.801498 24357 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.854861 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:06.858045 22139 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:06.861136 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:06.860407 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:06.864089 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 267300us
I20260709 12:27:06.867260 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:06.867870 22148 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:06.866982 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:06.833472 24289 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.871507 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:06.843686 22807 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:06.824185 24253 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.863039 24187 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.851461 24351 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:06.872932 24289 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:06.880303 22066 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.861876 24300 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.902061 22773 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:06.902961 24249 consensus_meta.cc:287] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.870s	user 0.006s	sys 0.008s
I20260709 12:27:06.903730 24175 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.904655 24253 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.841980 24263 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.880003 24190 raft_consensus.cc:2804] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:06.873431 24174 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.876400 24160 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.928850 22775 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:06.914837 22067 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
W20260709 12:27:06.894346 24276 consensus_meta.cc:287] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.004s
I20260709 12:27:06.920678 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:06.924408 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 70849.6us
I20260709 12:27:06.924963 24190 raft_consensus.cc:697] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:06.926291 24236 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.926791 24363 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:06.901373 24351 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.968899 24263 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.878259 24274 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:06.978435 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:06.981235 22140 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:27:06.980377 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 101683us
I20260709 12:27:06.919427 24300 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:06.961090 24357 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:06.984141 22067 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:27:06.984400 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.989326 22066 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:06.991689 22144 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:06.981526 24255 consensus_meta.cc:287] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.680s	user 0.012s	sys 0.001s
I20260709 12:27:06.998715 24298 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:06.999054 24160 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.000062 22073 raft_consensus.cc:2410] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:06.990674 24190 consensus_queue.cc:237] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:06.996594 24303 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.972962 24236 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:07.003322 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.004582 24183 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:07.004760 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.007134 22143 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:07.012012 22037 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:06.993587 24276 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.004733 24274 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:07.028605 22067 raft_consensus.cc:1240] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:27:07.013145 24253 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.029443 24255 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:07.030177 24298 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:07.036521 24298 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.014635 24236 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.033938 24274 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.007469 24363 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:27:07.035328 24302 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.034884 24276 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.035981 24294 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.034132 24287 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.010942 24374 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.047848 24255 raft_consensus.cc:697] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:07.064620 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 171055us
I20260709 12:27:07.031699 24183 raft_consensus.cc:697] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:07.073318 22143 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.022717 24295 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.076747 22036 leader_election.cc:400] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4.
I20260709 12:27:07.029059 24303 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.069169 24298 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:07.096329 24246 consensus_meta.cc:287] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.001s
I20260709 12:27:07.096810 24246 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3.
I20260709 12:27:07.098017 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.098178 22113 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:07.099948 24215 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4.
I20260709 12:27:07.103179 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.082376 24258 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.110059 22143 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:07.106498 24298 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.085772 24374 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.107965 24386 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:07.120326 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:07.131372 22113 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:07.111235 24175 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:07.133898 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 804997us
I20260709 12:27:07.141530 22217 raft_consensus.cc:2393] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
W20260709 12:27:07.130108 24262 consensus_meta.cc:287] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.727s	user 0.006s	sys 0.006s
I20260709 12:27:07.133586 24174 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.147352 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:07.185268 22073 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:07.147558 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:07.149362 22067 raft_consensus.cc:1240] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:27:07.186481 22066 raft_consensus.cc:1813] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Handling vote request from an unknown peer 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:07.187518 22066 raft_consensus.cc:2410] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:07.160192 22221 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.161438 22219 raft_consensus.cc:1275] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:07.192524 22146 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:07.194674 22072 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:07.170728 22038 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:07.203140 24388 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.203687 24388 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.205755 24388 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:07.179940 24365 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.480s	user 0.001s	sys 0.001s
W20260709 12:27:07.206746 24377 log.cc:927] Time spent T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:27:07.210198 24374 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.160508 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:07.227710 22216 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.161957 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:07.210702 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.149612 24298 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.211835 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 461) took 1829 ms. Trace:
I20260709 12:27:07.147899 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.149472 24382 consensus_queue.cc:1059] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:27:07.235417 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:07.146471 24173 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.218339 24378 log.cc:927] Time spent T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 12:27:07.218781 24386 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.159246 24276 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.221094 22185 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:07.222438 24373 log.cc:927] Time spent T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.487s	user 0.001s	sys 0.001s
I20260709 12:27:07.224721 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:07.229208 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.221028 22220 raft_consensus.cc:1240] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.234059 22068 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:07.228518 22214 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:07.237468 22222 raft_consensus.cc:2410] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:27:07.212924 24380 log.cc:927] Time spent T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 12:27:07.195394 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 209783us
I20260709 12:27:07.154743 24295 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.254180 22217 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:07.219674 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 90961.5us
W20260709 12:27:07.171670 24370 log.cc:927] Time spent T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.561s	user 0.000s	sys 0.003s
I20260709 12:27:07.154078 24303 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:07.246857 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 49345.9us
I20260709 12:27:07.186559 24351 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.169618 24349 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.225651 24274 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.261804 22804 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:07.140161 24255 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.263525 22114 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:07.269205 22219 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:07.231317 22070 rpcz_store.cc:276] 0709 12:27:05.382249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.386797 (+  4548us) service_pool.cc:224] Handling call
0709 12:27:05.387124 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.405760 (+ 18636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.405788 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.417200 (+ 11412us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.130543 (+713343us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b1800382240. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b 00007ff18c2a5d23 00007ff18c2a60d1 00007ff18c6c1a0f
0709 12:27:06.802500 (+671957us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:06.802554 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.811140 (+  8586us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.207921 (+396781us) raft_consensus.cc:1685] finished
0709 12:27:07.211461 (+  3540us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.211755 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18273,"raft.queue_time_us":23039,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5279,"spinlock_wait_cycles":21604096,"thread_start_us":634801,"threads_started":1,"wal-append.queue_time_us":1446012}
I20260709 12:27:07.255999 24258 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:07.252262 24374 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:07.273710 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 52749.7us
I20260709 12:27:07.274384 22185 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:07.272826 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 184114us
I20260709 12:27:07.270035 22215 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
W20260709 12:27:07.266229 24372 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.428s	user 0.001s	sys 0.002s
I20260709 12:27:07.255868 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.147070 24183 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:07.280918 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 214888us
W20260709 12:27:07.270897 24369 log.cc:927] Time spent T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.534s	user 0.001s	sys 0.005s
I20260709 12:27:07.169581 24336 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.283638 22185 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:07.287772 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:07.287942 22807 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:07.253819 24248 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:27:07.267307 24276 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:07.279325 24349 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.300493 22213 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.282873 24274 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:07.302302 22036 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:07.307571 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1952) took 1922 ms. Trace:
I20260709 12:27:07.291589 24388 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:07.285317 24215 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.310140 22114 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:07.278661 24173 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.308159 22064 rpcz_store.cc:276] 0709 12:27:05.384809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.087746 (+702937us) service_pool.cc:224] Handling call
0709 12:27:06.088283 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.094573 (+  6290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.094620 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.162303 (+ 67683us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.805745 (+643442us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:06.805785 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.805849 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.217605 (+411756us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:07.305845 (+ 88240us) raft_consensus.cc:1685] finished
0709 12:27:07.305863 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.307500 (+  1637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9691,"raft.queue_time_us":7725,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":13301,"spinlock_wait_cycles":99039104,"thread_start_us":559311,"threads_started":1,"wal-append.queue_time_us":661717}
I20260709 12:27:07.318934 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.319725 24385 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:07.320335 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.297704 24190 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.323335 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 152901us
I20260709 12:27:07.316330 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.325251 22140 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:07.332630 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.333230 22147 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:07.321127 24381 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:07.311177 24388 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.342130 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.341634 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 577) took 1160 ms. Trace:
I20260709 12:27:07.305263 24295 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:07.340180 22215 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:07.303977 24274 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.304872 24246 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:07.299994 24374 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.286001 24386 consensus_queue.cc:1059] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:27:07.343820 22144 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:07.345598 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.321395 24287 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.341956 24236 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.341713 24263 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:07.350046 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1954) took 1356 ms. Trace:
I20260709 12:27:07.342819 22803 rpcz_store.cc:276] 0709 12:27:06.179973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.192158 (+ 12185us) service_pool.cc:224] Handling call
0709 12:27:06.247930 (+ 55772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.569685 (+321755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.569725 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.570381 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.788158 (+217777us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:06.788207 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.788282 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.212112 (+423830us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:07.327360 (+115248us) raft_consensus.cc:1685] finished
0709 12:27:07.327379 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.339732 (+ 12353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479587,"raft.queue_time_us":301538,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":14596,"spinlock_wait_cycles":97873280,"thread_start_us":206104,"threads_started":1,"wal-append.queue_time_us":305887}
I20260709 12:27:07.345165 24385 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:07.352901 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.328822 24294 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.333904 24174 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:27:07.354743 22145 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:07.354305 22038 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:07.356235 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.338544 24381 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.344988 24289 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:07.379413 24263 raft_consensus.cc:697] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:07.379581 24381 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:07.380434 24263 consensus_queue.cc:237] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.382733 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 568) took 2101 ms. Trace:
I20260709 12:27:07.384582 24294 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.371331 24160 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:27:07.334182 24190 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.387722 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 633) took 1899 ms. Trace:
I20260709 12:27:07.359097 22140 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:07.388116 22808 rpcz_store.cc:276] 0709 12:27:05.487823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.490418 (+  2595us) service_pool.cc:224] Handling call
0709 12:27:05.490705 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.727493 (+236788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.727526 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.736878 (+  9352us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.405911 (+669033us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:06.435368 (+ 29457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.450727 (+ 15359us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.166344 (+715617us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:07.377866 (+211522us) raft_consensus.cc:1685] finished
0709 12:27:07.377890 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.387537 (+  9647us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44119,"raft.queue_time_us":242653,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4535,"spinlock_wait_cycles":373654784,"thread_start_us":269435,"threads_started":1,"wal-append.queue_time_us":515025}
I20260709 12:27:07.372941 22222 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:07.392418 24174 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:07.392854 24174 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:07.366113 22804 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEARNER]: Advancing to term 4
I20260709 12:27:07.393769 24174 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.362475 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:07.344611 24388 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.428488 22222 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:07.429533 24173 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.305536 24303 consensus_queue.cc:1048] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:27:07.349823 24187 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.433492 24289 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.431238 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.434162 24187 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.434995 22065 raft_consensus.cc:2393] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:07.435302 22222 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:07.435786 24289 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.324257 24276 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.436259 22214 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.437740 24276 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.346837 24300 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.352216 24274 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.372464 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.439047 22146 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:07.436084 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1964) took 1044 ms. Trace:
I20260709 12:27:07.375579 22143 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:07.386713 24287 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.390368 24236 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:07.399056 24375 log.cc:927] Time spent T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.495s	user 0.002s	sys 0.002s
I20260709 12:27:07.401144 24249 raft_consensus.cc:3055] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:07.402221 24393 raft_consensus.cc:3055] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:07.403187 24385 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.377754 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:07.449765 22220 raft_consensus.cc:2393] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:07.303551 24258 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.404512 22037 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:07.450841 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 46447.4us
I20260709 12:27:07.405427 24298 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.351432 24295 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.408483 24382 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:07.409030 24248 consensus_queue.cc:1059] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.417843 22218 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:07.418792 24384 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:27:07.348918 24349 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.423353 24390 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:07.424299 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 85411us
I20260709 12:27:07.349503 22036 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:07.365855 22069 rpcz_store.cc:276] 0709 12:27:06.040480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.114176 (+ 73696us) service_pool.cc:224] Handling call
0709 12:27:06.114585 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.115126 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.115167 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.115752 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.577342 (+461590us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:06.577381 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.577475 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.213810 (+636335us) spinlock_profiling.cc:243] Waited 89 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:07.346391 (+132581us) raft_consensus.cc:1685] finished
0709 12:27:07.346412 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.349984 (+  3572us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9896,"raft.queue_time_us":1330,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":20053,"spinlock_wait_cycles":204763904,"thread_start_us":461146,"threads_started":1,"wal-append.queue_time_us":695649}
W20260709 12:27:07.424122 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 57519.6us
I20260709 12:27:07.439606 22065 rpcz_store.cc:276] 0709 12:27:06.391257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.851722 (+460465us) service_pool.cc:224] Handling call
0709 12:27:07.435900 (+584178us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54001d5bd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:07.436026 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300902656}
W20260709 12:27:07.446100 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 94407.5us
W20260709 12:27:07.451613 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.451558 22216 raft_consensus.cc:2410] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:07.463121 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:07.447106 24393 raft_consensus.cc:740] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:07.463984 24382 raft_consensus.cc:697] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:07.464870 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.453146 24187 raft_consensus.cc:2804] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:07.467015 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.469301 24381 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:07.472103 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.501040 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.502351 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 164277us
I20260709 12:27:07.473042 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.477383 22214 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:07.447748 24249 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:07.448611 24190 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:07.494613 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 162672us
W20260709 12:27:07.494896 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.493074 22776 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:07.453313 24351 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.496343 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.511173 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:07.511773 22216 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:07.511907 22139 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.493738 22218 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:07.500236 24391 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:07.485533 22222 raft_consensus.cc:2376] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2. Re-sending same reply.
I20260709 12:27:07.446732 24246 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.513931 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.519568 22220 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:07.517867 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.498138 24187 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.507992 24174 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.526858 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.527534 22776 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:07.524173 24294 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.528357 22218 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:07.530017 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.508244 24390 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.532071 24236 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.532930 24390 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.502678 24336 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.533999 24388 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:07.526782 24187 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.535606 24295 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.535961 24246 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.536505 22147 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:27:07.540226 24388 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.541663 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.542688 24363 raft_consensus.cc:2804] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:07.502024 24173 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:07.543251 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:07.544221 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.565939 22145 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:07.526419 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:07.527485 22222 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:07.552066 22139 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:07.561400 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.564520 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.575641 22213 raft_consensus.cc:2410] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:07.578410 22219 raft_consensus.cc:1240] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.562932 24263 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.583369 22776 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:07.583000 24263 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:07.584406 24351 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:07.587739 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.568351 22036 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:07.609808 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:07.611887 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 43614.2us
I20260709 12:27:07.595124 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.624172 22143 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:07.634101 24263 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:07.635402 24175 consensus_queue.cc:1059] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:07.542906 24298 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.633888 24336 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:07.567545 24363 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.664965 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.383232 22802 rpcz_store.cc:276] 0709 12:27:05.246571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.248491 (+  1920us) service_pool.cc:224] Handling call
0709 12:27:06.048294 (+799803us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:06.048774 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.115575 (+ 66801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.115612 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.119805 (+  4193us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.405691 (+285886us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:06.406811 (+  1120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.412140 (+  5329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.221756 (+809616us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:07.338303 (+116547us) raft_consensus.cc:1685] finished
0709 12:27:07.338337 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.347718 (+  9381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65994,"raft.queue_time_us":81782,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":21492,"spinlock_wait_cycles":331550336,"thread_start_us":277085,"threads_started":1,"wal-append.queue_time_us":612315}
I20260709 12:27:07.586478 24294 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.666499 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 81824.3us
I20260709 12:27:07.675093 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.521407 24391 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.815336 22803 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:07.816347 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.816941 24391 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:07.690757 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.698264 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.637881 24173 raft_consensus.cc:697] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:07.698992 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.713691 22217 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:07.699808 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:07.802676 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 276402us
W20260709 12:27:07.741079 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.772423 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 51760.9us
W20260709 12:27:07.804186 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 284967us
W20260709 12:27:07.811419 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 248240us
I20260709 12:27:07.865453 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:08.065789 22213 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:08.066310 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.924235 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:07.865260 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 67518.1us
I20260709 12:27:08.067499 22222 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:07.817426 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:08.070022 22803 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
W20260709 12:27:08.070907 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.067413 22809 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:27:07.923305 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:07.925673 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:07.944741 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.931236 22188 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:07.668459 24363 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.817658 22776 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:07.865758 24287 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:08.066102 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:08.068665 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:08.083083 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 265484us
I20260709 12:27:08.089589 24406 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:08.090461 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1950) took 2706 ms. Trace:
I20260709 12:27:08.091444 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.664943 24394 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:08.041972 22808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.019s	sys 0.017s
W20260709 12:27:08.094547 22808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.020s	sys 0.017s
I20260709 12:27:08.094344 22148 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:08.095999 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:08.096864 22214 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:08.098977 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.099781 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:08.100533 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.686108 24215 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:07.782439 24258 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:07.718210 24294 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:07.703078 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.912297 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.865526 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:07.698410 24298 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.088574 22142 raft_consensus.cc:2376] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3. Re-sending same reply.
I20260709 12:27:08.103396 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:07.741405 24190 raft_consensus.cc:3055] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:08.388094 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:08.079715 24388 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.785861 24174 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.603s
W20260709 12:27:08.101652 24255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.027s	sys 0.025s
W20260709 12:27:08.389353 24255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.027s	sys 0.047s
I20260709 12:27:08.140336 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:08.391185 22222 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:07.674826 24262 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:08.103680 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.397078 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.675097 24249 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.148254 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:08.103432 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:08.388777 22213 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:07.781853 24382 consensus_queue.cc:237] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:08.086054 24349 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:07.705049 24295 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:08.416333 24295 raft_consensus.cc:697] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:08.417250 22213 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:08.417388 24295 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.388100 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:08.330121 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 242519us
I20260709 12:27:07.981194 24336 raft_consensus.cc:697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:08.017693 24405 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.098475 24410 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:07.687582 24393 consensus_queue.cc:260] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:07.862960 24187 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.388402 24190 raft_consensus.cc:740] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:08.414826 24349 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.414702 24215 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.415302 22222 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:08.459398 22222 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:08.460170 24187 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:08.460630 22222 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:08.388836 24388 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:08.222397 24374 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:08.124063 24287 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.462567 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.463357 22143 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:27:08.463218 24287 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.464990 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2270) took 1302 ms. Trace:
I20260709 12:27:08.465404 24287 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:08.466035 22215 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:08.466682 24405 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.467901 24190 consensus_queue.cc:260] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.468924 24190 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:08.469188 24405 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:08.469413 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.470031 22142 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
W20260709 12:27:08.471355 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.471652 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.472249 22147 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:08.473017 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.473795 24262 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.474318 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:08.465443 22217 rpcz_store.cc:276] 0709 12:27:07.184527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.197933 (+ 13406us) service_pool.cc:224] Handling call
0709 12:27:08.464783 (+1266850us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5400295c54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:08.464889 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41603328}
W20260709 12:27:08.331740 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 400625us
I20260709 12:27:08.331039 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:08.478348 22218 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:08.429116 24298 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:08.241557 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:08.432933 22801 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
W20260709 12:27:08.221042 24401 log.cc:927] Time spent T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.147s	user 0.000s	sys 0.005s
W20260709 12:27:08.433727 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 206279us
W20260709 12:27:08.291185 24274 consensus_meta.cc:287] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.840s	user 0.000s	sys 0.009s
I20260709 12:27:08.221869 24407 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.150033 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:08.092921 22071 rpcz_store.cc:276] 0709 12:27:05.384313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.848792 (+464479us) service_pool.cc:224] Handling call
0709 12:27:05.849459 (+   667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.032839 (+183380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.032874 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.033582 (+   708us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.412492 (+378910us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:06.412538 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.412619 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.207949 (+795330us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:08.080871 (+872922us) raft_consensus.cc:1685] finished
0709 12:27:08.080896 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.090282 (+  9386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182529,"raft.queue_time_us":197366,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":193,"spinlock_wait_cycles":351995136,"thread_start_us":378422,"threads_started":1,"wal-append.queue_time_us":778656}
I20260709 12:27:08.143042 24248 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:08.087157 24398 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.443346 24351 raft_consensus.cc:697] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:08.446893 24385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.009s	sys 0.006s
I20260709 12:27:08.406842 24386 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.413106 24258 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:08.462430 22804 consensus_meta.cc:287] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.069s	user 0.010s	sys 0.000s
I20260709 12:27:08.452088 24410 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.482563 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:08.573012 24410 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:08.404172 24173 consensus_queue.cc:237] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:08.573755 24397 raft_consensus.cc:3055] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:08.574153 24397 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:08.575430 22804 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:27:08.463254 24403 log.cc:927] Time spent T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:27:08.502739 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 414006us
I20260709 12:27:08.509415 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:08.550308 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.591696 22148 raft_consensus.cc:2393] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
W20260709 12:27:08.491639 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.509074 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:08.551349 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.509912 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:08.533417 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.590641 22067 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:08.578454 22806 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Advancing to term 5
I20260709 12:27:08.606768 24398 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:08.617199 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 196983us
I20260709 12:27:08.617913 22775 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:08.576182 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 642) took 1286 ms. Trace:
I20260709 12:27:08.625211 22065 raft_consensus.cc:2393] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:08.626448 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.627338 22148 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
W20260709 12:27:08.630298 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 47521.2us
W20260709 12:27:08.579121 24385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.010s	sys 0.007s
I20260709 12:27:08.614399 24388 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:08.614759 24248 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:08.599169 24274 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:08.474269 24262 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:08.661464 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.657881 22775 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:08.669565 22214 consensus_meta.cc:287] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.000s
I20260709 12:27:08.669963 22214 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:08.672930 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:08.625288 22804 rpcz_store.cc:276] 0709 12:27:07.290300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.297633 (+  7333us) service_pool.cc:224] Handling call
0709 12:27:07.340123 (+ 42490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.575826 (+1235703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.576106 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:08.666297 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 86768.9us
W20260709 12:27:08.675401 22114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.016s
I20260709 12:27:08.678519 22221 raft_consensus.cc:2393] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
W20260709 12:27:08.678833 22114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.000s	sys 0.016s
I20260709 12:27:08.679631 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 643) took 1141 ms. Trace:
I20260709 12:27:08.657174 24405 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:08.683387 24405 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.684420 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:08.685400 22066 raft_consensus.cc:2410] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:08.685672 24405 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:08.686407 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:08.686900 22067 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:08.687090 22066 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:08.682859 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1831) took 1087 ms. Trace:
I20260709 12:27:08.690143 22214 rpcz_store.cc:276] 0709 12:27:07.583624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.841180 (+257556us) service_pool.cc:224] Handling call
0709 12:27:08.670434 (+829254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.680068 22808 rpcz_store.cc:276] 0709 12:27:07.538335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.538515 (+   180us) service_pool.cc:224] Handling call
0709 12:27:07.538874 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.539258 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.539285 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.539781 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:27:08.095218 (+555437us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:08.095264 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.095336 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.679387 (+584051us) raft_consensus.cc:1685] finished
0709 12:27:08.679408 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.679559 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1148,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"thread_start_us":555042,"threads_started":1,"wal-append.queue_time_us":687094}
I20260709 12:27:08.694448 22806 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:27:08.675575 22773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.012s
W20260709 12:27:08.696653 22773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.004s	sys 0.012s
I20260709 12:27:08.696771 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:08.697021 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 595180us
I20260709 12:27:08.697510 22070 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:08.701232 22215 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:08.700424 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:08.481009 24349 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.591902 24363 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.582362 24386 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:08.597576 24407 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:08.702466 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.782208 22808 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:09.154305 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:09.073818 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.155678 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.155445 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:09.154780 22148 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:27:09.156404 22146 raft_consensus.cc:2393] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:08.759757 22037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.000s	sys 0.036s
I20260709 12:27:08.724709 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:08.923643 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:08.769555 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 98185us
W20260709 12:27:08.860137 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.841508 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:08.725865 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:08.768410 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:09.072557 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.886936 22773 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:08.730986 22071 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
W20260709 12:27:09.192018 22069 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.011s	sys 0.038s
W20260709 12:27:08.702689 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 294966us
I20260709 12:27:08.798614 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.921250 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.925238 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:08.842896 22221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1828) took 1351 ms (client timeout 1716 ms). Trace:
I20260709 12:27:08.921721 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:08.788838 22067 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:27:08.912804 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.203521 22065 raft_consensus.cc:2393] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 2: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:09.181164 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:09.189455 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:09.189743 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 503) took 1123 ms. Trace:
W20260709 12:27:09.191380 22186 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.017s	sys 0.032s
W20260709 12:27:09.192137 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 414054us
W20260709 12:27:09.205708 22069 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.012s	sys 0.038s
W20260709 12:27:09.209479 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.208073 22144 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
W20260709 12:27:09.218132 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.211498 22066 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:08.924111 24303 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.219533 22142 raft_consensus.cc:2393] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:09.218722 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 420088us
W20260709 12:27:09.207696 22221 rpcz_store.cc:269] 0709 12:27:07.491722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.507399 (+ 15677us) service_pool.cc:224] Handling call
0709 12:27:08.842660 (+1335261us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000e88d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:08.842820 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554664704}
I20260709 12:27:09.204480 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:09.207464 22139 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.225775 22803 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:08.703179 24405 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:09.213320 22186 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.017s	sys 0.032s
W20260709 12:27:09.211709 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.006s	sys 0.069s
W20260709 12:27:09.228792 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 807831us
W20260709 12:27:09.229485 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.212215 22146 rpcz_store.cc:276] 0709 12:27:08.066218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.888750 (+822532us) service_pool.cc:224] Handling call
0709 12:27:09.189664 (+300914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.924484 24385 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.212275 22114 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:09.211328 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.216811 22113 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.670s (SENT)
I20260709 12:27:08.791112 24422 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.240061 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:09.225778 22773 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:09.204051 24253 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.012s	sys 0.023s
I20260709 12:27:09.243739 22113 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:09.239166 22185 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:09.161661 24398 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:09.251544 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:09.278782 22214 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:08.668071 24336 consensus_queue.cc:237] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:09.250635 24253 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.012s	sys 0.023s
I20260709 12:27:09.274235 22807 raft_consensus.cc:2368] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:09.289574 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 409) took 1221 ms. Trace:
I20260709 12:27:09.240260 24173 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.291479 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:08.886255 24351 consensus_queue.cc:237] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.244642 24175 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:09.239877 24422 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.242875 24303 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:09.300551 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 50442.1us
I20260709 12:27:09.243821 24236 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:09.241529 24406 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:09.304004 22221 raft_consensus.cc:2393] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 2: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:09.231292 24215 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.301920 22215 rpcz_store.cc:276] 0709 12:27:08.068516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.080679 (+ 12163us) service_pool.cc:224] Handling call
0709 12:27:09.289390 (+1208711us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b54001f4354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:09.289506 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142063872}
W20260709 12:27:09.308391 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 102299us
I20260709 12:27:08.731412 24397 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:09.323691 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 646223us
I20260709 12:27:09.273826 24382 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.327296 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:09.334062 22146 raft_consensus.cc:2468] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
W20260709 12:27:09.326089 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 134407us
W20260709 12:27:09.300866 24421 log.cc:927] Time spent T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:27:09.334663 22186 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:09.249734 24385 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.271895 24405 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.226110 24418 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 12:27:09.287958 24416 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.351868 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:09.359068 22217 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
W20260709 12:27:09.360459 22113 leader_election.cc:336] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.067s (SENT)
I20260709 12:27:09.324153 24248 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:09.368057 22139 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:09.328740 24262 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.329568 24422 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.374343 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1841) took 1443 ms. Trace:
I20260709 12:27:09.357424 24416 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:09.352938 24274 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:09.363490 24398 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:09.342947 24382 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:09.401108 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.393183 24415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.019s
W20260709 12:27:09.410256 24415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.020s
I20260709 12:27:09.375288 24160 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:09.410949 24160 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:09.411644 24420 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.412199 24420 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.413548 24160 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:09.414227 24420 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.414865 24363 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:09.415292 22188 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:09.356487 24236 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.377465 24408 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.416288 24249 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:09.417778 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 178644us
I20260709 12:27:09.343109 24406 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.378079 24386 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.375155 22213 rpcz_store.cc:276] 0709 12:27:07.930733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.418268 (+487535us) service_pool.cc:224] Handling call
0709 12:27:08.418568 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.418825 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:08.787215 (+368390us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.374005 (+586790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:09.374052 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:09.374108 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.374182 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.374291 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":890087,"threads_started":3,"wal-append.queue_time_us":595729}
I20260709 12:27:09.374830 24439 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.378373 24407 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:09.410112 24402 log.cc:927] Time spent T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.612s	user 0.000s	sys 0.001s
I20260709 12:27:09.378657 24416 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.491514 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 395) took 2152 ms. Trace:
W20260709 12:27:09.495357 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 77051.3us
W20260709 12:27:09.500067 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 274351us
W20260709 12:27:09.537891 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.483438 24435 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.550707 22219 rpcz_store.cc:276] 0709 12:27:07.339291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.339419 (+   128us) service_pool.cc:224] Handling call
0709 12:27:07.578202 (+238783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.583027 (+  4825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.491210 (+1908183us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540003cfd0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:09.491416 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528381696}
W20260709 12:27:09.552971 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.492718 24408 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:09.555177 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 139959us
W20260709 12:27:09.558610 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 195542us
I20260709 12:27:09.557197 22185 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:09.562956 22036 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:09.567441 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:09.551716 24187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.001s	sys 0.019s
I20260709 12:27:09.568121 22146 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:09.567648 22776 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:09.576905 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:09.577454 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:09.554160 24349 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:09.562032 24394 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.168s	user 0.011s	sys 0.028s
W20260709 12:27:09.578730 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 244142us
W20260709 12:27:09.562201 24295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.000s	sys 0.018s
W20260709 12:27:09.571252 24187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.001s	sys 0.019s
W20260709 12:27:09.598210 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 118052us
I20260709 12:27:09.561851 24215 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.559244 24408 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:09.595352 24434 log.cc:927] Time spent T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:27:09.595041 22186 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:09.555835 24407 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:09.619339 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 62205.6us
I20260709 12:27:09.631321 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:09.619655 24215 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:09.632941 24426 log.cc:927] Time spent T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:27:09.633330 24444 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.633834 24444 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.634187 24444 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:09.634631 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 63765.8us
I20260709 12:27:09.635892 22188 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:09.638706 24429 log.cc:927] Time spent T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:27:09.641175 24441 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:09.606945 24295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.000s	sys 0.018s
I20260709 12:27:09.593283 24398 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:09.628261 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:09.631958 24437 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:09.600872 24394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.011s	sys 0.029s
I20260709 12:27:09.631651 22185 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:09.643816 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 48849.6us
I20260709 12:27:09.557961 24435 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.649950 24407 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.650918 24303 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.651186 22147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2170) took 1106 ms. Trace:
W20260709 12:27:09.631702 24436 log.cc:927] Time spent T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:27:09.656334 24394 raft_consensus.cc:697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:09.658383 22038 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:09.652798 22186 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:09.629040 24384 raft_consensus.cc:2804] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.609162 24386 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:27:09.658751 22147 rpcz_store.cc:276] 0709 12:27:08.544531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.545235 (+   704us) service_pool.cc:224] Handling call
0709 12:27:08.576725 (+ 31490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.223349 (+646624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.223377 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:09.223416 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:09.223452 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.650915 (+427463us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54003fc0d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:09.650973 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.651100 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14368,"raft.queue_time_us":103037,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6245,"spinlock_wait_cycles":1481836416}
W20260709 12:27:09.648299 24410 consensus_meta.cc:287] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.075s	user 0.010s	sys 0.002s
I20260709 12:27:09.672873 22185 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:09.660550 24418 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.648218 24405 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:09.663102 24173 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.659171 24349 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 12:27:09.702903 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 48932.3us
I20260709 12:27:09.671202 24384 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:09.757210 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 121400us
W20260709 12:27:09.739236 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.674374 24363 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:09.735911 24190 consensus_meta.cc:287] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.267s	user 0.012s	sys 0.000s
I20260709 12:27:09.794963 24349 raft_consensus.cc:2764] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:09.796448 24349 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.792879 24444 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.696708 24418 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.773408 24457 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:09.800849 24444 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.775197 24435 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.775787 24398 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:09.779700 24381 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.786435 24420 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.802971 24444 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.803649 24420 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.786918 24363 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.798216 24385 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.686071 24459 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.806097 24459 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:09.775075 24394 consensus_queue.cc:237] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:09.684988 24441 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.806942 24441 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.807322 24441 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.807928 24393 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.698679 24458 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.789167 24445 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.702111 24406 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:09.813390 24445 raft_consensus.cc:697] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:09.699841 24422 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.814399 24445 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.815652 22801 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:09.816344 24422 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:09.753456 24451 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.806461 24459 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.800676 24294 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.697908 24382 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.685334 24410 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.898047 24410 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:09.704087 24274 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:09.892074 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 135597us
I20260709 12:27:09.905085 22808 raft_consensus.cc:1240] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:09.756646 24173 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:09.798203 24408 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.888831 24435 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.908830 24295 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:09.894312 24457 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:27:09.911741 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.894979 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 581) took 1203 ms. Trace:
I20260709 12:27:09.913004 24408 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:09.913196 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:09.913051 22801 rpcz_store.cc:276] 0709 12:27:08.691698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.730043 (+ 38345us) service_pool.cc:224] Handling call
0709 12:27:08.842660 (+112617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.816429 (+973769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.894722 (+ 78293us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400597c54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:09.894912 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122688256}
I20260709 12:27:09.914000 22147 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:09.806526 24363 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:09.904466 24249 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:27:09.797817 24349 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.693172 24416 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:09.918798 24349 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.764187 24236 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.766657 24384 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:09.903117 22188 connection.cc:256] RPC call timeout handler was delayed by -2.4794153150000966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 12:27:09.925647 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 648) took 2290 ms. Trace:
W20260709 12:27:09.934093 22188 connection.cc:256] RPC call timeout handler was delayed by -2.0577391140000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 12:27:09.934818 22188 connection.cc:256] RPC call timeout handler was delayed by -1.9880153150002116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 12:27:09.935225 22188 connection.cc:256] RPC call timeout handler was delayed by -1.9745153150001897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 12:27:09.935268 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 262458us
W20260709 12:27:09.935642 22188 connection.cc:256] RPC call timeout handler was delayed by -1.6121302810001907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:27:09.936101 22188 connection.cc:256] RPC call timeout handler was delayed by -1.5959302810001645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:27:09.936790 22188 connection.cc:256] RPC call timeout handler was delayed by -1.5959302810001645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:27:09.816898 24444 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:09.937223 22188 connection.cc:256] RPC call timeout handler was delayed by -1.4339302809999026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
I20260709 12:27:09.934092 22806 rpcz_store.cc:276] 0709 12:27:07.635657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.137925 (+502268us) service_pool.cc:224] Handling call
0709 12:27:08.578323 (+440398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.695033 (+116710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.925426 (+1230393us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400808250. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:09.925571 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565762432}
W20260709 12:27:09.948676 22188 connection.cc:256] RPC call timeout handler was delayed by -1.3556302810002308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 12:27:09.949064 22188 connection.cc:256] RPC call timeout handler was delayed by -1.1990302809999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 12:27:09.949354 22188 connection.cc:256] RPC call timeout handler was delayed by -1.1441302809998888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 12:27:09.949892 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 334365us
I20260709 12:27:09.936132 22185 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:09.821822 24418 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.891302 24215 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:09.953320 22803 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:09.955207 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:09.958005 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:09.952047 22114 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:09.954655 22185 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:09.960553 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:09.930435 24173 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.950402 24444 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.957162 24236 raft_consensus.cc:2804] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.986496 22217 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:27:09.993983 22214 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
W20260709 12:27:09.994522 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.961591 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:09.996388 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:09.999069 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 346387us
I20260709 12:27:10.001864 22186 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:10.002393 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.003813 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:09.909425 24435 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:09.997681 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.020074 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:10.020880 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:10.021605 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:10.030328 22147 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:10.023635 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:10.031270 22140 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 1.
I20260709 12:27:10.031347 22186 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:10.005101 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.032200 22073 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:10.034417 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.033175 22186 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.040691 22141 raft_consensus.cc:2393] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:09.997571 24249 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.027684 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:10.028378 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 68890us
I20260709 12:27:10.049310 22143 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.956558 24457 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:27:09.993109 24294 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.045631 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:10.046271 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 56901.6us
I20260709 12:27:10.047072 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.085338 22068 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:10.049576 22773 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:09.992965 24236 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.050015 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.069898 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:10.067094 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.085747 22219 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:27:10.074043 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.076009 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:10.070113 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:10.088968 22140 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:10.086758 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:10.027021 22067 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:09.955958 24262 consensus_queue.cc:1048] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:27:10.092099 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:09.936473 24451 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:10.094750 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.095168 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.047821 24381 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:10.048446 24249 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.092756 22071 raft_consensus.cc:2393] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
W20260709 12:27:10.069845 22186 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.68:41677 timed out after 1.585s (SENT) [suppressed 36 similar messages]
I20260709 12:27:10.091429 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.048751 24386 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:10.097854 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.094748 22213 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:10.099510 22064 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:10.097214 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:09.981236 24422 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:27:10.104465 22219 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:10.107635 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 58124.1us
I20260709 12:27:10.107611 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:10.109408 22067 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.130669 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.132848 22217 raft_consensus.cc:3060] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.132993 22773 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:10.121290 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.091815 24236 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.135586 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.139238 22221 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.089812 24294 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:10.102582 24249 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.098870 24381 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:10.150712 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 64020us
I20260709 12:27:10.089093 24363 consensus_queue.cc:1059] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:27:10.159453 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.131971 24406 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.160980 22213 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:10.151537 24294 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.163451 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:10.164105 22064 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.162678 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.165818 22220 raft_consensus.cc:2393] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:10.167212 22038 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:10.164340 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.094513 24410 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:27:10.168497 22222 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:10.171707 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.094825 24391 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:10.174189 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.190068 22222 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.175514 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.190798 22218 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:10.110890 24386 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.160245 24381 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.187681 22776 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:10.211397 22067 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:10.162674 24336 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:10.222843 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 89912.4us
I20260709 12:27:10.221596 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.227661 22038 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:10.228488 22217 raft_consensus.cc:2468] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:10.194739 24394 raft_consensus.cc:2764] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:10.176270 24183 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:10.237550 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.237998 22220 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:10.252463 22213 raft_consensus.cc:2376] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3. Re-sending same reply.
I20260709 12:27:10.194118 24190 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.166726 24439 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:10.251781 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.261919 22773 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:10.262907 22221 raft_consensus.cc:2468] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:10.263782 22775 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.261958 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:10.174633 24406 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.249365 24461 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:10.283905 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.247257 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:10.286892 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.287539 22213 raft_consensus.cc:2376] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3. Re-sending same reply.
I20260709 12:27:10.248497 24416 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:10.360373 22219 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:10.254397 24215 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.339152 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.261137 24363 raft_consensus.cc:3055] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:10.231961 24462 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.286195 24303 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:10.237241 24336 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.364039 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:10.367024 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 179465us
I20260709 12:27:10.254513 24414 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:10.397410 22064 raft_consensus.cc:2410] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:27:10.366348 24463 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 12:27:10.369805 24471 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:10.362013 24456 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.364960 24410 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:10.408983 22776 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:10.372153 24190 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.284495 24183 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.420393 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.370926 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.387857 24438 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.289114 24469 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.322s
W20260709 12:27:10.418236 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 154508us
I20260709 12:27:10.403290 24363 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:10.407706 24435 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:10.409531 24477 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:10.433923 24408 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.435045 22775 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:10.434000 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 433875us
I20260709 12:27:10.435204 22776 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:10.419821 24416 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.443172 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.447566 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:10.448210 24465 log.cc:927] Time spent T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:27:10.456879 22114 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:10.458468 24398 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.459097 24398 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.459149 24481 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:10.459553 24398 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.459794 24183 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:10.420722 24471 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.430271 24451 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:10.420683 24190 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:10.430230 24438 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:10.440307 24477 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:10.458343 24470 raft_consensus.cc:2804] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:10.577353 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 142368us
I20260709 12:27:10.577685 24294 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.580276 22217 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:10.559722 22143 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:10.484992 22222 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:10.484098 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.491468 24391 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.579166 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:10.447474 24473 log.cc:927] Time spent T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:27:10.583379 22213 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:27:10.462491 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.583663 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.589596 22067 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:10.569913 24474 log.cc:927] Time spent T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:27:10.582403 24294 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:10.589775 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 154630us
I20260709 12:27:10.590034 22222 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
W20260709 12:27:10.542843 24445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.021s	sys 0.048s
I20260709 12:27:10.492340 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.577816 24190 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.598665 22067 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:10.609774 24249 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:10.611927 24249 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:10.592446 24363 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.613760 24363 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.606562 24470 raft_consensus.cc:697] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:10.615048 24472 log.cc:927] Time spent T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:27:10.615600 24470 consensus_queue.cc:237] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.617854 22775 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:10.618970 24482 raft_consensus.cc:2804] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.619524 24482 raft_consensus.cc:697] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:10.620385 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.621165 22218 raft_consensus.cc:2393] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:10.621971 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:10.622160 24393 consensus_meta.cc:287] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.814s	user 0.005s	sys 0.010s
W20260709 12:27:10.619534 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 642) took 2986 ms (client timeout 2141 ms). Trace:
W20260709 12:27:10.623126 22807 rpcz_store.cc:269] 0709 12:27:07.633662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.667379 (+ 33717us) service_pool.cc:224] Handling call
0709 12:27:10.619296 (+2951917us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54004420d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:10.619429 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813053696}
I20260709 12:27:10.623481 24477 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.624750 24408 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:10.599879 22776 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:10.576586 24438 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.575142 24386 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:10.606755 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:10.602743 24484 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:27:10.589027 24391 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.628396 22072 raft_consensus.cc:2410] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:10.458786 24416 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.624596 24477 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.577869 24471 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.653558 22218 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:10.637961 22143 raft_consensus.cc:1240] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:10.425120 24414 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.656313 24419 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.657855 24416 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:10.667896 24419 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:10.658735 24236 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:10.659255 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:10.668987 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:10.669421 22148 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.669530 22067 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.635025 24406 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:10.638240 24418 consensus_meta.cc:287] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.002s
I20260709 12:27:10.678104 22148 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:10.660385 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.636088 24407 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:10.659317 22185 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.686615 22185 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.687633 22185 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.665650 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:10.666936 24349 consensus_meta.cc:287] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.000s
I20260709 12:27:10.654381 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:10.603528 24445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.026s	sys 0.049s
I20260709 12:27:10.687187 22804 raft_consensus.cc:2393] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:10.725526 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.726135 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.727761 24183 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:10.728322 24183 raft_consensus.cc:697] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:10.726905 21968 catalog_manager.cc:5697] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.729242 24183 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.726145 22217 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.683310 24416 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:10.731899 24416 raft_consensus.cc:697] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:10.732333 24274 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:10.732896 24274 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.730417 21968 catalog_manager.cc:5697] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.736449 21968 catalog_manager.cc:5697] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 3, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 3 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:10.658330 22188 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.527s (SENT)
I20260709 12:27:10.634445 24420 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:10.662947 24391 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.688774 22213 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
W20260709 12:27:10.795197 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 136888us
W20260709 12:27:10.676178 24444 consensus_meta.cc:287] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.001s
I20260709 12:27:10.696985 22215 raft_consensus.cc:2393] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:10.659430 24381 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.697573 24469 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.698351 22185 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.699232 24414 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:10.698953 24349 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.699717 24461 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:10.701179 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.702013 22068 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:10.702425 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:10.673557 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 73995.7us
I20260709 12:27:10.620381 24482 consensus_queue.cc:237] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.683948 24418 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.711416 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:10.811528 22810 raft_consensus.cc:2368] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6.
I20260709 12:27:10.713676 22801 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:10.812258 24418 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:10.812676 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.714259 24336 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:10.723842 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 589) took 1394 ms. Trace:
I20260709 12:27:10.695106 24294 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.814019 22808 rpcz_store.cc:276] 0709 12:27:09.329153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.329401 (+   248us) service_pool.cc:224] Handling call
0709 12:27:09.351923 (+ 22522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.908099 (+556176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.723589 (+815490us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540027a954. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:10.723770 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261875456}
I20260709 12:27:10.814635 24294 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.815053 24294 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.737995 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.728269 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:10.810510 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 112221us
I20260709 12:27:10.745268 24274 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.749229 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.751760 24398 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:10.682492 22802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 653) took 2982 ms (client timeout 1585 ms). Trace:
I20260709 12:27:10.622972 24485 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.186s
W20260709 12:27:10.849004 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.761149 24190 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.853936 24190 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:10.727340 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.855356 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:10.772452 24459 consensus_meta.cc:287] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.817s	user 0.009s	sys 0.000s
W20260709 12:27:10.691071 24441 consensus_meta.cc:287] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.883s	user 0.001s	sys 0.009s
I20260709 12:27:10.683264 22222 raft_consensus.cc:2376] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3. Re-sending same reply.
W20260709 12:27:10.776011 24173 consensus_meta.cc:287] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.001s
I20260709 12:27:10.778926 24262 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:10.785635 22775 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.792626 22217 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:10.787914 21968 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 3 to 4, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 4 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.693861 22067 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:10.794173 24384 consensus_meta.cc:287] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.844s	user 0.005s	sys 0.005s
I20260709 12:27:10.803423 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.787025 24453 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.784212 24215 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:10.815246 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:10.793705 24407 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.831621 22220 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:10.836535 22185 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.837694 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.830916 24461 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:10.800592 24469 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.800220 24444 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:10.838073 22802 rpcz_store.cc:269] 0709 12:27:07.700135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.772257 (+ 72122us) service_pool.cc:224] Handling call
0709 12:27:10.682268 (+2910011us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54006d01d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:10.682406 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4106830080}
I20260709 12:27:10.732834 24416 consensus_queue.cc:237] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.804473 24236 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:10.864557 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.867321 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:10.869191 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:10.871503 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.914551 22222 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:27:10.867942 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 82406us
I20260709 12:27:10.891347 22214 raft_consensus.cc:2393] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:10.879977 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.877858 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:10.892555 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 56104.9us
I20260709 12:27:10.917027 22185 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.894925 22213 raft_consensus.cc:2393] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:10.896689 21968 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 5 to 6, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 6 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.904860 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:10.869727 24262 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.903205 24384 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.868870 24274 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:10.960631 24432 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 1.304s	user 0.004s	sys 0.000s
I20260709 12:27:10.960448 24437 consensus_queue.cc:1059] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:10.868405 24190 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:10.961388 24437 raft_consensus.cc:3055] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:10.913151 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.916887 22805 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:10.929765 22216 raft_consensus.cc:2368] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6.
I20260709 12:27:10.929230 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.928712 22222 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:10.955314 22067 raft_consensus.cc:2368] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3.
I20260709 12:27:10.958559 22186 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:10.959015 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:10.914672 22218 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
W20260709 12:27:10.958654 22038 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44992 dropped due to backpressure: service queue is full with 50 items
I20260709 12:27:10.963728 22214 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.963915 22222 raft_consensus.cc:1275] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:10.954885 21968 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 4 to 5, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:10.966192 21968 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 4 to 5, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 5 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.961606 24190 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:10.969604 22217 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:10.878312 24349 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:10.917371 22804 raft_consensus.cc:2410] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:27:10.880316 24398 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:10.972661 22222 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:27:10.903880 24461 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.866546 24498 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:10.973845 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.929793 24444 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:10.964967 24236 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:10.927863 24391 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.963964 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:10.903592 24485 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.974915 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.914433 24469 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.971352 21968 catalog_manager.cc:5697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 3, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:10.875967 24471 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.865417 24459 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:10.979161 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:10.915668 24497 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:10.980370 22066 raft_consensus.cc:1240] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:10.928318 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:10.961745 24437 raft_consensus.cc:740] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:10.873421 24173 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:10.986996 22805 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:11.008167 22069 raft_consensus.cc:2393] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:10.988262 22222 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:10.872962 24438 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.904349 24407 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.904239 24215 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:11.020920 22070 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:11.021059 24419 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:10.928104 24183 consensus_queue.cc:1059] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:27:10.991622 21968 catalog_manager.cc:5697] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:10.975039 24190 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.866916 24441 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.997561 22214 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:11.003934 24497 raft_consensus.cc:697] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:11.004319 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:11.004541 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:11.039248 22148 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.004931 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:11.039841 22141 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.005585 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:10.988798 24444 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:11.014104 22802 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:11.015266 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:11.016906 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.035455 24294 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:11.046473 22112 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:11.022274 22808 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:10.991186 24236 raft_consensus.cc:697] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:11.058019 24236 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:10.904076 24453 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:11.033224 24437 consensus_queue.cc:260] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:11.064536 24437 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.033722 24262 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:11.039906 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 81442.9us
I20260709 12:27:11.040446 22146 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.007045 22801 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:11.008886 24173 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:11.018054 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:11.043056 24444 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.052651 22221 raft_consensus.cc:2368] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3.
I20260709 12:27:10.964758 22038 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44992 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1475)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1484)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1998)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 499)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1995)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44992 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1997)
I20260709 12:27:11.037699 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e"
dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
mode: GRACEFUL
new_leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
 from {username='slave'} at 127.0.0.1:59562
I20260709 12:27:11.074155 24388 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.994323 24485 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:11.793872 22804 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:11.130997 22146 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
W20260709 12:27:11.396422 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:11.607959 22141 consensus_meta.cc:287] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.000s
W20260709 12:27:11.452270 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:11.140331 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.799659 24444 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:11.354450 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.595s (SENT)
I20260709 12:27:12.279778 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:12.280798 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1479) took 1427 ms (client timeout 1649 ms). Trace:
I20260709 12:27:11.796252 22141 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:11.079968 22148 raft_consensus.cc:2468] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
W20260709 12:27:12.281395 22069 rpcz_store.cc:269] 0709 12:27:10.853098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.243540 (+1390442us) service_pool.cc:224] Handling call
0709 12:27:12.280738 (+ 37198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:12.282414 22148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1642) took 1281 ms (client timeout 1707 ms). Trace:
I20260709 12:27:11.795707 22214 raft_consensus.cc:606] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Received request to transfer leadership to TS 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:12.109962 21968 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.028s	sys 0.013s
I20260709 12:27:12.284255 22214 raft_consensus.cc:614] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:27:12.284526 21968 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.031s	sys 0.014s
W20260709 12:27:11.804339 22219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1853) took 1683 ms (client timeout 1715 ms). Trace:
W20260709 12:27:12.285506 22219 rpcz_store.cc:269] 0709 12:27:10.120750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.120957 (+   207us) service_pool.cc:224] Handling call
0709 12:27:11.804096 (+1683139us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400029754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:11.804261 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520166656}
I20260709 12:27:12.287329 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:12.288218 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 437) took 1214 ms. Trace:
I20260709 12:27:12.288663 22219 rpcz_store.cc:276] 0709 12:27:11.074101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.287066 (+1212965us) service_pool.cc:224] Handling call
0709 12:27:12.288159 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.290360 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2290) took 1632 ms. Trace:
W20260709 12:27:12.256858 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.282038 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1643) took 1280 ms. Trace:
W20260709 12:27:12.283293 22148 rpcz_store.cc:269] 0709 12:27:11.001152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.004035 (+  2883us) service_pool.cc:224] Handling call
0709 12:27:12.282360 (+1278325us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:11.787025 24437 consensus_meta.cc:287] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.000s
W20260709 12:27:11.766419 24469 consensus_meta.cc:287] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.771s	user 0.000s	sys 0.009s
I20260709 12:27:12.292003 22141 rpcz_store.cc:276] 0709 12:27:11.001554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.002403 (+   849us) service_pool.cc:224] Handling call
0709 12:27:12.281972 (+1279569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.292544 22219 rpcz_store.cc:276] 0709 12:27:10.657949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.289499 (+1631550us) service_pool.cc:224] Handling call
0709 12:27:12.289799 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.290026 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.290060 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:12.290102 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:12.290144 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.290197 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.290303 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:11.074939 22775 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:11.551852 24477 consensus_meta.cc:287] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.877s	user 0.005s	sys 0.004s
I20260709 12:27:12.299198 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59562 (request call id 13) took 1281 ms. Trace:
W20260709 12:27:12.362632 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 1.00816e+06us
W20260709 12:27:11.445107 24499 log.cc:927] Time spent T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.423s	user 0.000s	sys 0.001s
W20260709 12:27:12.364768 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 407721us
W20260709 12:27:11.444244 24478 log.cc:927] Time spent T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260709 12:27:11.239344 24505 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:27:11.072785 24215 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:11.444784 24438 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:11.067541 22807 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:11.079288 24175 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.362761 22214 rpcz_store.cc:276] 0709 12:27:11.014530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.037560 (+ 23030us) service_pool.cc:224] Handling call
0709 12:27:12.284691 (+1247131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:12.359824 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 1.28489e+06us
W20260709 12:27:11.781929 24461 consensus_meta.cc:287] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.791s	user 0.006s	sys 0.000s
W20260709 12:27:12.285193 24236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.223s	user 0.017s	sys 0.018s
W20260709 12:27:12.299151 22803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 587) took 3058 ms (client timeout 2275 ms). Trace:
I20260709 12:27:11.455286 24391 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:12.378750 22803 rpcz_store.cc:269] 0709 12:27:09.240764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.241028 (+   264us) service_pool.cc:224] Handling call
0709 12:27:12.298952 (+3057924us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54005852d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:12.299078 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563857792}
I20260709 12:27:11.866382 24435 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:12.380309 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.536288 24384 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:11.541780 24471 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:11.078446 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:12.020403 24441 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:12.366091 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.813308 24407 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.027031 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:12.367491 24437 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:12.358851 24349 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:12.362358 24490 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:12.371910 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:11.872905 24253 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.392277 22069 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
W20260709 12:27:12.392735 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1489) took 1513 ms (client timeout 1637 ms). Trace:
W20260709 12:27:12.393103 22069 rpcz_store.cc:269] 0709 12:27:10.879038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.363939 (+1484901us) service_pool.cc:224] Handling call
0709 12:27:12.392684 (+ 28745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.377723 22775 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:12.393558 24513 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.394510 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:12.393586 24349 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.394748 24513 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.396730 24513 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:11.796454 24388 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.397313 24388 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:12.393784 24253 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.392638 24490 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:12.378569 24236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.020s	sys 0.021s
W20260709 12:27:12.378363 24507 log.cc:927] Time spent T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:27:12.293143 24500 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.432107 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1864) took 1970 ms. Trace:
I20260709 12:27:12.362896 24469 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:12.382871 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 659) took 2275 ms (client timeout 2826 ms). Trace:
I20260709 12:27:12.432556 22213 rpcz_store.cc:276] 0709 12:27:10.461850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.955079 (+493229us) service_pool.cc:224] Handling call
0709 12:27:10.972336 (+ 17257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.061503 (+ 89167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.061538 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.062053 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.254430 (+192377us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:11.864628 (+610198us) log.cc:844] Serialized 14 byte log entry
0709 12:27:11.864897 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.864981 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.373206 (+508225us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:12.430665 (+ 57459us) raft_consensus.cc:1685] finished
0709 12:27:12.430766 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.432046 (+  1280us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":609985,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":26319,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":8016,"spinlock_wait_cycles":43365632,"thread_start_us":276283,"threads_started":2,"wal-append.queue_time_us":978158}
I20260709 12:27:12.395140 22069 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.379729 24175 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.396859 24349 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.385247 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:12.382938 24435 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.405005 24498 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.397989 24490 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.380395 24461 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:12.402318 24485 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:12.430245 24506 log.cc:927] Time spent T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:27:11.074874 24497 consensus_queue.cc:237] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:12.446033 22113 connection.cc:256] RPC call timeout handler was delayed by -1.6596193759996822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 12:27:12.448187 22038 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:12.448779 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 599) took 1504 ms. Trace:
I20260709 12:27:12.458032 22803 rpcz_store.cc:276] 0709 12:27:10.944426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.380066 (+1435640us) service_pool.cc:224] Handling call
0709 12:27:12.448700 (+ 68634us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.431140 24471 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:12.453882 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 73060.3us
W20260709 12:27:12.452023 22188 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.695s (SENT)
I20260709 12:27:12.455763 22214 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:12.451107 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 672) took 1521 ms. Trace:
I20260709 12:27:12.459650 22038 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:12.453092 24498 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.458436 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:12.480113 24215 raft_consensus.cc:2804] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:12.480314 22213 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:12.480568 24215 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.480829 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:12.481012 24215 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.481469 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:12.457593 22113 connection.cc:256] RPC call timeout handler was delayed by -1.4025465279996752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 12:27:12.482198 22213 raft_consensus.cc:2368] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4.
I20260709 12:27:12.482211 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:12.483883 22038 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:12.484198 22188 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:12.484350 22113 connection.cc:256] RPC call timeout handler was delayed by -1.3554193759996451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
W20260709 12:27:12.484786 22113 connection.cc:256] RPC call timeout handler was delayed by -1.236619375999453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 12:27:12.485109 22113 connection.cc:256] RPC call timeout handler was delayed by -1.1976599689996874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 12:27:12.485091 24349 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:12.485606 22188 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.697s (SENT)
W20260709 12:27:12.486656 22113 connection.cc:256] RPC call timeout handler was delayed by -1.1733995589997903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 12:27:12.486780 22188 leader_election.cc:336] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.729s (SENT)
W20260709 12:27:12.487020 22113 connection.cc:256] RPC call timeout handler was delayed by -1.1622465279997414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 12:27:12.445561 24336 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:12.487365 22113 connection.cc:256] RPC call timeout handler was delayed by -1.1265995590001694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
I20260709 12:27:12.487239 22188 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:12.392680 24437 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:12.490221 22113 connection.cc:256] RPC call timeout handler was delayed by -1.1113710249996984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 12:27:12.490537 22113 connection.cc:256] RPC call timeout handler was delayed by -1.1066563859999405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 12:27:12.490854 22113 connection.cc:256] RPC call timeout handler was delayed by -1.0041995589999715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 12:27:12.498543 24336 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.499652 24253 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.499876 24458 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:12.500272 24458 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:12.487639 24512 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:12.500959 24336 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:12.501403 24517 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:27:12.501995 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.500840 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.504065 22217 raft_consensus.cc:1240] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:12.511240 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.514587 22803 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.450625 24384 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.498936 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.542521 22069 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
W20260709 12:27:12.553994 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 62613.6us
I20260709 12:27:12.442457 24500 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:12.517238 24458 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:12.557022 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 73230.6us
I20260709 12:27:12.557938 24485 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.557746 24253 consensus_queue.cc:1059] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:12.502964 24523 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.558681 22071 raft_consensus.cc:2410] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:27:12.610121 22071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1474) took 1758 ms (client timeout 1695 ms). Trace:
I20260709 12:27:12.609931 24523 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.558954 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 428) took 1781 ms. Trace:
I20260709 12:27:12.611007 22219 rpcz_store.cc:276] 0709 12:27:10.777827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.359526 (+1581699us) service_pool.cc:224] Handling call
0709 12:27:12.363705 (+  4179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.379863 (+ 16158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.379897 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:12.384798 (+  4901us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.455738 (+ 70940us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:12.455777 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.455848 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.558744 (+102896us) raft_consensus.cc:1685] finished
0709 12:27:12.558770 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.558892 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3551,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3313,"thread_start_us":62277,"threads_started":1,"wal-append.queue_time_us":165271}
I20260709 12:27:12.613886 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 431) took 1835 ms. Trace:
W20260709 12:27:12.615720 22070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1487) took 1737 ms (client timeout 1585 ms). Trace:
W20260709 12:27:12.616217 22070 rpcz_store.cc:269] 0709 12:27:10.878489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.615435 (+1736946us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.615616 (+   181us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.617179 22070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1467) took 1767 ms (client timeout 1707 ms). Trace:
W20260709 12:27:12.617503 22070 rpcz_store.cc:269] 0709 12:27:10.849959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.616969 (+1767010us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.617092 (+   123us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.618250 22070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1476) took 1765 ms (client timeout 1729 ms). Trace:
I20260709 12:27:12.558959 24469 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.487468 22804 rpcz_store.cc:276] 0709 12:27:10.929808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.889773 (+959965us) service_pool.cc:224] Handling call
0709 12:27:12.447728 (+557955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.560087 24461 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:12.560653 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 73901.4us
I20260709 12:27:12.564152 24435 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.568101 24393 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:12.597278 22038 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:12.487294 24498 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:12.557760 22064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1475) took 1705 ms (client timeout 1697 ms). Trace:
W20260709 12:27:12.650434 22064 rpcz_store.cc:269] 0709 12:27:10.852062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.458874 (+1606812us) service_pool.cc:224] Handling call
0709 12:27:12.557661 (+ 98787us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:12.442306 22807 rpcz_store.cc:269] 0709 12:27:10.102815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.998238 (+895423us) service_pool.cc:224] Handling call
0709 12:27:12.378179 (+1379941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.487742 24520 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.605746 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 50567.1us
I20260709 12:27:12.601579 24384 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:12.516710 24349 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:12.610586 22071 rpcz_store.cc:269] 0709 12:27:10.851824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.458896 (+1607072us) service_pool.cc:224] Handling call
0709 12:27:12.610043 (+151147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.614305 22219 rpcz_store.cc:276] 0709 12:27:10.778566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.612902 (+1834336us) service_pool.cc:224] Handling call
0709 12:27:12.613296 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.613500 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.613526 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:12.613585 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:12.613632 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.613690 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.613814 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:12.620386 22070 rpcz_store.cc:269] 0709 12:27:10.852334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.618100 (+1765766us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.618203 (+   103us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:12.500916 24512 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:12.633906 22188 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.750s (SENT)
I20260709 12:27:12.552942 24236 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:12.636368 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:12.636793 24175 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:12.595901 24388 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:12.648624 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 51419.7us
W20260709 12:27:12.599603 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 501) took 1667 ms (client timeout 1630 ms). Trace:
W20260709 12:27:12.693125 22215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1848) took 2704 ms (client timeout 1515 ms). Trace:
I20260709 12:27:12.654800 24526 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:12.657095 24500 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:12.700428 24526 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.674520 24215 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.657986 24397 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.657347 24384 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:12.701084 24526 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:12.671826 24444 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.662720 24393 raft_consensus.cc:697] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:12.702694 24215 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.675668 24437 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:12.703471 22070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1477) took 1850 ms (client timeout 1750 ms). Trace:
I20260709 12:27:12.643105 24513 raft_consensus.cc:3055] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:12.704243 24513 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:12.670822 24520 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.705014 24513 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.706082 24513 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.620676 24485 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.684952 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:12.706881 22802 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
W20260709 12:27:12.707273 22806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 658) took 2659 ms (client timeout 1942 ms). Trace:
I20260709 12:27:12.707618 24236 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.708086 24485 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.673447 24453 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.709769 24236 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.711198 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2288) took 2120 ms. Trace:
I20260709 12:27:12.711540 22217 rpcz_store.cc:276] 0709 12:27:10.593574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.972779 (+379205us) service_pool.cc:224] Handling call
0709 12:27:10.981794 (+  9015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.504517 (+1522723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.710982 (+206465us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000889d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:12.711143 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3500481280}
I20260709 12:27:12.713227 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 434) took 1915 ms. Trace:
I20260709 12:27:12.713550 22217 rpcz_store.cc:276] 0709 12:27:10.798207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.712393 (+1914186us) service_pool.cc:224] Handling call
0709 12:27:12.712707 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.712893 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.712918 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:12.712961 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:12.713000 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.713052 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.713174 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.664546 24498 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:12.715047 24498 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.715553 24498 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:12.700590 22215 rpcz_store.cc:269] 0709 12:27:09.988895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.989007 (+   112us) service_pool.cc:224] Handling call
0709 12:27:12.692888 (+2703881us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54000e74d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:12.693035 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513226624}
I20260709 12:27:12.718333 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7"
dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
mode: GRACEFUL
new_leader_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:36732
I20260709 12:27:12.718688 22215 raft_consensus.cc:1240] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:12.719331 22141 raft_consensus.cc:606] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Received request to transfer leadership to TS d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:12.720007 22112 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:12.720826 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:12.722043 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:12.722251 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:12.692544 22073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1469) took 1842 ms (client timeout 1527 ms). Trace:
I20260709 12:27:12.724021 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:12.682503 22216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1842) took 2732 ms (client timeout 2226 ms). Trace:
I20260709 12:27:12.724370 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:12.656270 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:12.707876 22810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 657) took 2667 ms (client timeout 2124 ms). Trace:
I20260709 12:27:12.723834 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:12.705400 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:12.685329 22065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1496) took 1796 ms (client timeout 1707 ms). Trace:
W20260709 12:27:12.736465 22065 rpcz_store.cc:269] 0709 12:27:10.888387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.685120 (+1796733us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.685261 (+   141us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:12.736662 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 596) took 1864 ms. Trace:
I20260709 12:27:12.723068 22139 raft_consensus.cc:2410] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:12.725462 22143 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
I20260709 12:27:12.723055 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:12.724875 22220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 425) took 2493 ms (client timeout 3255 ms). Trace:
I20260709 12:27:12.725075 22144 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.737496 22141 raft_consensus.cc:2376] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5. Re-sending same reply.
I20260709 12:27:12.675541 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 429) took 1897 ms. Trace:
I20260709 12:27:12.726154 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:12.669963 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 487) took 2595 ms. Trace:
I20260709 12:27:12.738685 22214 rpcz_store.cc:276] 0709 12:27:10.778098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.380825 (+1602727us) service_pool.cc:224] Handling call
0709 12:27:12.385391 (+  4566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.479399 (+ 94008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.675251 (+195852us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b5400295754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:12.675474 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161269120}
I20260709 12:27:12.653739 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:12.723003 22073 rpcz_store.cc:269] 0709 12:27:10.850450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.692334 (+1841884us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.692465 (+   131us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.740257 22073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1465) took 1890 ms (client timeout 1794 ms). Trace:
W20260709 12:27:12.703862 22070 rpcz_store.cc:269] 0709 12:27:10.852593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.703307 (+1850714us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.703408 (+   101us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.740257 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 86614.1us
I20260709 12:27:12.727677 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 435) took 1925 ms. Trace:
I20260709 12:27:12.741930 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:12.722687 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:12.742853 22140 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:12.741181 22220 rpcz_store.cc:269] 0709 12:27:10.231102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.260718 (+ 29616us) service_pool.cc:224] Handling call
0709 12:27:12.724692 (+2463974us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400088ed4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:12.724822 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002529664}
W20260709 12:27:12.742965 22070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1480) took 1877 ms (client timeout 1795 ms). Trace:
W20260709 12:27:12.735981 22810 rpcz_store.cc:269] 0709 12:27:10.040312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.040435 (+   123us) service_pool.cc:224] Handling call
0709 12:27:12.707696 (+2667261us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400690354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:12.707807 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666987776}
W20260709 12:27:12.743892 22073 rpcz_store.cc:269] 0709 12:27:10.849451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.740097 (+1890646us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.740197 (+   100us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.743755 22065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1483) took 1866 ms (client timeout 1806 ms). Trace:
I20260709 12:27:12.742169 22217 rpcz_store.cc:276] 0709 12:27:10.802211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.714375 (+1912164us) service_pool.cc:224] Handling call
0709 12:27:12.727229 (+ 12854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.727399 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.727422 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:12.727461 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:12.727493 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.727543 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.727629 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.665043 22114 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:12.744745 22065 rpcz_store.cc:269] 0709 12:27:10.877370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.743599 (+1866229us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.743698 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.745945 22073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1492) took 1866 ms (client timeout 1810 ms). Trace:
W20260709 12:27:12.746285 22073 rpcz_store.cc:269] 0709 12:27:10.879832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.745794 (+1865962us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.745891 (+    97us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.746997 22073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1493) took 1867 ms (client timeout 1828 ms). Trace:
I20260709 12:27:12.741932 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:12.727627 22071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1472) took 1876 ms (client timeout 1752 ms). Trace:
W20260709 12:27:12.655107 22064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 498) took 1839 ms (client timeout 1768 ms). Trace:
I20260709 12:27:12.700601 22219 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:27:12.724478 22069 rpcz_store.cc:269] 0709 12:27:10.887048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.393630 (+1506582us) service_pool.cc:224] Handling call
0709 12:27:12.554503 (+160873us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:12.707695 22806 rpcz_store.cc:269] 0709 12:27:10.066644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.084453 (+ 17809us) service_pool.cc:224] Handling call
0709 12:27:10.621610 (+537157us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:27:12.684791 (+2063181us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1e9c 00007ff1895e1a5b 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:27:12.707196 (+ 22405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20609152}
W20260709 12:27:12.666887 22808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 666) took 2562 ms (client timeout 2235 ms). Trace:
W20260709 12:27:12.724750 22216 rpcz_store.cc:269] 0709 12:27:09.950001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.955696 (+  5695us) service_pool.cc:224] Handling call
0709 12:27:12.682268 (+2726572us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54003822d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:12.682425 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079160704}
W20260709 12:27:12.734777 22037 connection.cc:256] RPC call timeout handler was delayed by -1.5528937560002305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 12:27:12.737138 22805 rpcz_store.cc:276] 0709 12:27:10.872220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.705129 (+1832909us) service_pool.cc:224] Handling call
0709 12:27:12.736606 (+ 31477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.703835 24444 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:12.744418 22070 rpcz_store.cc:269] 0709 12:27:10.866089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.742813 (+1876724us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.742912 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:12.724403 24420 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:12.799263 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:12.745512 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 80549.4us
W20260709 12:27:12.766100 22071 rpcz_store.cc:269] 0709 12:27:10.851302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.727454 (+1876152us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.727560 (+   106us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.748055 22065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1485) took 1870 ms (client timeout 1831 ms). Trace:
I20260709 12:27:12.800321 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:12.766100 22073 rpcz_store.cc:269] 0709 12:27:10.887559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.746855 (+1859296us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.746947 (+    92us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.806555 22065 rpcz_store.cc:269] 0709 12:27:10.877915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.747874 (+1869959us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.747998 (+   124us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:12.649545 24471 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:12.674639 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1997) took 1787 ms. Trace:
W20260709 12:27:12.801766 22064 rpcz_store.cc:269] 0709 12:27:10.816118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.652665 (+1836547us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.655040 (+  2375us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.808415 22065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1478) took 1955 ms (client timeout 1931 ms). Trace:
W20260709 12:27:12.800594 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1486) took 1922 ms (client timeout 1858 ms). Trace:
W20260709 12:27:12.803490 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 62530.1us
I20260709 12:27:12.801209 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:12.801754 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 432) took 2014 ms. Trace:
I20260709 12:27:12.743134 22066 rpcz_store.cc:276] 0709 12:27:10.074831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.074973 (+   142us) service_pool.cc:224] Handling call
0709 12:27:10.075285 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:10.994782 (+919497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.669679 (+1674897us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54003cb754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:12.669885 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081144192}
W20260709 12:27:12.809309 22069 rpcz_store.cc:269] 0709 12:27:10.878215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.800429 (+1922214us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.800536 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:12.810075 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:12.800168 22808 rpcz_store.cc:269] 0709 12:27:10.104918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.814982 (+710064us) service_pool.cc:224] Handling call
0709 12:27:12.666634 (+1851652us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54004e75d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:12.666796 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287065984}
W20260709 12:27:12.808585 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 174711us
I20260709 12:27:12.807564 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:12.809034 22065 rpcz_store.cc:269] 0709 12:27:10.852846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.808261 (+1955415us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.808358 (+    97us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:12.806429 22071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1494) took 1918 ms (client timeout 1887 ms). Trace:
I20260709 12:27:12.811319 22113 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:12.811833 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:12.810562 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.743355 22185 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:12.810212 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.806989 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:12.665580 24435 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 12:27:12.765650 24437 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:12.825630 22070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1462) took 2008 ms (client timeout 1968 ms). Trace:
I20260709 12:27:12.812942 22805 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:12.810319 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:12.826577 22114 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.105s (SENT)
W20260709 12:27:12.826719 22066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1470) took 1976 ms (client timeout 2028 ms). Trace:
W20260709 12:27:12.812268 22071 rpcz_store.cc:269] 0709 12:27:10.887846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.806138 (+1918292us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.806364 (+   226us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:12.826963 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:12.826162 22070 rpcz_store.cc:269] 0709 12:27:10.804910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.813117 (+2008207us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.813233 (+   116us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:12.827235 22112 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:12.827256 22066 rpcz_store.cc:269] 0709 12:27:10.850725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.810097 (+1959372us) service_pool.cc:224] Handling call
0709 12:27:12.826662 (+ 16565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.814258 22810 raft_consensus.cc:2393] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
W20260709 12:27:12.815127 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 73401.2us
I20260709 12:27:12.815687 22806 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:12.747031 22804 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
I20260709 12:27:12.816149 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:12.808245 22039 rpcz_store.cc:276] 0709 12:27:10.887460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.674565 (+1787105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:12.736007 24512 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.797392 24255 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:27:12.817792 22113 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:12.834414 22216 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
W20260709 12:27:12.834510 22039 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45000 dropped due to backpressure: service queue is full with 50 items
I20260709 12:27:12.766647 24485 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:12.824662 22144 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:12.814329 22069 raft_consensus.cc:2410] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:12.770817 24422 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.674858 24515 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.829800 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:12.839463 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 602) took 1872 ms (client timeout 2465 ms). Trace:
I20260709 12:27:12.797555 24394 consensus_queue.cc:1048] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:27:12.832393 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:12.855434 22143 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:12.855554 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:12.856591 22216 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.837994 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.835104 22039 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45000 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1998)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 499)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1499)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2001)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2002)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1995)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44992 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1999)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2000)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2004)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 503)
W20260709 12:27:12.857620 22064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1484) took 1980 ms (client timeout 1955 ms). Trace:
W20260709 12:27:12.857993 22064 rpcz_store.cc:269] 0709 12:27:10.877649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.808785 (+1931136us) service_pool.cc:224] Handling call
0709 12:27:12.857546 (+ 48761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.830945 24514 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.830864 22185 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:12.831787 24411 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:12.865073 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:12.865746 22144 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.840879 24485 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:12.839054 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.839951 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:12.871277 22214 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:12.746683 24384 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:12.829481 22073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1996) took 2143 ms (client timeout 2105 ms). Trace:
I20260709 12:27:12.872305 24388 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.873070 24411 raft_consensus.cc:2804] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:12.873481 24411 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:12.873828 24411 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.874262 24459 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:12.875793 24294 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.861167 24514 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:12.880499 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:12.881561 24514 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:12.882086 22803 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:12.852850 24477 raft_consensus.cc:2764] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:12.805256 24420 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.694278 24490 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.839730 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:12.844619 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1464) took 1995 ms (client timeout 2029 ms). Trace:
I20260709 12:27:12.819108 24253 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:12.815748 24520 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:12.847153 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.702958 24393 consensus_queue.cc:237] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:12.814628 22219 rpcz_store.cc:276] 0709 12:27:10.787841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.699953 (+1912112us) service_pool.cc:224] Handling call
0709 12:27:12.700271 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.801514 (+101243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.801700 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.830931 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.799706 24452 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:27:12.825814 24444 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:12.854516 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:12.836287 22140 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
W20260709 12:27:12.851859 22807 rpcz_store.cc:269] 0709 12:27:10.959680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.655939 (+1696259us) service_pool.cc:224] Handling call
0709 12:27:12.832092 (+176153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:12.871430 22066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1460) took 2075 ms (client timeout 2126 ms). Trace:
W20260709 12:27:12.933736 22066 rpcz_store.cc:269] 0709 12:27:10.796419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.829198 (+2032779us) service_pool.cc:224] Handling call
0709 12:27:12.871365 (+ 42167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.934705 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.935496 22066 raft_consensus.cc:2368] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6.
I20260709 12:27:12.935719 22144 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 2.
W20260709 12:27:12.935868 22066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1490) took 2056 ms (client timeout 2124 ms). Trace:
W20260709 12:27:12.936249 22066 rpcz_store.cc:269] 0709 12:27:10.879304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.934417 (+2055113us) service_pool.cc:224] Handling call
0709 12:27:12.935811 (+  1394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.937120 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.848903 24453 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:12.844957 22804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 597) took 1952 ms (client timeout 2275 ms). Trace:
I20260709 12:27:12.913321 24420 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:12.885913 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:12.886236 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.947655 22141 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.947942 22064 raft_consensus.cc:2368] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
W20260709 12:27:12.948475 22064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1461) took 2150 ms (client timeout 2141 ms). Trace:
W20260709 12:27:12.948814 22064 rpcz_store.cc:269] 0709 12:27:10.797891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.858637 (+2060746us) service_pool.cc:224] Handling call
0709 12:27:12.948401 (+ 89764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.949863 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:12.881469 22139 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:12.914728 24253 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:12.887612 22803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 673) took 1957 ms (client timeout 2232 ms). Trace:
W20260709 12:27:12.889192 22069 rpcz_store.cc:269] 0709 12:27:10.849069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.809982 (+1960913us) service_pool.cc:224] Handling call
0709 12:27:12.844550 (+ 34568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.889281 22808 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:12.871626 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:12.958058 22806 raft_consensus.cc:2410] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:12.812587 22215 raft_consensus.cc:2393] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:12.959465 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:12.911233 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 430) took 2132 ms. Trace:
W20260709 12:27:12.915315 22112 leader_election.cc:336] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Timed out: RequestConsensusVote RPC to 127.20.109.68:41677 timed out after 2.275s (SENT)
W20260709 12:27:12.916708 22065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 496) took 2101 ms (client timeout 2073 ms). Trace:
W20260709 12:27:12.956836 22803 rpcz_store.cc:269] 0709 12:27:10.930083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.479480 (+1549397us) service_pool.cc:224] Handling call
0709 12:27:12.887548 (+408068us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:12.961983 22065 rpcz_store.cc:269] 0709 12:27:10.815517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.813816 (+1998299us) service_pool.cc:224] Handling call
0709 12:27:12.916627 (+102811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.885643 24485 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.933343 24520 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.852046 24422 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.869789 24500 raft_consensus.cc:2804] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:12.931685 22071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1488) took 2052 ms (client timeout 2058 ms). Trace:
W20260709 12:27:12.990795 22071 rpcz_store.cc:269] 0709 12:27:10.878785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.831457 (+1952672us) service_pool.cc:224] Handling call
0709 12:27:12.931621 (+100164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.932950 22222 raft_consensus.cc:1240] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:27:12.882329 24175 consensus_queue.cc:1059] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:27:12.860375 22185 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:12.942993 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:12.994648 22140 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:12.945302 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:12.995138 22216 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:12.945375 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:12.945894 22066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 495) took 2130 ms (client timeout 2211 ms). Trace:
I20260709 12:27:12.913137 24498 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:12.872328 22073 rpcz_store.cc:269] 0709 12:27:10.674247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.817413 (+2143166us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:12.817533 (+   120us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:13.001144 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:13.001761 22073 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.961513 22213 rpcz_store.cc:276] 0709 12:27:10.778328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.482900 (+1704572us) service_pool.cc:224] Handling call
0709 12:27:12.483192 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.483398 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:12.555387 (+ 71989us) log.cc:844] Serialized 14 byte log entry
0709 12:27:12.910754 (+355367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:12.910839 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:12.910902 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.910985 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.911153 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188001,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":25775,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":16666,"thread_start_us":404276,"threads_started":2}
I20260709 12:27:12.934566 24457 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.961809 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 46533us
I20260709 12:27:12.920867 22775 leader_election.cc:400] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4.
I20260709 12:27:13.004376 22775 leader_election.cc:403] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:12.967572 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:13.005366 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:12.953045 24508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.011s	sys 0.013s
W20260709 12:27:12.941628 22804 rpcz_store.cc:269] 0709 12:27:10.891739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.636011 (+1744272us) service_pool.cc:224] Handling call
0709 12:27:12.843566 (+207555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.853617 24515 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:12.968832 24503 log.cc:927] Time spent T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 1.061s	user 0.001s	sys 0.004s
W20260709 12:27:12.971047 24509 log.cc:927] Time spent T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.674s	user 0.000s	sys 0.002s
I20260709 12:27:12.972530 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:13.035282 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:12.973578 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.974030 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:12.953208 24453 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:12.980702 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:12.981846 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 183541us
I20260709 12:27:12.992206 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:12.993076 22143 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:12.945231 24444 raft_consensus.cc:697] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:12.995786 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 135481us
I20260709 12:27:12.995807 22214 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:12.996421 22066 rpcz_store.cc:269] 0709 12:27:10.815172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.936876 (+2121704us) service_pool.cc:224] Handling call
0709 12:27:12.945828 (+  8952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:12.961090 24253 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.939314 24471 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:13.007802 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 87085.3us
W20260709 12:27:13.008108 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 190397us
I20260709 12:27:13.009310 22071 raft_consensus.cc:2410] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:13.014617 22213 raft_consensus.cc:3055] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:13.015324 22216 raft_consensus.cc:1275] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:13.011503 24508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.011s	sys 0.013s
I20260709 12:27:12.994113 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:12.991251 24520 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:13.036686 22219 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:27:13.450562 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56083.7us
W20260709 12:27:13.660800 22141 consensus_meta.cc:287] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.002s
I20260709 12:27:13.663630 22141 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
W20260709 12:27:13.663733 22071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1468) took 2813 ms (client timeout 2398 ms). Trace:
W20260709 12:27:13.664135 22071 rpcz_store.cc:269] 0709 12:27:10.850211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.993888 (+2143677us) service_pool.cc:224] Handling call
0709 12:27:13.663667 (+669779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.664539 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:13.011157 24437 raft_consensus.cc:697] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:13.665820 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:13.666491 24520 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:13.666275 24437 consensus_queue.cc:237] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.012795 24457 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.668147 22145 raft_consensus.cc:2410] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:13.189321 24411 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.446048 24381 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:13.670243 24470 consensus_queue.cc:1059] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:13.671066 24446 raft_consensus.cc:3055] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:13.671442 24446 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:13.671798 24411 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:13.672607 22185 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:13.672250 24446 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:13.673898 24446 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:13.674535 24470 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:13.666344 22141 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.675582 24470 raft_consensus.cc:3055] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:13.675962 24470 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:13.676784 24470 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:13.677736 24470 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:13.683333 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 502) took 2704 ms (client timeout 2130 ms). Trace:
I20260709 12:27:13.662500 22113 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:13.683774 22069 rpcz_store.cc:269] 0709 12:27:10.978968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.962950 (+1983982us) service_pool.cc:224] Handling call
0709 12:27:13.683242 (+720292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.684705 22113 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:13.036866 22810 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.687413 24536 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:13.687880 24536 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:13.688223 24536 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.689829 22065 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:13.690194 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:13.134878 22064 raft_consensus.cc:2393] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:13.690516 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:13.002079 24501 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:13.694918 22185 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:13.273718 22072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1973) took 4755 ms (client timeout 2105 ms). Trace:
I20260709 12:27:13.697139 22140 raft_consensus.cc:1240] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:13.240476 22073 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:13.698514 22073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 1998) took 2769 ms (client timeout 2465 ms). Trace:
I20260709 12:27:13.684985 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:13.091415 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.686008 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:13.007849 24500 raft_consensus.cc:697] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:13.011372 24438 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.669718 22803 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:13.692662 22147 raft_consensus.cc:2368] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5.
I20260709 12:27:13.179771 22148 raft_consensus.cc:2410] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:13.663268 22213 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:13.683636 22775 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:13.699184 22069 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:13.440946 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.191756 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:13.181450 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 582052us
I20260709 12:27:13.721341 22113 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:13.258385 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:13.696059 22072 rpcz_store.cc:269] 0709 12:27:08.482139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.482294 (+   155us) service_pool.cc:224] Handling call
0709 12:27:13.237606 (+4755312us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54000d6454. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:13.237783 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4725210368}
W20260709 12:27:13.698891 22073 rpcz_store.cc:269] 0709 12:27:10.928667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.000848 (+2072181us) service_pool.cc:224] Handling call
0709 12:27:13.698439 (+697591us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:13.664790 22071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 499) took 2805 ms (client timeout 2580 ms). Trace:
I20260709 12:27:13.723698 22113 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:13.724059 22071 rpcz_store.cc:269] 0709 12:27:10.858992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.664645 (+2805653us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:13.664741 (+    96us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:13.709998 22141 raft_consensus.cc:2468] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
W20260709 12:27:13.169730 24458 consensus_meta.cc:287] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.005s
I20260709 12:27:13.731123 24458 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.733227 24458 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:13.736217 24457 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:13.737934 24445 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:13.738495 24445 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:13.739390 24445 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:13.716882 24381 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:13.723757 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:13.715803 24393 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.685957 24444 consensus_queue.cc:237] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.037230 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:13.747205 22809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 652) took 3552 ms (client timeout 2748 ms). Trace:
W20260709 12:27:13.746968 22068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 489) took 3638 ms (client timeout 2079 ms). Trace:
W20260709 12:27:13.763175 22068 rpcz_store.cc:269] 0709 12:27:10.088171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.097631 (+  9460us) service_pool.cc:224] Handling call
0709 12:27:13.726148 (+3628517us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000712d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:13.726240 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376561024}
I20260709 12:27:13.362810 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1866) took 2768 ms. Trace:
W20260709 12:27:13.151700 24528 log.cc:927] Time spent T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:27:13.724838 22113 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:13.726975 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:13.742527 22810 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
W20260709 12:27:13.727284 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.179366 24422 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:13.720085 22213 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.871929 22213 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:13.758008 22809 rpcz_store.cc:269] 0709 12:27:10.194433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.747002 (+3552569us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:13.747115 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:13.746320 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:13.628307 24487 raft_consensus.cc:3055] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:13.796327 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:13.725713 22221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 427) took 3461 ms (client timeout 1833 ms). Trace:
I20260709 12:27:13.797598 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:13.873476 22188 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.509s (SENT)
I20260709 12:27:13.874185 22188 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:13.757287 22065 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
W20260709 12:27:13.874869 22065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1495) took 2986 ms (client timeout 2235 ms). Trace:
W20260709 12:27:13.875242 22065 rpcz_store.cc:269] 0709 12:27:10.888112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.967121 (+2079009us) service_pool.cc:224] Handling call
0709 12:27:13.874796 (+907675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.803526 22803 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:13.876637 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:13.877475 22803 raft_consensus.cc:2410] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:13.802290 22069 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
W20260709 12:27:13.878024 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1499) took 1980 ms (client timeout 1919 ms). Trace:
W20260709 12:27:13.878381 22069 rpcz_store.cc:269] 0709 12:27:11.898002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.684697 (+1786695us) service_pool.cc:224] Handling call
0709 12:27:13.877949 (+193252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.703469 24411 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:13.853447 24458 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:13.852910 22807 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.716840 24520 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.854836 24456 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:13.807435 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:13.855537 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 130764us
I20260709 12:27:13.894465 22068 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:13.894696 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:13.895941 22113 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:13.856355 22036 connection.cc:256] RPC call timeout handler was delayed by -2.2277798469999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:27:13.897542 22036 connection.cc:256] RPC call timeout handler was delayed by -2.0577326170000561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:27:13.898033 22036 connection.cc:256] RPC call timeout handler was delayed by -1.672532616999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 12:27:13.744177 22804 raft_consensus.cc:2393] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:13.785336 22218 rpcz_store.cc:276] 0709 12:27:10.593901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.975306 (+381405us) service_pool.cc:224] Handling call
0709 12:27:10.989519 (+ 14213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:10.996370 (+  6851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:10.996400 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.009805 (+ 13405us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.051777 (+ 41972us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:11.051814 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.051875 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.940479 (+1888604us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:13.273248 (+332769us) raft_consensus.cc:1685] finished
0709 12:27:13.273271 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.362701 (+ 89430us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16625,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8012,"spinlock_wait_cycles":886835456,"thread_start_us":36163,"threads_started":1,"wal-append.queue_time_us":891687}
I20260709 12:27:13.859810 24452 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.742961 24381 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:13.905838 24381 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:13.853533 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.858777 24513 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:13.855486 24422 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:13.747390 24393 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:13.743170 22802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 659) took 2699 ms (client timeout 1581 ms). Trace:
I20260709 12:27:13.853658 24440 raft_consensus.cc:2764] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:27:13.873440 22072 raft_consensus.cc:2393] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 11: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:13.879317 22806 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:13.925474 22809 raft_consensus.cc:1240] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
W20260709 12:27:13.879863 22221 rpcz_store.cc:269] 0709 12:27:10.264378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.264504 (+   126us) service_pool.cc:224] Handling call
0709 12:27:13.725522 (+3461018us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400118354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:13.725642 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766040832}
I20260709 12:27:13.926250 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 655) took 3392 ms. Trace:
I20260709 12:27:13.926620 22809 rpcz_store.cc:276] 0709 12:27:10.533495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.907930 (+3374435us) service_pool.cc:224] Handling call
0709 12:27:13.925264 (+ 17334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.925983 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.926190 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:13.748564 24531 log.cc:927] Time spent T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.558s	user 0.010s	sys 0.009s
I20260709 12:27:13.885533 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 605) took 1136 ms. Trace:
I20260709 12:27:13.887081 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:13.887290 24458 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.170414 24526 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:13.725610 24295 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:13.889945 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:13.939189 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2007) took 1075 ms. Trace:
I20260709 12:27:13.912680 24532 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:13.903358 24457 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:13.908696 22068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 505) took 1234 ms (client timeout 1642 ms). Trace:
W20260709 12:27:13.943508 22068 rpcz_store.cc:269] 0709 12:27:12.674331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.807128 (+1132797us) service_pool.cc:224] Handling call
0709 12:27:13.908625 (+101497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.944442 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:13.944972 22068 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:13.909492 22036 connection.cc:256] RPC call timeout handler was delayed by -1.2581327879997843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 12:27:13.890393 22773 connection.cc:256] RPC call timeout handler was delayed by -1.1171520060001967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.258s for a response
I20260709 12:27:13.865767 24500 consensus_queue.cc:237] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.911592 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:13.951243 22065 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:13.757541 24535 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:13.914885 22213 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:13.882826 24487 raft_consensus.cc:740] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:13.929494 22072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1471) took 3078 ms (client timeout 3143 ms). Trace:
I20260709 12:27:13.929198 22803 rpcz_store.cc:276] 0709 12:27:12.748921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.876362 (+1127441us) service_pool.cc:224] Handling call
0709 12:27:13.885447 (+  9085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.930331 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 676) took 1043 ms. Trace:
I20260709 12:27:13.909410 24385 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.934002 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 590) took 3109 ms. Trace:
I20260709 12:27:13.913256 24411 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:13.893651 24520 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:13.939584 22069 rpcz_store.cc:276] 0709 12:27:12.863736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.889631 (+1025895us) service_pool.cc:224] Handling call
0709 12:27:13.939121 (+ 49490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.942231 22809 raft_consensus.cc:1240] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:13.949620 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.958977 22213 pending_rounds.cc:85] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting all ops after (but not including) 1
I20260709 12:27:13.961441 24458 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:13.931524 24422 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:13.962750 22072 rpcz_store.cc:269] 0709 12:27:10.851011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.746052 (+2895041us) service_pool.cc:224] Handling call
0709 12:27:13.929411 (+183359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.963055 22810 rpcz_store.cc:276] 0709 12:27:12.886934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.874550 (+987616us) service_pool.cc:224] Handling call
0709 12:27:13.930256 (+ 55706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.905794 24452 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:13.971920 22068 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:13.973129 22806 rpcz_store.cc:276] 0709 12:27:10.816421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.925410 (+3108989us) service_pool.cc:224] Handling call
0709 12:27:13.925731 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.925962 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.925990 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:13.926036 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:13.926082 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.926135 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.926237 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.989387 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 504) took 1315 ms. Trace:
I20260709 12:27:13.989732 22068 rpcz_store.cc:276] 0709 12:27:12.674073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.944186 (+1270113us) service_pool.cc:224] Handling call
0709 12:27:13.989326 (+ 45140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.990070 22806 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:27:13.991199 22803 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:13.977276 22213 pending_rounds.cc:107] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:13.991873 22213 raft_consensus.cc:2889] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:13.992650 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1874) took 1174 ms. Trace:
I20260709 12:27:13.992976 22213 rpcz_store.cc:276] 0709 12:27:12.818375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.002535 (+184160us) service_pool.cc:224] Handling call
0709 12:27:13.014471 (+ 11936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.992400 (+977929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.992583 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.991896 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 593) took 3134 ms. Trace:
W20260709 12:27:13.963904 24512 consensus_meta.cc:287] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.119s	user 0.008s	sys 0.002s
I20260709 12:27:13.983323 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 658) took 3139 ms. Trace:
I20260709 12:27:13.994149 22803 rpcz_store.cc:276] 0709 12:27:10.857171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.963746 (+3106575us) service_pool.cc:224] Handling call
0709 12:27:13.991010 (+ 27264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.991649 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.991835 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.993728 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.000948 22809 rpcz_store.cc:276] 0709 12:27:10.843958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.927546 (+3083588us) service_pool.cc:224] Handling call
0709 12:27:13.942031 (+ 14485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.974896 (+ 32865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.983243 (+  8347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.001523 22069 raft_consensus.cc:2393] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
W20260709 12:27:14.002003 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 128573us
I20260709 12:27:14.002609 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:13.968789 22065 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
W20260709 12:27:13.916324 22802 rpcz_store.cc:269] 0709 12:27:11.043530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.052542 (+  9012us) service_pool.cc:224] Handling call
0709 12:27:13.742972 (+2690430us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54008a02d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:13.743098 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738649984}
I20260709 12:27:13.999985 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:14.008683 22068 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.935266 24513 consensus_queue.cc:1059] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:27:14.007596 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 595) took 3128 ms. Trace:
I20260709 12:27:14.011691 22806 rpcz_store.cc:276] 0709 12:27:10.862008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.989485 (+3127477us) service_pool.cc:224] Handling call
0709 12:27:13.989853 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.990465 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.990691 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.012720 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2008) took 1144 ms. Trace:
I20260709 12:27:14.013074 22069 rpcz_store.cc:276] 0709 12:27:12.863960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.002306 (+1138346us) service_pool.cc:224] Handling call
0709 12:27:14.008267 (+  5961us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.013935 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.004125 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2011) took 1114 ms. Trace:
I20260709 12:27:14.014730 22065 rpcz_store.cc:276] 0709 12:27:12.889394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.888886 (+999492us) service_pool.cc:224] Handling call
0709 12:27:14.004059 (+115173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.015671 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:14.016367 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 119388us
I20260709 12:27:14.016992 24513 raft_consensus.cc:3055] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:14.017385 24513 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:14.018303 24513 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.019330 24545 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.016392 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 508) took 1040 ms. Trace:
I20260709 12:27:14.020907 22065 rpcz_store.cc:276] 0709 12:27:12.976242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.015424 (+1039182us) service_pool.cc:224] Handling call
0709 12:27:14.016313 (+   889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.916142 24456 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.024940 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2006) took 1151 ms. Trace:
I20260709 12:27:14.025462 22069 rpcz_store.cc:276] 0709 12:27:12.863472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.013682 (+1150210us) service_pool.cc:224] Handling call
0709 12:27:14.014551 (+   869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.026535 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:14.027390 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1503) took 1014 ms. Trace:
I20260709 12:27:14.027720 22069 rpcz_store.cc:276] 0709 12:27:13.012662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.026209 (+1013547us) service_pool.cc:224] Handling call
0709 12:27:14.027329 (+  1120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.019865 24513 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:14.032912 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:14.034629 22809 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:14.036412 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 598) took 3126 ms. Trace:
I20260709 12:27:14.036775 22809 rpcz_store.cc:276] 0709 12:27:10.909946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.001751 (+3091805us) service_pool.cc:224] Handling call
0709 12:27:14.034300 (+ 32549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.036105 (+  1805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.036314 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.036895 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.030390 22068 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:14.038094 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1506) took 1024 ms. Trace:
W20260709 12:27:14.038200 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 354642us
I20260709 12:27:13.999714 24482 raft_consensus.cc:3055] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:14.039899 22113 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:14.038103 22065 raft_consensus.cc:2393] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
W20260709 12:27:14.040565 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 67203.6us
W20260709 12:27:14.041359 22067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1473) took 3189 ms (client timeout 1595 ms). Trace:
W20260709 12:27:14.042688 22067 rpcz_store.cc:269] 0709 12:27:10.851577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.041187 (+3189610us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:14.041301 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:14.043697 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:13.950245 24532 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:14.044907 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2005) took 1371 ms. Trace:
W20260709 12:27:14.041498 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 346627us
I20260709 12:27:14.010222 24535 raft_consensus.cc:697] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:14.049685 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2001) took 1377 ms. Trace:
I20260709 12:27:13.985884 24385 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:14.050101 22067 rpcz_store.cc:276] 0709 12:27:12.672628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.043429 (+1370801us) service_pool.cc:224] Handling call
0709 12:27:14.049619 (+  6190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:14.050839 22064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1481) took 3176 ms (client timeout 2181 ms). Trace:
I20260709 12:27:14.051057 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.051690 22067 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:14.051978 22064 rpcz_store.cc:269] 0709 12:27:10.874675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.949562 (+2074887us) service_pool.cc:224] Handling call
0709 12:27:14.050615 (+1101053us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400314054. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:14.050759 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423311232}
W20260709 12:27:14.044015 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.038527 22068 rpcz_store.cc:276] 0709 12:27:13.013364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.999717 (+986353us) service_pool.cc:224] Handling call
0709 12:27:14.038025 (+ 38308us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:14.042071 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 306502us
I20260709 12:27:14.028827 24501 raft_consensus.cc:697] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:14.045324 22065 rpcz_store.cc:276] 0709 12:27:12.673578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.036631 (+1363053us) service_pool.cc:224] Handling call
0709 12:27:14.044841 (+  8210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.045883 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.052145 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2009) took 1183 ms. Trace:
I20260709 12:27:14.054353 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2010) took 1183 ms. Trace:
I20260709 12:27:14.047360 22809 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:14.054977 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:14.055444 22069 rpcz_store.cc:276] 0709 12:27:12.870680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.028392 (+1157712us) service_pool.cc:224] Handling call
0709 12:27:14.054297 (+ 25905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.046097 22185 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:14.054334 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.056427 22065 raft_consensus.cc:2410] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:14.056721 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 664) took 1352 ms. Trace:
I20260709 12:27:14.007332 24422 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.060658 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:14.042116 24482 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:14.058676 22809 rpcz_store.cc:276] 0709 12:27:12.704040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.037646 (+1333606us) service_pool.cc:224] Handling call
0709 12:27:14.047065 (+  9419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.056481 (+  9416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.056665 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:14.048483 24485 consensus_meta.cc:287] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.057s	user 0.010s	sys 0.000s
I20260709 12:27:14.062271 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1505) took 1049 ms. Trace:
I20260709 12:27:14.062732 22069 rpcz_store.cc:276] 0709 12:27:13.013134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.056247 (+1043113us) service_pool.cc:224] Handling call
0709 12:27:14.062207 (+  5960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.058339 22068 raft_consensus.cc:2393] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:14.044492 24457 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:14.054955 22067 rpcz_store.cc:276] 0709 12:27:12.868326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.050823 (+1182497us) service_pool.cc:224] Handling call
0709 12:27:14.052094 (+  1271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.060711 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.047402 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:14.059449 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1498) took 2167 ms. Trace:
I20260709 12:27:14.010645 24512 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:14.066864 22064 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:14.067027 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:14.066929 22065 rpcz_store.cc:276] 0709 12:27:11.892568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.054741 (+2162173us) service_pool.cc:224] Handling call
0709 12:27:14.059386 (+  4645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.067504 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1504) took 1054 ms. Trace:
I20260709 12:27:14.049788 24411 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:14.061566 22185 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:14.064903 22037 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:14.063882 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1508) took 1049 ms. Trace:
I20260709 12:27:14.071264 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.089293 24490 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:14.090656 24437 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:14.091029 24456 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:14.091259 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 1.17269e+06us
W20260709 12:27:14.115718 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 54230.4us
I20260709 12:27:14.070930 22064 rpcz_store.cc:276] 0709 12:27:13.012900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.052965 (+1040065us) service_pool.cc:224] Handling call
0709 12:27:14.067437 (+ 14472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30848}
I20260709 12:27:14.070986 22067 raft_consensus.cc:2393] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:14.116570 22185 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:14.117340 22068 rpcz_store.cc:276] 0709 12:27:13.014242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.053669 (+1039427us) service_pool.cc:224] Handling call
0709 12:27:14.063820 (+ 10151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.119076 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.089066 24253 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:14.066918 24485 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:14.118294 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2012) took 1142 ms. Trace:
I20260709 12:27:14.117930 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.119237 22809 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:27:14.094230 22807 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
W20260709 12:27:14.091008 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 43679us
I20260709 12:27:14.052394 24487 consensus_queue.cc:260] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:14.424894 24420 consensus_meta.cc:287] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.463s	user 0.002s	sys 0.008s
W20260709 12:27:14.428526 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.429195 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.428905 24420 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.429805 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2002) took 1757 ms. Trace:
I20260709 12:27:14.430431 22065 rpcz_store.cc:276] 0709 12:27:12.975711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.070994 (+1095283us) service_pool.cc:224] Handling call
0709 12:27:14.118219 (+ 47225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.430737 22113 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:14.119971 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 171909us
I20260709 12:27:14.431417 22809 pending_rounds.cc:85] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting all ops after (but not including) 6
I20260709 12:27:14.431737 22809 pending_rounds.cc:107] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting uncommitted NO_OP operation due to leader change: 6.7
W20260709 12:27:14.248378 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.432089 22809 raft_consensus.cc:2889] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:14.173797 22773 leader_election.cc:336] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.599s (SENT)
I20260709 12:27:14.432736 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:14.320384 22810 raft_consensus.cc:1240] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:14.433614 22213 raft_consensus.cc:2393] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 3: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
W20260709 12:27:14.120464 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 60125us
I20260709 12:27:14.435731 22213 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:14.437475 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:14.438313 22213 raft_consensus.cc:2393] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:14.138329 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1501) took 1126 ms. Trace:
I20260709 12:27:14.120976 22185 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:14.114204 24393 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:14.441295 24393 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:14.441990 24393 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.442441 24393 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:14.096752 24445 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:14.166926 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.443640 22064 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:14.444247 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 507) took 1469 ms. Trace:
I20260709 12:27:14.444633 22064 rpcz_store.cc:276] 0709 12:27:12.975021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.116620 (+1141599us) service_pool.cc:224] Handling call
0709 12:27:14.444176 (+327556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.140401 24446 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.289s
I20260709 12:27:14.430214 22068 rpcz_store.cc:276] 0709 12:27:12.672856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.118778 (+1445922us) service_pool.cc:224] Handling call
0709 12:27:14.429743 (+310965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.451309 22221 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:14.433477 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 259707us
I20260709 12:27:14.087709 24453 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:14.213739 22066 raft_consensus.cc:2368] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:14.439196 22067 rpcz_store.cc:276] 0709 12:27:13.012194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.066797 (+1054603us) service_pool.cc:224] Handling call
0709 12:27:14.138215 (+ 71418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.455585 22067 raft_consensus.cc:1240] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:27:14.452756 22773 leader_election.cc:336] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.833s (SENT)
I20260709 12:27:14.115895 24437 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.454317 22221 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:14.456243 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 497) took 3640 ms. Trace:
I20260709 12:27:14.457950 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 665) took 1753 ms. Trace:
W20260709 12:27:14.457824 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.457602 22067 rpcz_store.cc:276] 0709 12:27:10.815821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.454992 (+3639171us) service_pool.cc:224] Handling call
0709 12:27:14.455360 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.455992 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.456190 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18816}
I20260709 12:27:14.459440 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1507) took 1445 ms. Trace:
I20260709 12:27:14.459743 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 600) took 3500 ms. Trace:
I20260709 12:27:14.460045 22067 raft_consensus.cc:1240] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:14.088063 24520 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:14.460790 22069 rpcz_store.cc:276] 0709 12:27:13.013698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.063447 (+1049749us) service_pool.cc:224] Handling call
0709 12:27:14.459283 (+395836us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:14.456704 22773 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.853s (SENT)
I20260709 12:27:14.452466 22113 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:14.464905 22064 raft_consensus.cc:1240] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:14.465308 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 500) took 3592 ms. Trace:
I20260709 12:27:14.066504 24457 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:14.161013 24274 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:14.465778 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 493) took 3651 ms. Trace:
I20260709 12:27:14.460796 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 494) took 3646 ms. Trace:
I20260709 12:27:14.460387 22809 rpcz_store.cc:276] 0709 12:27:12.704271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.061863 (+1357592us) service_pool.cc:224] Handling call
0709 12:27:14.096263 (+ 34400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.457728 (+361465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.457897 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.428821 24385 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:14.165279 24381 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.170996 24535 consensus_queue.cc:237] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:14.242339 24501 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.465744 22067 rpcz_store.cc:276] 0709 12:27:10.873312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.459559 (+3586247us) service_pool.cc:224] Handling call
0709 12:27:14.459873 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.461921 (+  2048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.465250 (+  3329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.590083 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1999) took 1918 ms. Trace:
I20260709 12:27:14.706825 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 669) took 3778 ms. Trace:
I20260709 12:27:14.424871 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 654) took 4176 ms. Trace:
W20260709 12:27:14.589957 22114 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.604s (SENT)
I20260709 12:27:14.522608 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:14.782666 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 330264us
I20260709 12:27:14.793941 22218 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:14.683748 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 252115us
I20260709 12:27:14.794749 22113 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:14.776569 22064 rpcz_store.cc:276] 0709 12:27:10.814204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.449981 (+3635777us) service_pool.cc:224] Handling call
0709 12:27:14.464739 (+ 14758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.465551 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.465727 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.795403 22036 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:14.320298 22801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 650) took 4205 ms (client timeout 2187 ms). Trace:
I20260709 12:27:14.450201 24526 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:14.777846 24445 raft_consensus.cc:697] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:14.600399 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:14.591200 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:14.775619 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 318937us
I20260709 12:27:14.233069 24549 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:14.462131 24437 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:14.813534 24444 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:14.859125 24444 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.859589 24444 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:14.460227 22806 rpcz_store.cc:276] 0709 12:27:10.959065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.243567 (+3284502us) service_pool.cc:224] Handling call
0709 12:27:14.243949 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.244211 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:14.326481 (+ 82270us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.459400 (+132919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.459469 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:14.459528 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.459590 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.459691 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85649,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":71,"raft.queue_time_us":818,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3213,"thread_start_us":132550,"threads_started":1}
I20260709 12:27:14.865442 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2289) took 4207 ms. Trace:
I20260709 12:27:14.799034 24420 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:14.709103 24536 consensus_meta.cc:287] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.020s	user 0.008s	sys 0.002s
I20260709 12:27:14.866631 24420 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:14.867161 24420 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.526150 22186 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:14.596704 22070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1458) took 3815 ms (client timeout 2188 ms). Trace:
W20260709 12:27:14.867990 22070 rpcz_store.cc:269] 0709 12:27:10.781679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.596497 (+3814818us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:14.596642 (+   145us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:14.775473 22803 rpcz_store.cc:276] 0709 12:27:10.929007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.003635 (+3074628us) service_pool.cc:224] Handling call
0709 12:27:14.023167 (+ 19532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.141392 (+118225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.141431 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.141477 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:14.141528 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.706459 (+564931us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b54008a2fd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:14.706523 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.706743 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":243,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":52647,"spinlock_wait_cycles":213048192}
I20260709 12:27:14.774685 22071 rpcz_store.cc:276] 0709 12:27:12.672128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.589194 (+1917066us) service_pool.cc:224] Handling call
0709 12:27:14.589563 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.589750 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.589776 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.589819 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:14.589857 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.589909 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.590009 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.776227 22068 rpcz_store.cc:276] 0709 12:27:10.814842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.450082 (+3635240us) service_pool.cc:224] Handling call
0709 12:27:14.450542 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.460495 (+  9953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.460522 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.460565 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:14.460598 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.460650 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.460745 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.787156 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:14.457336 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 674) took 1571 ms (client timeout 1903 ms). Trace:
I20260709 12:27:14.788939 22037 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:14.596143 24515 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:14.519436 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 398519us
I20260709 12:27:14.775429 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2000) took 2103 ms. Trace:
W20260709 12:27:14.790165 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.140666 24541 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:14.517163 24482 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.891611 24482 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:14.891779 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 102919us
I20260709 12:27:14.893641 24526 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:14.894008 24526 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.894336 24526 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:14.895612 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.897533 22809 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:14.458648 24411 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:14.794468 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 204545us
W20260709 12:27:14.900733 22114 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.690s (SENT)
W20260709 12:27:14.901690 22114 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.832s (SENT)
I20260709 12:27:14.902029 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:14.453600 24545 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:14.775221 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 222524us
I20260709 12:27:14.796926 22064 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:14.234310 24532 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:14.709638 24438 consensus_meta.cc:287] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.985s	user 0.006s	sys 0.002s
I20260709 12:27:14.789359 24457 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:14.804239 24274 raft_consensus.cc:697] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:14.588083 24253 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:14.807677 24381 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:14.807502 24382 consensus_queue.cc:1059] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:27:14.808481 24556 log.cc:927] Time spent T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 12:27:14.886673 22807 rpcz_store.cc:269] 0709 12:27:12.886382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.986658 (+100276us) service_pool.cc:224] Handling call
0709 12:27:14.454773 (+1468115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.809238 22036 leader_election.cc:400] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5.
I20260709 12:27:14.472594 24520 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:14.456959 24418 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.342s
I20260709 12:27:14.563259 24537 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.792044 24422 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:14.796499 24487 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:14.686137 24512 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:14.842190 22218 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
W20260709 12:27:14.802120 22776 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.768s (SENT)
W20260709 12:27:14.868613 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 342516us
W20260709 12:27:14.989089 22773 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.768s (SENT)
I20260709 12:27:14.989662 22186 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:14.939209 24561 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.885627 22185 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:14.798169 22801 rpcz_store.cc:269] 0709 12:27:10.115356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.812375 (+697019us) service_pool.cc:224] Handling call
0709 12:27:14.314909 (+3502534us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540054d3d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:14.320211 (+  5302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444915584}
I20260709 12:27:14.899227 24485 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:14.886078 22067 rpcz_store.cc:276] 0709 12:27:12.672391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.774501 (+2102110us) service_pool.cc:224] Handling call
0709 12:27:14.774904 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.775101 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.775125 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.775169 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:14.775205 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.775259 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.775374 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.886482 22068 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:14.995428 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 506) took 2044 ms. Trace:
I20260709 12:27:14.995787 22068 rpcz_store.cc:276] 0709 12:27:12.950964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.885833 (+1934869us) service_pool.cc:224] Handling call
0709 12:27:14.886163 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.995140 (+108977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.995366 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.996819 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:14.997529 22068 raft_consensus.cc:2368] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3.
I20260709 12:27:14.879346 24420 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:14.887459 24536 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:14.889324 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 671) took 3959 ms. Trace:
I20260709 12:27:14.889585 24445 consensus_queue.cc:237] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.888947 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:14.890386 24562 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:14.890933 24541 raft_consensus.cc:697] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:14.902750 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 108087us
W20260709 12:27:14.986340 24393 consensus_meta.cc:287] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.002s
I20260709 12:27:14.971796 22036 leader_election.cc:403] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:14.972223 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 604) took 2223 ms. Trace:
W20260709 12:27:14.937511 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.001654 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.809310 22069 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:27:15.002017 22069 pending_rounds.cc:85] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: Aborting all ops after (but not including) 3
I20260709 12:27:15.002192 22141 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:15.002844 22188 leader_election.cc:400] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: Vote denied by peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979) with higher term. Message: Invalid argument: T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3.
I20260709 12:27:15.002342 22069 pending_rounds.cc:107] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:27:14.982676 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2003) took 2301 ms. Trace:
W20260709 12:27:14.983167 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 382832us
I20260709 12:27:15.003221 22069 raft_consensus.cc:2889] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:15.003958 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44992 (request call id 1482) took 4127 ms. Trace:
I20260709 12:27:15.004297 22069 rpcz_store.cc:276] 0709 12:27:10.877042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.462689 (+3585647us) service_pool.cc:224] Handling call
0709 12:27:14.808998 (+346309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.003745 (+194747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.003904 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:15.006348 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.007002 22064 rpcz_store.cc:276] 0709 12:27:12.673113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.795616 (+2122503us) service_pool.cc:224] Handling call
0709 12:27:14.795937 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.973833 (+177896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.974019 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.840098 24553 raft_consensus.cc:2764] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:14.894758 24560 consensus_queue.cc:1059] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:27:15.001276 22806 rpcz_store.cc:276] 0709 12:27:12.748655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.862997 (+2114342us) service_pool.cc:224] Handling call
0709 12:27:14.863340 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.863568 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:14.863869 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.971743 (+107874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.971810 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:14.971872 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.971977 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.972129 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3134,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":465,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5723,"thread_start_us":106637,"threads_started":1,"wal-append.queue_time_us":129244}
I20260709 12:27:14.865871 22222 rpcz_store.cc:276] 0709 12:27:10.657608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.010685 (+353077us) service_pool.cc:224] Handling call
0709 12:27:11.010999 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.991635 (+1980636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.865109 (+1873474us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54000e88d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:14.865360 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4419639680}
I20260709 12:27:14.978940 24565 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:14.989045 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 186952us
I20260709 12:27:14.905261 24515 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:27:15.016206 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.017015 22146 raft_consensus.cc:2410] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:27:14.993239 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 107715us
I20260709 12:27:14.870151 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2004) took 2196 ms. Trace:
I20260709 12:27:15.017886 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:14.985807 24559 log.cc:927] Time spent T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:27:14.999467 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:15.001654 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 192576us
W20260709 12:27:15.000737 24513 consensus_meta.cc:287] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.960s	user 0.011s	sys 0.000s
I20260709 12:27:15.023253 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:14.900760 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:15.009464 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 69470.5us
I20260709 12:27:14.940824 24411 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:14.932214 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 503) took 2258 ms. Trace:
I20260709 12:27:14.982398 24438 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4.
I20260709 12:27:15.027004 22071 rpcz_store.cc:276] 0709 12:27:12.673818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.885630 (+2211812us) service_pool.cc:224] Handling call
0709 12:27:14.931655 (+ 46025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.931852 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.931879 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.931924 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:14.931962 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.932017 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.932143 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:15.011672 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.867554 24385 consensus_queue.cc:1059] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:27:15.014741 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.015051 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.903295 24453 consensus_queue.cc:1059] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:27:15.017922 22185 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:15.018141 22070 rpcz_store.cc:276] 0709 12:27:12.673342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.868898 (+2195556us) service_pool.cc:224] Handling call
0709 12:27:14.869239 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.869606 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.869649 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.869723 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:14.869775 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.869928 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.870085 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.879781 24549 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:14.994179 24501 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.009233 24388 raft_consensus.cc:993] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: : Instructing follower d465f3cb42174eb89615dcd747f9e682 to start an election
I20260709 12:27:15.009212 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:15.044644 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.025437 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.028918 22147 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:15.029197 22068 raft_consensus.cc:2368] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 5.
I20260709 12:27:15.044745 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.029516 22141 raft_consensus.cc:1240] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:15.009285 24381 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:15.016763 24562 raft_consensus.cc:697] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:15.031872 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.040436 22185 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:15.027573 22037 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:14.987464 24437 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:15.042127 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:14.987272 24444 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:15.046427 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.046942 22146 raft_consensus.cc:2410] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:15.055539 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:15.047740 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:14.979099 24545 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:14.989714 24537 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.061266 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.061959 22146 raft_consensus.cc:2393] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:15.062284 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.062913 22147 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:15.049161 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.052929 22140 raft_consensus.cc:2368] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3.
I20260709 12:27:15.026738 24411 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:15.060004 24437 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:15.001796 24561 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:15.013172 24393 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.012288 24570 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:27:15.068589 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.078622 22140 raft_consensus.cc:2393] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:15.063753 22070 raft_consensus.cc:2376] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6. Re-sending same reply.
I20260709 12:27:15.081681 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.082379 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:15.082101 24562 consensus_queue.cc:237] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.082942 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.084075 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.084599 22070 raft_consensus.cc:2376] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6. Re-sending same reply.
I20260709 12:27:15.085419 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.089315 24541 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.091871 24545 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:15.092453 24545 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:15.092942 24545 raft_consensus.cc:697] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:15.093930 24536 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:15.093787 24545 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.053617 24274 consensus_queue.cc:237] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:15.095914 24393 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:15.096616 24537 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:15.098500 24561 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:15.099267 22114 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.989s (SENT)
I20260709 12:27:15.099478 24523 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:15.001284 22802 rpcz_store.cc:276] 0709 12:27:10.929558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.031802 (+3102244us) service_pool.cc:224] Handling call
0709 12:27:14.062177 (+ 30375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.095753 (+ 33576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.097906 (+  2153us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.160432 (+ 62526us) log.cc:844] Serialized 26 byte log entry
0709 12:27:14.516136 (+355704us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:14.518825 (+  2689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.567281 (+ 48456us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.889089 (+321808us) raft_consensus.cc:1685] finished
0709 12:27:14.889115 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.889258 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":274,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":15432,"thread_start_us":305673,"threads_started":1,"wal-append.queue_time_us":727078}
I20260709 12:27:15.101392 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:15.101513 24457 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.103150 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:15.104028 24530 log.cc:927] Time spent T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: Append to log took a long time: real 1.797s	user 0.020s	sys 0.004s
I20260709 12:27:15.104595 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.105180 22071 raft_consensus.cc:2376] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6. Re-sending same reply.
I20260709 12:27:15.106058 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.107056 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.080027 24453 consensus_queue.cc:1243] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer 7ff8d9fd78c1454cacc77bbc1bfb992e log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:15.062933 22188 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:15.032428 24553 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5.
I20260709 12:27:15.070432 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:15.068396 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.047746 24381 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:15.051366 24560 raft_consensus.cc:3055] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:15.053416 24388 raft_consensus.cc:1081] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Signalling peer d465f3cb42174eb89615dcd747f9e682 to start an election
W20260709 12:27:15.077059 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 49554.9us
I20260709 12:27:15.061401 24500 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
W20260709 12:27:15.179704 22036 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.579s (SENT) [suppressed 99 similar messages]
I20260709 12:27:15.204766 22143 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:15.300241 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 309332us
I20260709 12:27:15.306723 24560 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:15.307950 24560 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.309299 24560 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:15.148283 22066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1491) took 4268 ms (client timeout 2996 ms). Trace:
W20260709 12:27:15.316963 22066 rpcz_store.cc:269] 0709 12:27:10.879574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.689933 (+2810359us) service_pool.cc:224] Handling call
0709 12:27:15.143859 (+1453926us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54003cb254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:15.148187 (+  4328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195891456}
I20260709 12:27:15.072862 24411 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.107786 22147 raft_consensus.cc:2368] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4.
I20260709 12:27:15.146183 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.322718 22140 raft_consensus.cc:2410] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:15.121685 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.115170 22805 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:15.336217 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.336753 22070 raft_consensus.cc:2376] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4. Re-sending same reply.
I20260709 12:27:15.338541 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.061071 24564 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:15.340683 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:15.341079 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 278227us
I20260709 12:27:15.341578 22806 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:15.146965 22071 raft_consensus.cc:2393] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
W20260709 12:27:15.296154 24569 log.cc:927] Time spent T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 12:27:15.297075 24567 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
I20260709 12:27:15.344214 24573 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:15.362179 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.081440 24571 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:15.351341 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.317960 24420 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:15.359912 22188 leader_election.cc:400] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Vote denied by peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979) with higher term. Message: Invalid argument: T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 5.
I20260709 12:27:15.362425 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:15.363539 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.363731 22221 raft_consensus.cc:1240] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:15.364384 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.408618 22037 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:15.409595 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.411437 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.381078 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.069553 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:15.383343 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.402801 22222 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:15.414731 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.415453 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.416249 22066 raft_consensus.cc:2368] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:15.417125 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.402931 24485 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:15.400184 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:15.417878 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.418776 22806 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.340412 24381 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.412555 22188 leader_election.cc:403] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:15.425851 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 246195us
I20260709 12:27:15.426138 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.413326 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:15.379545 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 339168us
I20260709 12:27:15.419180 22141 raft_consensus.cc:2393] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:15.421152 22037 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:15.421890 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.423290 22147 raft_consensus.cc:2368] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3.
I20260709 12:27:15.429200 22070 raft_consensus.cc:2368] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6.
I20260709 12:27:15.429603 22071 raft_consensus.cc:2393] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:15.427796 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.103219 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:15.430166 22066 raft_consensus.cc:2376] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6. Re-sending same reply.
I20260709 12:27:15.431376 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.432170 22066 raft_consensus.cc:2368] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 7.
I20260709 12:27:15.400980 24536 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.793565 22804 rpcz_store.cc:276] 0709 12:27:10.248615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.903046 (+3654431us) service_pool.cc:224] Handling call
0709 12:27:13.903394 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.903634 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:14.057506 (+153872us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.424440 (+366934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.424502 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:14.424566 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.424642 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.424794 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":137431,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1883,"raft.queue_time_us":131,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":497056,"threads_started":2,"wal-append.queue_time_us":457893}
I20260709 12:27:15.298403 24526 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.443996 22066 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:15.404361 24564 raft_consensus.cc:697] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:15.424750 24385 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:15.456238 22073 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:15.458719 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:15.460616 24572 raft_consensus.cc:3055] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.437472 24515 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:15.465555 22805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 680) took 2548 ms (client timeout 2449 ms). Trace:
I20260709 12:27:15.475251 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 594) took 4614 ms. Trace:
I20260709 12:27:15.464264 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.485044 22142 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:27:15.488229 22142 pending_rounds.cc:85] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 2
I20260709 12:27:15.488489 22142 pending_rounds.cc:107] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 12:27:15.487648 22805 rpcz_store.cc:269] 0709 12:27:12.917371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.035012 (+117641us) service_pool.cc:224] Handling call
0709 12:27:15.465312 (+2430300us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54005528d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:15.465459 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4607037824}
I20260709 12:27:15.485929 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.489120 22073 raft_consensus.cc:2376] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5. Re-sending same reply.
I20260709 12:27:15.489393 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:15.487726 22810 rpcz_store.cc:276] 0709 12:27:10.860850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.987143 (+3126293us) service_pool.cc:224] Handling call
0709 12:27:14.320169 (+333026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.437432 (+117263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.475038 (+1037606us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540054d3d0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:15.475184 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712532352}
W20260709 12:27:15.491998 22145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1626) took 6711 ms (client timeout 2058 ms). Trace:
I20260709 12:27:15.492837 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.493697 22070 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:15.488713 22142 raft_consensus.cc:2889] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:15.434242 22801 raft_consensus.cc:2376] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5. Re-sending same reply.
I20260709 12:27:15.497030 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:15.492449 22145 rpcz_store.cc:269] 0709 12:27:08.773290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.773409 (+   119us) service_pool.cc:224] Handling call
0709 12:27:15.484467 (+6711058us) spinlock_profiling.cc:243] Waited 4.46 s on lock 0x7b5400407754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:15.484602 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10260885760}
I20260709 12:27:15.497968 22776 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:15.504006 22114 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:15.505997 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.498211 22066 raft_consensus.cc:3055] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:15.510041 22066 raft_consensus.cc:740] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:15.512590 22806 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:15.514583 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.516145 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.521467 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:15.523666 22806 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.525100 22071 raft_consensus.cc:1240] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:15.527158 22065 raft_consensus.cc:1240] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:15.487051 24572 raft_consensus.cc:740] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:15.528239 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.527779 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 1995) took 4858 ms. Trace:
I20260709 12:27:15.552933 22065 rpcz_store.cc:276] 0709 12:27:10.669289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.455053 (+3785764us) service_pool.cc:224] Handling call
0709 12:27:15.526500 (+1071447us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800010598. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1eee 000000000036eb39 00007ff1916551e0 00007ff19171e0c4 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:15.526984 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.527551 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.527721 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7141120}
I20260709 12:27:15.447919 24536 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.538750 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:15.555364 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.552489 22073 raft_consensus.cc:2376] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4. Re-sending same reply.
I20260709 12:27:15.558141 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.558770 22073 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:15.559893 22072 raft_consensus.cc:2393] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:15.554214 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.562273 22810 raft_consensus.cc:2393] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:15.507218 24388 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:15.566088 22806 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:15.564141 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.513680 24175 raft_consensus.cc:2804] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:15.516634 24574 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:15.588152 22810 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:15.589079 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 667) took 1865 ms. Trace:
I20260709 12:27:15.589504 22810 rpcz_store.cc:276] 0709 12:27:13.723446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.563015 (+1839569us) service_pool.cc:224] Handling call
0709 12:27:15.587958 (+ 24943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.588792 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.589012 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:15.591331 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.591686 22140 raft_consensus.cc:2410] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:15.592999 22144 raft_consensus.cc:2368] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:15.594331 22072 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:15.555907 24457 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:15.527771 24418 consensus_queue.cc:1059] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:27:15.599530 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.523769 24487 consensus_queue.cc:1059] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:27:15.523492 24523 consensus_queue.cc:1059] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:27:15.596415 24420 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:15.592463 24549 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:15.527933 24535 consensus_queue.cc:1059] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:27:15.604951 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.607913 22810 raft_consensus.cc:1240] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:15.599018 24438 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:27:15.573711 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:15.584005 24175 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:15.574581 24437 consensus_queue.cc:1059] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:27:15.623730 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.625550 22141 raft_consensus.cc:2410] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:15.629559 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:15.631491 22185 connection.cc:256] RPC call timeout handler was delayed by -1.2635000559998844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 12:27:15.633072 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.634105 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:15.633627 22148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1647) took 2906 ms (client timeout 1614 ms). Trace:
W20260709 12:27:15.634660 22148 rpcz_store.cc:269] 0709 12:27:12.721557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.721801 (+   244us) service_pool.cc:224] Handling call
0709 12:27:15.627545 (+2905744us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54002247d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:15.627702 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050625280}
I20260709 12:27:15.640517 22221 raft_consensus.cc:1240] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:15.642009 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.645247 22221 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:15.652604 22222 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:15.652390 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.650130 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.655009 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.657231 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:15.663321 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 140425us
I20260709 12:27:15.663882 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.664566 22222 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:15.664866 22112 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:15.665566 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:15.673009 22221 raft_consensus.cc:2393] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:15.624809 24175 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:15.677929 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.684612 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:15.685381 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.685307 22222 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.686527 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.687323 22067 raft_consensus.cc:2393] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:15.688233 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.689067 22073 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:15.689631 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.690825 22220 raft_consensus.cc:1240] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:15.630235 24420 raft_consensus.cc:3055] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:15.684680 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:15.705049 22216 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:15.696517 24575 log.cc:927] Time spent T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:27:15.703593 22036 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:15.696451 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.696815 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:15.706660 22219 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.706921 22148 raft_consensus.cc:2410] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:15.697352 22114 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:15.707734 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.698858 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.708289 22114 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:15.708702 22141 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.597299 24564 consensus_queue.cc:237] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:15.696300 24553 consensus_queue.cc:1059] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:27:15.701385 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.713424 22221 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
W20260709 12:27:15.714202 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 354461us
W20260709 12:27:15.701669 24566 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.749s	user 0.000s	sys 0.011s
I20260709 12:27:15.724808 22222 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:15.693387 22112 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:15.633616 24418 raft_consensus.cc:3055] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:15.710376 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:15.710376 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.701912 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:15.704941 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.718118 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:15.720157 24576 log.cc:927] Time spent T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:27:15.617107 24572 consensus_queue.cc:260] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.719285 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:15.706353 24482 consensus_meta.cc:287] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.807s	user 0.006s	sys 0.004s
I20260709 12:27:15.706804 24535 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:15.731216 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.744426 22036 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:15.748018 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.755491 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.731850 22221 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:15.787295 22188 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:15.804514 22185 leader_election.cc:336] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.614s (SENT)
I20260709 12:27:15.925931 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.703037 24420 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:15.940721 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:15.941557 22808 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:15.939229 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.942106 22073 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:15.942981 22185 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:15.942261 22222 raft_consensus.cc:2393] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:15.944442 22216 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 11.
I20260709 12:27:15.724660 24520 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:15.711301 24388 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:15.946631 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 159414us
I20260709 12:27:15.964426 22188 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:15.965920 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.716136 24526 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:15.958381 24411 consensus_meta.cc:287] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.000s
I20260709 12:27:15.949683 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.744952 24418 raft_consensus.cc:740] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:15.949995 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:15.950553 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 206192us
W20260709 12:27:15.951624 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 147173us
I20260709 12:27:15.952813 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:15.953958 24595 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:15.958895 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:15.960872 24592 raft_consensus.cc:3055] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:15.961501 22773 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:15.716693 24515 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.252s
I20260709 12:27:15.966683 22216 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
W20260709 12:27:15.979938 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.932418 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 246208us
I20260709 12:27:15.979645 24411 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.933168 24393 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:15.975301 22141 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:16.064877 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 520) took 1050 ms. Trace:
I20260709 12:27:16.065282 22141 rpcz_store.cc:276] 0709 12:27:15.014389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.644390 (+630001us) service_pool.cc:224] Handling call
0709 12:27:16.064815 (+420425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:15.981244 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:15.976572 22775 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:15.977604 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 284301us
I20260709 12:27:16.004751 22144 raft_consensus.cc:2376] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3. Re-sending same reply.
I20260709 12:27:16.007274 22221 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:15.982721 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:15.962330 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 249734us
I20260709 12:27:15.958791 24582 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:16.002328 24553 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:16.068256 24553 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.967851 24572 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.069800 24437 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:16.070351 24553 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:16.003397 24545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.026s	sys 0.046s
W20260709 12:27:16.071410 24545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.026s	sys 0.047s
I20260709 12:27:16.067533 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:16.040799 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.072373 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.002077 24541 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.072811 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2013) took 3096 ms. Trace:
I20260709 12:27:16.071775 22036 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:16.072386 22148 raft_consensus.cc:2393] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 6: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:16.075537 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:16.075976 22148 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:16.075045 24515 raft_consensus.cc:2804] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:16.077345 22148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 523) took 1050 ms. Trace:
I20260709 12:27:16.077787 24515 raft_consensus.cc:697] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.077852 22148 rpcz_store.cc:276] 0709 12:27:15.027144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.075534 (+1048390us) service_pool.cc:224] Handling call
0709 12:27:16.075804 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.076754 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.077265 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:16.078907 24515 consensus_queue.cc:237] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:15.949229 24573 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:16.082823 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:16.083554 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:16.083490 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2180) took 6171 ms. Trace:
I20260709 12:27:15.724455 24568 consensus_queue.cc:1059] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.286s
I20260709 12:27:16.073174 22071 rpcz_store.cc:276] 0709 12:27:12.975968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.440201 (+2464233us) service_pool.cc:224] Handling call
0709 12:27:15.440474 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.525551 (+ 85077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.072590 (+547039us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54000d5a54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:16.072758 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194070272}
I20260709 12:27:16.071765 22037 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:16.066329 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:16.090540 22071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7"
dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
 from {username='slave'} at 127.0.0.1:45000
I20260709 12:27:16.091161 22071 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.091475 22071 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:16.091692 22141 raft_consensus.cc:1240] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:27:16.069813 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.086567 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 1.23765e+06us
I20260709 12:27:16.084369 22142 rpcz_store.cc:276] 0709 12:27:09.912536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.937255 (+ 24719us) service_pool.cc:224] Handling call
0709 12:27:15.484702 (+5547447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.514083 (+ 29381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.083217 (+569134us) spinlock_profiling.cc:243] Waited 5.54 s on lock 0x7b5400407750. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:16.083376 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12731053312}
I20260709 12:27:16.095577 22142 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:27:16.095923 22142 pending_rounds.cc:85] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 5
I20260709 12:27:16.096122 22142 pending_rounds.cc:107] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:27:16.096330 22142 raft_consensus.cc:2889] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:16.084179 22072 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:16.093859 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.005859 24520 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:16.113484 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:16.116605 22065 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.005999 24592 raft_consensus.cc:740] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:15.963182 24487 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 12:27:16.114898 22139 raft_consensus.cc:2393] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:16.117654 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.118943 22114 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:16.064618 24536 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:16.115010 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 539) took 1009 ms. Trace:
I20260709 12:27:16.122134 22142 rpcz_store.cc:276] 0709 12:27:15.106016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.095011 (+988995us) service_pool.cc:224] Handling call
0709 12:27:16.095265 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.111347 (+ 16082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.114949 (+  3602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:16.123508 22142 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:16.124010 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 540) took 1017 ms. Trace:
I20260709 12:27:16.124298 22142 rpcz_store.cc:276] 0709 12:27:15.106277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.122919 (+1016642us) service_pool.cc:224] Handling call
0709 12:27:16.123199 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.123794 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.123960 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:16.126412 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.129261 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.131139 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:16.104084 24458 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:16.132074 22221 raft_consensus.cc:2393] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:16.128919 24393 consensus_queue.cc:1059] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:27:16.133500 24393 consensus_queue.cc:1243] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer ecc1814bfd604baa9cc66be8c02c5cfa log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:27:16.134075 24393 consensus_queue.cc:1059] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:16.134763 24393 consensus_queue.cc:1243] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer ecc1814bfd604baa9cc66be8c02c5cfa log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:27:16.093933 24452 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.144199 22220 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:27:16.142730 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.145917 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.132783 24553 consensus_queue.cc:1059] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:27:16.128664 24418 consensus_queue.cc:260] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.156420 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.156978 24418 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:15.968613 24596 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:16.129036 24482 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:16.089485 24593 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.128880 24520 raft_consensus.cc:697] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:16.115269 24570 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:27:16.158553 24381 consensus_meta.cc:287] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.001s
I20260709 12:27:16.095194 24420 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.173265 24482 raft_consensus.cc:697] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:16.158756 24599 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:16.159922 24452 raft_consensus.cc:3055] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:16.114838 24385 consensus_queue.cc:1059] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:27:16.140193 24444 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:16.174953 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.185256 22216 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:16.178666 24520 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.179468 24536 consensus_queue.cc:1059] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:16.182416 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.184336 22219 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:27:16.186918 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 208420us
I20260709 12:27:16.190348 22775 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:16.183221 24599 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.183037 24452 raft_consensus.cc:740] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:16.189540 24574 consensus_meta.cc:287] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.004s
I20260709 12:27:16.185009 24592 consensus_queue.cc:260] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.199337 24487 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:16.207193 24411 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:16.199460 24599 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.216890 24482 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.215641 24574 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979) with higher term. Message: Invalid argument: T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 5.
I20260709 12:27:16.200491 24458 raft_consensus.cc:697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.219246 24458 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.221616 24452 consensus_queue.cc:260] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.181018 24381 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.225091 24381 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:16.207861 24501 consensus_meta.cc:287] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 1.159s	user 0.007s	sys 0.004s
I20260709 12:27:16.227654 24501 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:16.229282 24560 consensus_meta.cc:287] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.920s	user 0.012s	sys 0.001s
I20260709 12:27:16.229429 24599 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.231858 24599 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.166393 22065 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:16.276958 21970 catalog_manager.cc:5697] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 3 to 5, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 5 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:16.280377 22067 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:16.282346 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44992 (request call id 1500) took 3270 ms. Trace:
I20260709 12:27:16.282967 22070 rpcz_store.cc:276] 0709 12:27:13.011895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.442980 (+2431085us) service_pool.cc:224] Handling call
0709 12:27:15.443236 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.507983 (+ 64747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.281769 (+773786us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b54000d5f54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:16.282103 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115533568}
I20260709 12:27:16.285238 22070 raft_consensus.cc:1240] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.293463 21968 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38180 (request call id 208) took 8793 ms. Trace:
I20260709 12:27:16.296283 21970 catalog_manager.cc:5697] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 1 to 2, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 2 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:16.301081 22066 consensus_queue.cc:260] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.303579 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:16.304657 22072 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:16.305354 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 513) took 1294 ms. Trace:
I20260709 12:27:16.305884 22139 rpcz_store.cc:276] 0709 12:27:15.010929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.011054 (+   125us) service_pool.cc:224] Handling call
0709 12:27:16.304773 (+1293719us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400128754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:16.305064 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2508644736}
I20260709 12:27:16.307861 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:16.308964 22139 raft_consensus.cc:2393] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:16.303579 22073 raft_consensus.cc:1275] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:16.310024 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:16.309438 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:16.310853 22139 raft_consensus.cc:1275] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:16.310882 22068 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.317595 22145 raft_consensus.cc:1240] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.318202 22222 raft_consensus.cc:1240] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.320986 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 516) took 1307 ms. Trace:
I20260709 12:27:16.321516 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 449) took 1866 ms. Trace:
I20260709 12:27:16.322031 22213 rpcz_store.cc:276] 0709 12:27:14.455015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.455129 (+   114us) service_pool.cc:224] Handling call
0709 12:27:14.455382 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.079609 (+624227us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:15.507358 (+427749us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.946396 (+439038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:15.946462 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:15.946509 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.321083 (+374574us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54001f4d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:16.321138 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.321311 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1099,"prepare.queue_time_us":511193,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":2001,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4918,"spinlock_wait_cycles":1435112192,"thread_start_us":837714,"threads_started":2,"wal-append.queue_time_us":597976}
I20260709 12:27:16.324712 22141 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:27:16.324944 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:16.325532 22141 pending_rounds.cc:85] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 5
I20260709 12:27:16.325881 22141 pending_rounds.cc:107] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:27:16.326159 22141 raft_consensus.cc:2889] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:16.326690 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:16.327736 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 538) took 1222 ms. Trace:
I20260709 12:27:16.328114 22141 rpcz_store.cc:276] 0709 12:27:15.105760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.092515 (+986755us) service_pool.cc:224] Handling call
0709 12:27:16.323821 (+231306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.326801 (+  2980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.327486 (+   685us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540013db50. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:16.327664 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531076480}
I20260709 12:27:16.325312 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:16.328896 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.330225 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.321388 22143 rpcz_store.cc:276] 0709 12:27:15.013385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.014351 (+   966us) service_pool.cc:224] Handling call
0709 12:27:15.014669 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.300271 (+285602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.320487 (+1020216us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400057154. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:16.320795 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436727680}
I20260709 12:27:16.331702 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:16.332464 22219 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.323506 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:16.323413 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 532) took 1219 ms. Trace:
I20260709 12:27:16.335068 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.334992 22140 rpcz_store.cc:276] 0709 12:27:15.103890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.411182 (+307292us) service_pool.cc:224] Handling call
0709 12:27:16.322937 (+911755us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540013db54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:16.323210 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412333824}
I20260709 12:27:16.337237 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.340142 22114 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:16.340359 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:16.341157 22218 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:16.341646 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.343634 22146 raft_consensus.cc:1240] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.344497 22222 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:16.346272 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:16.347081 22214 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.347334 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:16.349417 22146 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:16.346392 22147 raft_consensus.cc:1240] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.351092 22143 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:16.352110 22220 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:16.352730 22140 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:16.343528 22221 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:16.355849 22185 leader_election.cc:400] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:16.376719 22185 leader_election.cc:403] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:16.357533 22141 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:16.312321 21970 catalog_manager.cc:5697] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 2 to 3, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
W20260709 12:27:16.362172 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.362663 22139 raft_consensus.cc:1275] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:16.191504 24388 raft_consensus.cc:697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:16.367132 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.367975 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 170071us
I20260709 12:27:16.369429 24457 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.368973 24553 consensus_queue.cc:1059] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:16.373219 24573 raft_consensus.cc:1064] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:27:16.301977 22071 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.431926 22219 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:16.433636 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 92432.2us
I20260709 12:27:16.435775 22114 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:16.441126 24573 consensus_queue.cc:237] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.368904 24411 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:16.423979 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 302136us
I20260709 12:27:16.459385 24599 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.459208 24388 consensus_queue.cc:237] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.460078 24599 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.462203 24599 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:16.462828 24564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.009s	sys 0.012s
W20260709 12:27:16.463315 24564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.009s	sys 0.012s
I20260709 12:27:16.368904 24385 consensus_queue.cc:1059] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 12:27:16.437255 24593 consensus_queue.cc:1059] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:27:16.526758 24593 raft_consensus.cc:3055] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:16.527063 22143 raft_consensus.cc:1240] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.519237 24388 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:16.528784 22143 raft_consensus.cc:1240] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.528901 24388 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.512859 24457 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.520946 22144 raft_consensus.cc:1240] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.521250 24553 consensus_queue.cc:1059] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:16.531922 24553 raft_consensus.cc:3055] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:16.522784 24570 consensus_queue.cc:1059] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:16.523130 22809 raft_consensus.cc:1240] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:16.511968 24411 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.513309 24623 consensus_queue.cc:1059] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 12:27:16.525012 24175 consensus_meta.cc:287] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.008s
I20260709 12:27:16.529528 22066 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.464581 22215 raft_consensus.cc:1240] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.463331 22140 raft_consensus.cc:1240] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:16.477507 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 122097us
I20260709 12:27:16.496335 22071 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 12 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.464358 22807 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:27:16.543340 22146 raft_consensus.cc:1240] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:27:16.512458 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:16.524132 24607 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:16.514711 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:16.529579 24388 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.542776 22807 pending_rounds.cc:85] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting all ops after (but not including) 5
W20260709 12:27:16.552064 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 116636us
I20260709 12:27:16.551174 24623 consensus_queue.cc:1243] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer d465f3cb42174eb89615dcd747f9e682 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:27:16.532374 24553 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.533260 24593 raft_consensus.cc:740] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:16.562731 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.562335 24553 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.563313 24623 raft_consensus.cc:3055] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:16.565023 24418 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.565773 24411 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:16.583863 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 69416.3us
I20260709 12:27:16.583449 24593 consensus_queue.cc:260] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.585551 24593 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.585613 24515 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:16.586135 24515 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:16.586638 24515 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:16.586740 24553 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.553208 24175 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.588909 22810 raft_consensus.cc:1240] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.589998 22218 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:16.590008 24175 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:16.592047 22808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 612) took 2503 ms (client timeout 1838 ms). Trace:
W20260709 12:27:16.592468 22808 rpcz_store.cc:269] 0709 12:27:14.088996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.590924 (+501928us) service_pool.cc:224] Handling call
0709 12:27:16.591636 (+2000712us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400570154. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:16.591833 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2513999232}
I20260709 12:27:16.593653 24418 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.595974 22066 raft_consensus.cc:1275] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:27:16.578997 24623 raft_consensus.cc:740] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:16.514884 24487 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:27:16.597400 24623 consensus_queue.cc:260] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.565785 24453 raft_consensus.cc:3055] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:16.556111 22807 pending_rounds.cc:107] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 12:27:16.599331 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43891.7us
I20260709 12:27:16.602945 22146 raft_consensus.cc:1275] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:16.565743 22773 connection.cc:256] RPC call timeout handler was delayed by -1.1261668030001601s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3205s for a response
I20260709 12:27:16.596045 24457 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:16.600469 24453 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.611928 24453 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.621232 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:16.617390 22113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.620576 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:16.585861 22038 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:16.634964 22214 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:16.600642 22066 pending_rounds.cc:85] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: Aborting all ops after (but not including) 2
I20260709 12:27:16.636546 22066 pending_rounds.cc:107] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:27:16.636823 22066 raft_consensus.cc:2889] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:16.620860 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:16.644605 22773 connection.cc:256] RPC call timeout handler was delayed by -1.0556665479998628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 12:27:16.642906 22222 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:16.624779 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:16.651662 22068 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:16.613597 24453 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.572150 24607 raft_consensus.cc:697] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:16.655977 24623 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.648370 24382 raft_consensus.cc:3055] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:16.618836 24535 raft_consensus.cc:697] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:16.596048 24418 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:16.613652 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 675) took 3726 ms. Trace:
W20260709 12:27:16.658900 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 73248.6us
I20260709 12:27:16.659109 24553 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.294049 21968 rpcz_store.cc:276] 0709 12:27:07.500493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.522759 (+ 22266us) service_pool.cc:224] Handling call
0709 12:27:16.293124 (+8770365us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:12.286945 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:12.287733 (+   788us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:12.287786 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:27:12.287826 (+    40us) tablet.cc:662] Decoding operations
0709 12:27:12.288952 (+  1126us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:12.289052 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:12.289090 (+    38us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:27:12.290006 (+   916us) tablet.cc:701] Row locks acquired
0709 12:27:12.290059 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:27:12.290256 (+   197us) write_op.cc:270] Start()
0709 12:27:12.290419 (+   163us) write_op.cc:276] Timestamp: P: 1783600032290179 usec, L: 0
0709 12:27:12.290441 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:27:12.291226 (+   785us) log.cc:844] Serialized 3597 byte log entry
0709 12:27:12.677351 (+386125us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff1895fc0ac 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b
0709 12:27:15.079768 (+2402417us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:15.491555 (+411787us) op_driver.cc:464] REPLICATION: finished
0709 12:27:15.928877 (+437322us) write_op.cc:301] APPLY: starting
0709 12:27:15.928983 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:15.929252 (+   269us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:15.929291 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:15.930665 (+  1374us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:15.931096 (+   431us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:27:15.931147 (+    51us) write_op.cc:312] APPLY: finished
0709 12:27:15.931527 (+   380us) log.cc:844] Serialized 71 byte log entry
0709 12:27:15.931721 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:15.931851 (+   130us) write_op.cc:454] Released schema lock
0709 12:27:15.931914 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:16.088561 (+156647us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:16.095674 (+  7113us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":2176,"child_traces":[["op",{"apply.queue_time_us":422529,"apply.run_cpu_time_us":3629,"apply.run_wall_time_us":50724,"num_ops":9,"prepare.queue_time_us":1207602,"prepare.run_cpu_time_us":56155,"prepare.run_wall_time_us":1468617,"raft.queue_time_us":309122,"raft.run_cpu_time_us":34252,"raft.run_wall_time_us":505060,"replication_time_us":3150660,"spinlock_wait_cycles":204089472,"thread_start_us":2823851,"threads_started":4,"wal-append.queue_time_us":741717}]]}
I20260709 12:27:16.601365 22807 raft_consensus.cc:2889] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:16.665218 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:16.666911 22143 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:16.667539 22146 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:16.671706 24382 raft_consensus.cc:740] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.675422 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49866 (request call id 517) took 1025 ms. Trace:
I20260709 12:27:16.688345 22143 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:16.689007 22067 rpcz_store.cc:276] 0709 12:27:15.649962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.704403 (+ 54441us) service_pool.cc:224] Handling call
0709 12:27:16.675174 (+970771us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b5400265554. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:16.675321 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196751232}
I20260709 12:27:16.692533 22145 raft_consensus.cc:1240] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:16.693881 24501 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:16.695662 22038 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:16.696762 22218 raft_consensus.cc:2393] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:16.697445 22038 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:16.677534 24457 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:16.698458 22143 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.679857 22801 rpcz_store.cc:276] 0709 12:27:12.886687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.557447 (+2670760us) service_pool.cc:224] Handling call
0709 12:27:16.610532 (+1053085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.611138 (+   606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.611176 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.611240 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:16.611299 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.611379 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.613295 (+  1916us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400570150. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:16.613464 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7718,"raft.run_cpu_time_us":540,"raft.run_wall_time_us":540,"spinlock_wait_cycles":2311003520}
I20260709 12:27:16.698606 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 669) took 2953 ms. Trace:
I20260709 12:27:16.709462 22806 rpcz_store.cc:276] 0709 12:27:13.736391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.574469 (+1838078us) service_pool.cc:224] Handling call
0709 12:27:16.669856 (+1095387us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:16.670209 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.670539 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.670565 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.677274 (+  6709us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:16.687794 (+ 10520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.687856 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.689812 (+  1956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21685504}
I20260709 12:27:16.698540 22113 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:16.711383 24607 consensus_queue.cc:237] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.701085 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:16.713649 22146 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:16.714669 24611 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:16.714890 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:16.705381 24515 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.716969 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:16.718678 24572 raft_consensus.cc:3055] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:16.705896 24615 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:16.719602 24615 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:16.719985 24615 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.720271 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2308) took 1082 ms. Trace:
I20260709 12:27:16.720636 22215 rpcz_store.cc:276] 0709 12:27:15.637479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.684760 (+ 47281us) service_pool.cc:224] Handling call
0709 12:27:15.685041 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.553612 (+868571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.719999 (+166387us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54001f5254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:16.720210 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791610624}
I20260709 12:27:16.699159 24457 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.725119 24457 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:16.725502 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.649s (SENT)
I20260709 12:27:16.705641 24553 consensus_queue.cc:1059] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:27:16.726111 22188 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:16.727721 24582 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.728092 24532 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:16.728765 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.729206 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.729437 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:16.730304 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 617) took 1029 ms. Trace:
I20260709 12:27:16.730649 22804 rpcz_store.cc:276] 0709 12:27:15.701194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.728957 (+1027763us) service_pool.cc:224] Handling call
0709 12:27:16.730228 (+  1271us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:16.731011 22188 leader_election.cc:336] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.707s (SENT)
I20260709 12:27:16.732043 24515 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.719146 24572 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.733690 24572 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.699985 24619 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.701237 22143 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:27:16.702215 24382 consensus_queue.cc:260] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.739087 24572 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.742619 24619 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:16.744033 24512 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:27:16.748632 24458 raft_consensus.cc:3055] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:16.749105 24458 raft_consensus.cc:740] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.714685 24589 raft_consensus.cc:3055] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:16.750783 24589 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:16.751199 24515 consensus_queue.cc:1059] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:16.752887 24393 consensus_queue.cc:1059] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:16.703752 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 521) took 1684 ms. Trace:
I20260709 12:27:16.753800 22144 rpcz_store.cc:276] 0709 12:27:15.019053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.070947 (+1051894us) service_pool.cc:224] Handling call
0709 12:27:16.071269 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.530519 (+459250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.703366 (+172847us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001397d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:16.703665 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033260288}
I20260709 12:27:16.754446 24570 consensus_queue.cc:1059] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:16.755198 24584 consensus_queue.cc:1059] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:16.755774 24570 raft_consensus.cc:3055] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:16.756374 24570 raft_consensus.cc:740] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.756999 24456 raft_consensus.cc:3055] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:16.752167 24515 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:27:16.757479 24456 raft_consensus.cc:740] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.751953 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 616) took 1277 ms. Trace:
I20260709 12:27:16.735664 24595 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.760061 24393 raft_consensus.cc:3055] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:16.759805 24595 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.760486 24393 raft_consensus.cc:740] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.744160 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:16.761461 24393 consensus_queue.cc:260] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.762647 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:16.763823 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:16.764531 22147 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:16.763695 24619 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.766674 24452 raft_consensus.cc:3060] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.758240 22810 rpcz_store.cc:276] 0709 12:27:15.474675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.619216 (+144541us) service_pool.cc:224] Handling call
0709 12:27:15.619556 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.589347 (+969791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.751633 (+162286us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54006c1bd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:16.751870 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228309248}
I20260709 12:27:16.768678 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:16.769296 22144 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:16.770149 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:16.752027 24589 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.772064 24589 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.772508 24615 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.773309 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2195) took 1289 ms. Trace:
I20260709 12:27:16.773650 22145 rpcz_store.cc:276] 0709 12:27:15.484227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.336123 (+851896us) service_pool.cc:224] Handling call
0709 12:27:16.336525 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.693180 (+356655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.773038 (+ 79858us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54000023d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:16.773226 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784529792}
I20260709 12:27:16.758627 24456 consensus_queue.cc:260] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.775571 22140 raft_consensus.cc:1240] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:16.775978 24456 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.777370 22143 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 12.
I20260709 12:27:16.778568 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:16.779271 22143 raft_consensus.cc:2376] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6. Re-sending same reply.
W20260709 12:27:16.780707 22188 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.794s (SENT)
I20260709 12:27:16.780901 24420 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:16.781937 22188 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.795s (SENT)
I20260709 12:27:16.776268 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2213) took 1076 ms. Trace:
I20260709 12:27:16.783280 22140 rpcz_store.cc:276] 0709 12:27:15.699353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.538199 (+838846us) service_pool.cc:224] Handling call
0709 12:27:16.655125 (+116926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.776017 (+120892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.776206 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:16.708899 24535 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.765491 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:16.789561 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44992 (request call id 1511) took 1716 ms. Trace:
W20260709 12:27:16.791338 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.806s (SENT)
I20260709 12:27:16.790117 22066 rpcz_store.cc:276] 0709 12:27:14.973510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.444739 (+471229us) service_pool.cc:224] Handling call
0709 12:27:15.444974 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.299872 (+854898us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b4c001b75c0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18a9d2a20 00007ff18a9e3a29 00007ff18a9a9644 00007ff18a9d0f2d 00007ff18a9d0b93 00007ff18c70118b 00007ff18c701cb5 00007ff18c6fcf30 00007ff18c6fe7de 00007ff18c708b49 00007ff18c709416
0709 12:27:16.686682 (+386810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.690098 (+  3416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12845824}
I20260709 12:27:16.795814 22188 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:16.793381 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:16.794291 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 59928.7us
I20260709 12:27:16.794728 22185 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:16.750095 24458 consensus_queue.cc:260] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.787781 24615 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.805629 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:16.795770 24593 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:16.831619 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 45852.8us
W20260709 12:27:16.833705 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 147365us
I20260709 12:27:16.829274 24438 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.836215 24438 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.813887 24393 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:16.838042 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 121207us
I20260709 12:27:16.840750 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:16.843402 22148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 524) took 1752 ms. Trace:
I20260709 12:27:16.845835 24568 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:16.845490 24596 raft_consensus.cc:3055] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:16.844995 22036 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:16.844533 24549 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:16.847711 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.847654 22139 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:16.846724 24437 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.850456 22147 raft_consensus.cc:2368] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4.
I20260709 12:27:16.846521 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:16.861370 24582 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.863955 22139 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:16.864645 24595 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.864967 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:16.865767 22807 raft_consensus.cc:2376] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4. Re-sending same reply.
I20260709 12:27:16.865790 24253 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.867151 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:16.867045 24253 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.867841 22803 raft_consensus.cc:2376] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3. Re-sending same reply.
I20260709 12:27:16.868844 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:16.869040 24586 raft_consensus.cc:3055] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:16.856098 22144 raft_consensus.cc:1275] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:16.869526 24586 raft_consensus.cc:740] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:16.856393 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:16.870460 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:16.857056 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:16.872522 24592 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.873528 22806 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:27:16.857434 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.874732 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.857270 24437 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.875612 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:16.876072 24457 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.876472 22804 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:16.858067 22810 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.876641 24457 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.858413 24560 raft_consensus.cc:3055] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:16.857101 24438 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.850258 24593 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.878903 24560 raft_consensus.cc:740] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.880007 24560 consensus_queue.cc:260] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.880681 24593 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:16.881106 22114 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:16.849639 24596 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:16.882814 24388 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.884584 24537 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:16.885217 24537 raft_consensus.cc:697] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:16.885419 24388 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:16.872674 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:16.861004 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 69733.2us
I20260709 12:27:16.886606 22801 raft_consensus.cc:2376] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4. Re-sending same reply.
I20260709 12:27:16.871274 22802 raft_consensus.cc:2376] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3. Re-sending same reply.
I20260709 12:27:16.869396 24253 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:16.871341 24382 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.843885 22148 rpcz_store.cc:276] 0709 12:27:15.042786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.079930 (+1037144us) service_pool.cc:224] Handling call
0709 12:27:16.080266 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.080630 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.080655 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.081131 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:27:16.314151 (+233020us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:16.434360 (+120209us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.782871 (+348511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.795299 (+ 12428us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.795357 (+    58us) raft_consensus.cc:1685] finished
0709 12:27:16.795369 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.795523 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161787,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":80933,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"thread_start_us":686977,"threads_started":3,"wal-append.queue_time_us":127480}
I20260709 12:27:16.852633 22140 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:16.860160 24501 consensus_queue.cc:1048] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:16.865324 22139 raft_consensus.cc:1240] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:16.899622 24526 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:16.900094 24526 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.900476 24526 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.900593 22809 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:16.901038 24500 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:16.901149 24582 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:16.902582 24500 consensus_queue.cc:1048] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:16.893497 22776 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:16.904855 22145 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:16.891713 22810 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
W20260709 12:27:16.886806 22188 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.810s (SENT)
W20260709 12:27:16.895762 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 106470us
W20260709 12:27:16.896150 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.914948 24274 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:27:16.915015 22808 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:16.888653 22773 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:16.910257 24549 consensus_queue.cc:1048] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:27:16.919400 24595 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:16.920053 24595 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.920806 24570 consensus_queue.cc:260] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.922230 24595 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:16.934547 22808 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:16.934738 22188 leader_election.cc:336] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.828s (SENT)
I20260709 12:27:16.937168 22809 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:27:16.935928 22036 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:16.949862 22809 pending_rounds.cc:85] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting all ops after (but not including) 5
I20260709 12:27:16.950177 22809 pending_rounds.cc:107] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:27:16.923802 24537 consensus_queue.cc:237] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:16.951799 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:16.929129 24570 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.931492 22805 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:27:16.932219 22142 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:16.934090 22037 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:16.876734 24437 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:16.950407 22809 raft_consensus.cc:2889] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:16.937510 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:16.985021 24593 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:17.032387 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1659) took 1604 ms. Trace:
I20260709 12:27:16.943102 24596 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:16.903239 24582 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 12:27:16.937232 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:16.947300 22148 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:16.938198 22220 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:16.946233 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:16.944381 22221 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:16.948115 22072 raft_consensus.cc:1240] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:16.941483 22801 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:16.938273 24456 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.944293 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:16.995222 22188 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:17.040148 22113 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.046578 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:17.047233 22064 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:17.048516 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 112678us
I20260709 12:27:17.032863 22142 rpcz_store.cc:276] 0709 12:27:15.428220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.131969 (+703749us) service_pool.cc:224] Handling call
0709 12:27:16.132307 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.843937 (+711630us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54004031a0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c67ddc0 00007ff18c7081c0 00007ff18c709231 00007ff18c705d8f 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c
0709 12:27:17.031917 (+187980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.032216 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413931264}
I20260709 12:27:16.908419 24457 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:17.061326 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 127269us
I20260709 12:27:17.039098 24456 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:17.080356 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.935407 22807 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:17.050117 24595 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:17.063935 24458 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:17.086485 22810 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:16.870651 24586 consensus_queue.cc:260] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.095243 22072 raft_consensus.cc:1240] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:17.082006 24453 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:27:17.099794 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.059217 24385 consensus_queue.cc:1059] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:27:17.101233 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 207951us
I20260709 12:27:17.102839 24627 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:17.096740 24437 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.107285 24453 raft_consensus.cc:697] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:17.107515 24634 log.cc:927] Time spent T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:27:17.100937 22186 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:17.111058 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 222555us
I20260709 12:27:17.115051 24631 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:17.108054 24572 consensus_queue.cc:1059] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.094835 24560 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:17.120221 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 422860us
W20260709 12:27:17.125694 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 229019us
I20260709 12:27:17.141252 22146 raft_consensus.cc:2410] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:17.141657 22142 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:17.143584 22776 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.122531 24549 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:27:17.147324 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:17.147643 24632 log.cc:927] Time spent T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:27:17.148964 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 214244us
I20260709 12:27:17.121061 24385 consensus_queue.cc:1243] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:27:17.108824 24615 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:27:17.096452 24500 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:27:17.159114 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 118471us
I20260709 12:27:17.163329 22038 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.140425 24586 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:17.173519 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.188016 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.126224 24437 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:17.176623 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45486.3us
I20260709 12:27:17.179296 24583 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:17.179509 24456 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:17.123306 24515 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:27:17.184046 22113 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:17.185725 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.831s (SENT)
I20260709 12:27:17.161201 22773 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.144476 24631 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 12 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:17.196182 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:17.128897 24501 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:27:17.206573 22073 raft_consensus.cc:2410] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:17.139304 24453 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.186271 24593 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:17.200834 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:17.215914 22186 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:17.194494 24619 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:17.229173 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 65937.9us
W20260709 12:27:17.230130 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 46182.6us
I20260709 12:27:17.196792 24535 consensus_queue.cc:1059] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:17.208654 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:17.233481 22072 raft_consensus.cc:2410] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:17.243345 24532 raft_consensus.cc:3055] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.243916 24532 raft_consensus.cc:740] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:17.246131 24523 consensus_queue.cc:1059] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:27:17.247154 24523 raft_consensus.cc:3055] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:17.247498 24523 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:17.248565 24571 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:27:17.244987 24532 consensus_queue.cc:260] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:17.251029 24452 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:17.254415 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 112818us
W20260709 12:27:17.258948 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 92388.1us
I20260709 12:27:17.218173 24512 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:17.282852 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.249668 24631 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:17.220723 24583 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:17.207165 24500 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:27:17.237936 24627 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:17.305202 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.314791 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.208379 24438 consensus_queue.cc:1059] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:27:17.236552 24595 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:17.333703 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.858s (SENT)
I20260709 12:27:17.334177 22188 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:17.327114 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 118406us
W20260709 12:27:17.336273 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.316176 24623 raft_consensus.cc:3055] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:17.336625 22113 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.327908 24627 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:17.355096 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 148045us
I20260709 12:27:17.356886 24526 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:17.358155 22067 raft_consensus.cc:2393] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:17.359941 24526 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:17.361690 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:17.330957 24582 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:17.352995 24393 consensus_meta.cc:287] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.001s
I20260709 12:27:17.321617 24452 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.340229 24623 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:17.364095 24627 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:17.370147 24607 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:17.376302 22807 raft_consensus.cc:2410] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:27:17.401788 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 65099.6us
I20260709 12:27:17.374365 24532 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.372542 24573 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:17.406200 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 102838us
W20260709 12:27:17.406414 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 72743.6us
W20260709 12:27:17.420814 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 92706.9us
I20260709 12:27:17.384083 24393 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:17.414958 24382 consensus_meta.cc:287] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.002s
I20260709 12:27:17.364854 24512 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.438583 22068 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 2.
W20260709 12:27:17.441063 24640 log.cc:927] Time spent T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:27:17.437534 22776 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:17.447461 24635 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:27:17.447904 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:17.449039 24458 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:17.449559 24458 raft_consensus.cc:697] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:17.451107 22186 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:17.457994 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2217) took 1151 ms. Trace:
I20260709 12:27:17.458974 24500 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:27:17.459115 22188 leader_election.cc:336] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.887s (SENT)
I20260709 12:27:17.459553 24500 raft_consensus.cc:697] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:17.460536 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.919s (SENT)
W20260709 12:27:17.461536 22188 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.931s (SENT)
I20260709 12:27:17.354449 24523 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.463124 24523 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:17.458474 22143 rpcz_store.cc:276] 0709 12:27:16.307204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.780000 (+472796us) service_pool.cc:224] Handling call
0709 12:27:16.780469 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.805814 (+ 25345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.805848 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.829804 (+ 23956us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.028242 (+198438us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:17.028396 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.028478 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.457777 (+429299us) raft_consensus.cc:1685] finished
0709 12:27:17.457794 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.457923 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21196,"raft.queue_time_us":25886,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":28470,"thread_start_us":158886,"threads_started":1,"wal-append.queue_time_us":346771}
I20260709 12:27:17.426534 24437 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:17.468986 22038 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:17.475481 22188 leader_election.cc:336] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.955s (SENT)
I20260709 12:27:17.427575 24595 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:27:17.496301 22113 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.460419 24274 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 12:27:17.498390 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 43929.9us
I20260709 12:27:17.442834 24444 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.184s
I20260709 12:27:17.490919 24615 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:17.450441 24458 consensus_queue.cc:237] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:17.506704 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 57479.8us
W20260709 12:27:17.510697 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 78313us
I20260709 12:27:17.513738 24253 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:17.501817 24418 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:17.515053 24501 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:17.478112 24393 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.460506 24500 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.482782 24627 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:17.524564 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 49110.1us
I20260709 12:27:17.530948 24593 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:27:17.538511 24627 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:17.539793 24512 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:17.540488 24646 log.cc:927] Time spent T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:27:17.541621 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:17.541993 22038 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:17.546797 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.968s (SENT)
I20260709 12:27:17.547425 22188 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:17.551172 24656 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:17.508891 24615 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:17.552237 24438 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:17.529691 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 57843.8us
I20260709 12:27:17.552896 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.553746 24274 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:17.553683 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.552723 24615 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.553982 24438 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:17.558321 24627 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:17.562502 22186 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:17.563041 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.508299 24583 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:27:17.567286 24643 log.cc:927] Time spent T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.231s	user 0.004s	sys 0.000s
I20260709 12:27:17.567896 24393 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:17.503364 24623 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:17.568917 24623 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:17.569326 24641 log.cc:927] Time spent T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:27:17.575785 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43921.5us
W20260709 12:27:17.578755 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.559289 24656 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:17.580541 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.580711 24549 consensus_queue.cc:1059] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:17.581157 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:17.581663 24549 raft_consensus.cc:3055] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:17.582053 24549 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:17.582926 24549 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.584122 24549 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.586314 24535 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.586934 24535 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.589331 24535 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:17.526450 24573 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:27:17.600669 24592 raft_consensus.cc:3055] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:17.601264 24592 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:17.602129 24592 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.602828 22776 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.603753 24627 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:17.604076 24642 log.cc:927] Time spent T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.281s	user 0.000s	sys 0.000s
I20260709 12:27:17.603781 24592 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.605409 24583 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.605911 24583 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:17.608466 22064 consensus_meta.cc:287] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.003s
I20260709 12:27:17.611421 22147 raft_consensus.cc:1275] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.610682 22064 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:17.613468 22070 raft_consensus.cc:1240] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:27:17.613794 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.610183 24583 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:17.614283 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.614895 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.618510 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.622803 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 60366.9us
I20260709 12:27:17.579592 24274 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:17.636373 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 83597us
W20260709 12:27:17.643767 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 91447.6us
W20260709 12:27:17.643569 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.028s (SENT)
I20260709 12:27:17.644999 22188 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:17.648684 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:17.629702 24595 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:17.654023 22113 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.621166 24418 consensus_queue.cc:1048] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:27:17.659163 24631 raft_consensus.cc:2764] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 12 LEADER]: Leader election decision vote started in defunct term 11: won
I20260709 12:27:17.668128 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:17.674764 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 44373.8us
I20260709 12:27:17.637818 24583 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:27:17.682618 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 69738.3us
I20260709 12:27:17.666978 24535 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:17.686913 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:17.692530 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 67429.3us
W20260709 12:27:17.693365 22188 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.029s (SENT)
I20260709 12:27:17.693768 22188 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:17.682178 24274 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:17.699860 24573 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:17.714299 22037 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:17.743927 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:17.742132 22113 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.717118 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:17.714514 22215 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:17.688979 24664 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.747699 22148 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
W20260709 12:27:17.765133 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 71802.2us
I20260709 12:27:17.741780 24595 raft_consensus.cc:697] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:17.754371 24631 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:17.781296 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.755008 24535 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:17.784006 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.058s (SENT)
I20260709 12:27:17.784543 22188 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:17.790047 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:17.794186 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 98718.6us
I20260709 12:27:17.754513 24664 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.815104 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:17.797770 24631 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:17.828852 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:17.845088 24596 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:17.853333 22064 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:17.855027 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:17.855768 22072 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
W20260709 12:27:17.856364 24665 log.cc:927] Time spent T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260709 12:27:17.856773 24599 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.857409 24599 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.857863 24453 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.858409 24453 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.860445 24619 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.860618 24453 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:17.860994 24619 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:17.863039 24619 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:17.862279 24599 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:17.865259 22069 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:17.865403 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:17.868628 22113 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:17.870944 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:17.871845 22144 raft_consensus.cc:2410] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:17.887086 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:17.888028 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:17.890036 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 118022us
I20260709 12:27:17.891680 22185 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:17.891777 22809 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:17.912178 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:17.912416 22037 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:17.914009 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 166027us
I20260709 12:27:17.915901 22809 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:17.887567 24535 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:17.924230 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 97067us
W20260709 12:27:17.928205 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 75266us
I20260709 12:27:17.951462 22114 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:17.952117 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:17.954984 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 171017us
I20260709 12:27:17.923511 24453 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:17.917186 24583 consensus_queue.cc:1048] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:27:17.971349 24607 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:17.975116 24676 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:27:17.970062 24670 log.cc:927] Time spent T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:27:17.967001 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.021934 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:18.023252 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:17.972081 24619 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:18.024348 22188 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.124s (SENT)
I20260709 12:27:18.024901 22188 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:17.972873 24453 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.913678 24595 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:17.973551 24532 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.027060 24666 log.cc:927] Time spent T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 12:27:18.039367 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 58281.3us
I20260709 12:27:18.029685 22802 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:18.035815 24437 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:18.043212 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 98896us
I20260709 12:27:18.021646 24607 raft_consensus.cc:697] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:17.978976 24615 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.026723 24453 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.050666 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:18.027297 24619 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:18.046160 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 62245.8us
I20260709 12:27:18.042689 24535 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:18.037169 24532 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.025207 24599 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:27:18.074539 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 94410.1us
I20260709 12:27:18.038877 24678 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:18.098946 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:18.103215 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 313384us
I20260709 12:27:18.073608 24512 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.106037 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:18.107659 22038 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:18.082263 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:18.109848 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.074956 24619 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.107581 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.072248 24664 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:18.098223 24535 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.124039 22805 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:18.126189 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.129168 22071 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 12:27:18.126993 24637 log.cc:927] Time spent T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:27:18.127569 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:18.095410 24437 raft_consensus.cc:697] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:18.125545 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.129443 22809 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
W20260709 12:27:18.113879 24672 log.cc:927] Time spent T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
I20260709 12:27:18.130985 22801 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:18.131147 24274 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.131628 22220 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:18.131946 24583 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:18.134943 22803 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
W20260709 12:27:18.135282 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.129652 22071 pending_rounds.cc:85] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Aborting all ops after (but not including) 6
I20260709 12:27:18.144522 22071 pending_rounds.cc:107] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:27:18.144836 22071 raft_consensus.cc:2889] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:18.105952 24512 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.143839 22803 pending_rounds.cc:85] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting all ops after (but not including) 4
I20260709 12:27:18.146898 22803 pending_rounds.cc:107] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:27:18.147217 22803 raft_consensus.cc:2889] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:18.141957 24444 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.141759 24274 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.133659 24535 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.169685 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.178366 22809 raft_consensus.cc:2468] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:18.147096 24560 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:18.171356 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.176239 24512 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:18.181447 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.151290 24596 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.183959 24674 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:27:18.181977 24444 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.139693 24698 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:27:18.189833 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45000 (request call id 2042) took 1249 ms. Trace:
I20260709 12:27:18.145411 24607 consensus_queue.cc:237] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.193420 22067 raft_consensus.cc:1240] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:27:18.177340 24274 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.146934 24458 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:27:18.196018 22068 rpcz_store.cc:276] 0709 12:27:16.937154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.937298 (+   144us) service_pool.cc:224] Handling call
0709 12:27:18.186392 (+1249094us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54000b27d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:18.186532 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927484288}
W20260709 12:27:18.251173 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 148681us
I20260709 12:27:18.264904 24452 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:18.269389 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 246601us
I20260709 12:27:18.223748 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:18.273452 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:18.198997 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:18.276779 22066 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
W20260709 12:27:18.276844 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 294883us
I20260709 12:27:18.195504 24599 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:18.220139 24560 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.213507 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:18.291726 24619 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:18.290139 22188 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.126s (SENT)
I20260709 12:27:18.288079 22112 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:18.296926 22188 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:18.250413 24615 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.269886 24452 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.189632 24596 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.274304 24512 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.273376 24698 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.307991 22038 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:18.297230 24532 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.305907 24452 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.327585 24619 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:18.327927 24532 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.328498 24532 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:18.328884 24532 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.335065 24253 consensus_queue.cc:1059] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:18.336864 24253 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.337536 24611 raft_consensus.cc:3055] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:18.337999 24611 raft_consensus.cc:740] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:18.250671 24437 consensus_queue.cc:237] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.299477 24560 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.351959 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:18.354228 22145 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:18.352574 22146 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:27:18.355881 22775 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:18.359026 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:18.359997 22141 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:18.361552 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:18.337846 24452 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.322284 24571 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.372531 22036 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:18.311364 24698 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.379859 22036 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:18.311720 24512 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:18.390255 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 100192us
W20260709 12:27:18.391345 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 87656.5us
W20260709 12:27:18.392880 22142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.022s
W20260709 12:27:18.393472 22142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.012s	sys 0.022s
I20260709 12:27:18.384486 24592 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:18.377087 24627 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.400254 22188 leader_election.cc:336] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.141s (SENT)
W20260709 12:27:18.393502 24623 consensus_meta.cc:287] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.822s	user 0.013s	sys 0.001s
I20260709 12:27:18.402693 22188 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:18.388291 24615 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.387485 24593 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:18.395539 24619 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:18.402436 24592 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.377871 24571 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.379376 24453 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.432492 24592 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.413715 24573 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:18.412292 24615 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.398933 24456 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:27:18.441665 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 395053us
I20260709 12:27:18.449717 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:18.450580 22146 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:18.451984 24512 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.417030 24619 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.414500 24627 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:18.456290 22773 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.819s (SENT)
I20260709 12:27:18.464547 22773 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:18.416782 24593 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.443116 24615 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.519505 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:18.500949 22036 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:18.483866 24619 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:18.548589 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 92337.9us
I20260709 12:27:18.519675 24512 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.500389 24573 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.539729 24664 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:18.562204 22038 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:18.542130 24452 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.547823 24458 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.549706 24596 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:18.587925 22773 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 2.073s (SENT)
I20260709 12:27:18.593062 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:18.537663 24253 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:27:18.595175 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:18.597446 22188 leader_election.cc:336] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.521s (SENT)
I20260709 12:27:18.564574 24693 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:18.638666 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 50765.1us
W20260709 12:27:18.642532 22773 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 2.079s (SENT)
I20260709 12:27:18.587059 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.588965 24582 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.602276 24523 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:18.597296 24623 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:18.643777 22773 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:18.611181 24713 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.647336 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 524) took 1551 ms. Trace:
I20260709 12:27:18.589545 24458 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:18.705035 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 107675us
I20260709 12:27:18.597982 22141 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:18.712052 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.712654 24381 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:18.712723 24582 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.771610 24582 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:18.715353 24571 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:18.716730 22802 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:18.689088 24560 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:18.774278 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:18.725620 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.583549 24512 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.777015 24512 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:18.727531 24627 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:18.728431 24623 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.779263 24623 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.592139 24452 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.781332 24452 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:18.731616 24456 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:18.782152 24456 raft_consensus.cc:697] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:18.783195 24456 consensus_queue.cc:237] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.732069 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 701) took 1016 ms. Trace:
I20260709 12:27:18.586865 24573 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.786499 22801 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:18.789031 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.789227 22037 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:18.789434 24573 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.789801 24523 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.733074 24698 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:18.734230 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 702) took 1018 ms. Trace:
I20260709 12:27:18.763393 24458 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.790310 24512 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:18.738332 22070 rpcz_store.cc:276] 0709 12:27:17.096168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.101427 (+  5259us) service_pool.cc:224] Handling call
0709 12:27:17.613259 (+511832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.617831 (+  4572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.647117 (+1029286us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b5400148a50. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:18.647270 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133487488}
I20260709 12:27:18.790979 24512 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.790504 22810 rpcz_store.cc:276] 0709 12:27:17.715557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.715754 (+   197us) service_pool.cc:224] Handling call
0709 12:27:17.716497 (+   743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.038464 (+321967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.038498 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.039327 (+   829us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.437190 (+397863us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:18.437228 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.437295 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.734024 (+296729us) raft_consensus.cc:1685] finished
0709 12:27:18.734045 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.734174 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7929,"raft.queue_time_us":51594,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12123,"thread_start_us":678698,"threads_started":2,"wal-append.queue_time_us":683700}
W20260709 12:27:18.697808 24501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.008s	sys 0.007s
I20260709 12:27:18.725019 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.797883 22808 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:18.692598 24693 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:18.799904 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 157458us
W20260709 12:27:18.797654 24501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.008s	sys 0.007s
I20260709 12:27:18.791472 24512 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.792366 24381 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.802927 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.806280 22810 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:18.807585 22037 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:18.763600 24713 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:18.809580 22773 leader_election.cc:336] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 2.115s (SENT)
I20260709 12:27:18.813453 24381 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.789702 22801 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:18.821681 24582 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.821699 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.181s (SENT)
I20260709 12:27:18.823403 24444 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.790779 22807 rpcz_store.cc:276] 0709 12:27:17.715257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.748896 (+ 33639us) service_pool.cc:224] Handling call
0709 12:27:18.315788 (+566892us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1eee 000000000036eb39 00007ff1916551e0 00007ff19171e0c4 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:18.315959 (+   171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.316230 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.316258 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.316774 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.505719 (+188945us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:18.505764 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.505855 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.731735 (+225880us) raft_consensus.cc:1685] finished
0709 12:27:18.731762 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.732000 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12682112,"thread_start_us":188522,"threads_started":1,"wal-append.queue_time_us":387872}
I20260709 12:27:18.818205 24452 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:18.828903 24582 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.841460 24452 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.841903 24452 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.843397 24582 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.809304 24693 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:18.844756 22185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.039s	sys 0.047s
I20260709 12:27:18.811641 24619 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.787597 24274 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:18.827543 24673 log.cc:927] Time spent T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.798s	user 0.003s	sys 0.000s
W20260709 12:27:18.847404 22185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.039s	sys 0.048s
I20260709 12:27:18.807034 24532 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:18.851859 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 792629us
I20260709 12:27:18.815517 24615 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:18.852236 24535 consensus_meta.cc:287] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.001s
W20260709 12:27:18.868889 22221 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.017s	sys 0.077s
W20260709 12:27:18.869361 22221 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.017s	sys 0.078s
W20260709 12:27:18.898106 22039 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.005s	sys 0.015s
W20260709 12:27:18.898561 22039 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.015s
W20260709 12:27:18.898365 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 336242us
I20260709 12:27:18.899507 22114 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:18.900444 24623 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:18.900656 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.900918 24623 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:18.901088 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.901317 24623 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:18.901710 24571 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.902104 22112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.007s	sys 0.012s
W20260709 12:27:18.902457 22112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.012s
I20260709 12:27:18.902276 24571 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:18.903196 22113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.016s	sys 0.002s
W20260709 12:27:18.903366 24690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.014s	sys 0.056s
W20260709 12:27:18.903863 24690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.014s	sys 0.057s
W20260709 12:27:18.904433 22809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.015s
W20260709 12:27:18.904781 22809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.003s	sys 0.015s
I20260709 12:27:18.904925 24596 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:18.905864 24607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.000s	sys 0.012s
W20260709 12:27:18.903558 22072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.013s	sys 0.007s
W20260709 12:27:18.906850 22113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.016s	sys 0.002s
I20260709 12:27:18.906055 24596 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:18.907333 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 808460us
W20260709 12:27:18.906280 22775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.013s	sys 0.005s
W20260709 12:27:18.906580 22222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.007s	sys 0.010s
W20260709 12:27:18.908275 24607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.012s
W20260709 12:27:18.910729 22775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.014s	sys 0.005s
W20260709 12:27:18.907788 22072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.013s	sys 0.007s
W20260709 12:27:18.913691 22222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.008s	sys 0.010s
W20260709 12:27:18.909618 22188 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.188s (SENT)
W20260709 12:27:18.916101 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 560000us
I20260709 12:27:18.908140 22113 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:18.903096 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 615070us
I20260709 12:27:18.917174 22067 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:18.912266 24676 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:27:18.911738 24675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.007s	sys 0.010s
W20260709 12:27:18.956648 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 48608.9us
I20260709 12:27:18.976392 22113 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:18.958568 24253 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:18.959197 24699 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
I20260709 12:27:18.956700 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:18.960412 24684 log.cc:927] Time spent T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.524s	user 0.000s	sys 0.001s
I20260709 12:27:18.991562 24596 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.992493 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 703) took 1250 ms. Trace:
W20260709 12:27:18.993525 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 84557.1us
W20260709 12:27:18.994243 22188 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.235s (SENT)
I20260709 12:27:18.998055 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:18.998710 22148 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:18.961531 24689 log.cc:927] Time spent T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.910s	user 0.000s	sys 0.001s
I20260709 12:27:18.999192 24253 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:18.967198 24453 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.967527 24619 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:18.994392 24671 log.cc:927] Time spent T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 1.076s	user 0.003s	sys 0.000s
I20260709 12:27:18.968144 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:18.969749 24274 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:18.973193 24458 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:18.925350 22112 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:18.912635 24582 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.977034 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:18.977543 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:18.980496 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 52587us
I20260709 12:27:18.857302 24713 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:18.988548 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:19.045774 22805 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:18.989521 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:19.003108 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1691) took 1261 ms. Trace:
I20260709 12:27:19.046391 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:19.005720 22188 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:19.045929 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2045) took 2097 ms. Trace:
I20260709 12:27:18.912748 24693 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.992887 22806 rpcz_store.cc:276] 0709 12:27:17.742545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.747752 (+  5207us) service_pool.cc:224] Handling call
0709 12:27:17.763909 (+ 16157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.764160 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.764197 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.803947 (+ 39750us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.052783 (+248836us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:18.052819 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.052886 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.959775 (+906889us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:18.992209 (+ 32434us) raft_consensus.cc:1685] finished
0709 12:27:18.992230 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.992431 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6346624,"thread_start_us":180037,"threads_started":1,"wal-append.queue_time_us":562418}
I20260709 12:27:19.032534 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:18.981575 24595 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:19.039945 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 114701us
I20260709 12:27:18.891635 24535 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:18.976493 22036 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:19.043016 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2232) took 1177 ms. Trace:
I20260709 12:27:19.043680 22066 raft_consensus.cc:1240] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:19.043979 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:18.988859 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:19.046377 22803 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.047449 22071 rpcz_store.cc:276] 0709 12:27:16.940251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.940369 (+   118us) service_pool.cc:224] Handling call
0709 12:27:16.940639 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.155203 (+1214564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.028971 (+873768us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400185bd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:19.037600 (+  8629us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732684160}
I20260709 12:27:18.919037 24549 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:19.081548 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.043473 21970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46396 (request call id 330) took 8881 ms. Trace:
I20260709 12:27:19.002496 24593 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:19.047878 24583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.027s	sys 0.032s
W20260709 12:27:19.108589 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 114381us
I20260709 12:27:19.016954 22148 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:19.069319 22112 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:18.975391 24675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.008s	sys 0.010s
I20260709 12:27:19.003542 24695 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:19.046800 22142 rpcz_store.cc:276] 0709 12:27:17.742157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.748427 (+  6270us) service_pool.cc:224] Handling call
0709 12:27:17.764046 (+ 15619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.771395 (+  7349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.771423 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.794968 (+ 23545us) log.cc:844] Serialized 564 byte log entry
0709 12:27:18.399527 (+604559us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:18.399568 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.399639 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.958470 (+558831us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:19.002793 (+ 44323us) raft_consensus.cc:1685] finished
0709 12:27:19.002816 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:19.003032 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11386240,"thread_start_us":564619,"threads_started":1,"wal-append.queue_time_us":735145}
I20260709 12:27:18.928151 24592 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:19.079648 22068 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:27:19.088222 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 111799us
I20260709 12:27:19.073915 22140 rpcz_store.cc:276] 0709 12:27:17.865312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.872525 (+  7213us) service_pool.cc:224] Handling call
0709 12:27:17.889440 (+ 16915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.889780 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.889810 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.913064 (+ 23254us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.978146 (+ 65082us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:17.978185 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.978254 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.960936 (+982682us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:19.003890 (+ 42954us) raft_consensus.cc:1685] finished
0709 12:27:19.003909 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:19.042932 (+ 39023us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":21736,"spinlock_wait_cycles":59088000,"thread_start_us":57796,"threads_started":1,"wal-append.queue_time_us":128807}
I20260709 12:27:19.067070 22145 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:19.048394 24607 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:19.104894 24599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.023s	sys 0.022s
I20260709 12:27:19.131793 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:19.131405 22139 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:19.049613 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:19.229106 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 96045.4us
I20260709 12:27:19.227386 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:19.227516 22147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1690) took 1604 ms. Trace:
W20260709 12:27:19.336879 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 267649us
W20260709 12:27:19.336560 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 108246us
I20260709 12:27:19.049881 24253 consensus_queue.cc:1059] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 12:27:19.130548 24583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.027s	sys 0.035s
I20260709 12:27:19.111508 24596 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:19.082684 21970 rpcz_store.cc:276] 0709 12:27:10.162309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.195985 (+ 33676us) service_pool.cc:224] Handling call
0709 12:27:19.043384 (+8847399us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:16.916177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:16.991568 (+ 75391us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:17.055361 (+ 63793us) write_op.cc:435] Acquired schema lock
0709 12:27:17.059135 (+  3774us) tablet.cc:662] Decoding operations
0709 12:27:17.107129 (+ 47994us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:17.107206 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:17.107238 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:27:17.107700 (+   462us) tablet.cc:701] Row locks acquired
0709 12:27:17.107743 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:27:17.107997 (+   254us) write_op.cc:270] Start()
0709 12:27:17.108172 (+   175us) write_op.cc:276] Timestamp: P: 1783600037107838 usec, L: 0
0709 12:27:17.108195 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:27:17.134490 (+ 26295us) log.cc:844] Serialized 1375 byte log entry
0709 12:27:17.539719 (+405229us) op_driver.cc:464] REPLICATION: finished
0709 12:27:18.127509 (+587790us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18003a36c0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:27:18.127679 (+   170us) write_op.cc:301] APPLY: starting
0709 12:27:18.127770 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:18.127923 (+   153us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:18.127960 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:18.131403 (+  3443us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:18.131729 (+   326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:27:18.131775 (+    46us) write_op.cc:312] APPLY: finished
0709 12:27:18.132058 (+   283us) log.cc:844] Serialized 35 byte log entry
0709 12:27:18.132263 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:18.132360 (+    97us) write_op.cc:454] Released schema lock
0709 12:27:18.132414 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:18.132876 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:18.132903 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201354,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":86489,"apply.run_cpu_time_us":2621,"apply.run_wall_time_us":5139,"num_ops":3,"prepare.queue_time_us":383982,"prepare.run_cpu_time_us":24549,"prepare.run_wall_time_us":416824,"raft.queue_time_us":113575,"raft.run_cpu_time_us":9917,"raft.run_wall_time_us":89406,"replication_time_us":431349,"spinlock_wait_cycles":4099456,"thread_start_us":612412,"threads_started":4,"wal-append.queue_time_us":246720,"wal-append.run_cpu_time_us":22965,"wal-append.run_wall_time_us":1866511}]]}
I20260709 12:27:19.109494 24274 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:19.397051 22188 leader_election.cc:336] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.398s (SENT)
I20260709 12:27:19.355274 22147 rpcz_store.cc:276] 0709 12:27:17.623041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.623189 (+   148us) service_pool.cc:224] Handling call
0709 12:27:17.645172 (+ 21983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.645507 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.645533 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.650170 (+  4637us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.756436 (+106266us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:17.756471 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.756529 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.337089 (+580560us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b4800150258. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff19162faa1 00007ff191626b37 00007ff1916269ca 00007ff19171e26f 00007ff19171df37 00007ff19173255c 00007ff191732508 00007ff191732488 00007ff191732443 00007ff1917316ec 00007ff19065ba96
0709 12:27:18.993757 (+656668us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:19.227331 (+233574us) raft_consensus.cc:1685] finished
0709 12:27:19.227350 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:19.227463 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159,"raft.run_cpu_time_us":5664,"raft.run_wall_time_us":690352,"spinlock_wait_cycles":19318784,"thread_start_us":80429,"threads_started":1,"wal-append.queue_time_us":168512}
I20260709 12:27:19.250407 24697 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:19.429171 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:19.472695 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.076756 24693 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:19.431844 22810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.019s	sys 0.027s
W20260709 12:27:19.478163 22810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.019s	sys 0.027s
W20260709 12:27:19.371714 24599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.023s	sys 0.023s
I20260709 12:27:19.068917 24582 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:19.430222 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:19.080606 24595 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:19.449676 22221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.010s	sys 0.038s
I20260709 12:27:19.452494 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:19.429325 22804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.013s	sys 0.043s
I20260709 12:27:19.366897 24607 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:19.337622 24680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.042s	sys 0.072s
I20260709 12:27:19.457145 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:19.464664 24692 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:19.454175 24437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.017s	sys 0.044s
I20260709 12:27:19.248886 24593 consensus_queue.cc:1059] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.190s
I20260709 12:27:19.400103 24596 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:19.436371 24456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.015s	sys 0.034s
I20260709 12:27:19.396976 24381 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:19.474035 22218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.021s	sys 0.033s
W20260709 12:27:19.529994 22218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.022s	sys 0.033s
I20260709 12:27:19.436045 24681 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:19.487977 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:19.493182 24453 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:19.479209 22807 raft_consensus.cc:2393] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
W20260709 12:27:19.501646 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 428818us
W20260709 12:27:19.492214 22804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.013s	sys 0.044s
I20260709 12:27:19.459609 24705 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:19.504266 24690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.019s	sys 0.057s
W20260709 12:27:19.561056 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 223836us
I20260709 12:27:19.482849 24697 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:19.509415 24680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.042s	sys 0.074s
I20260709 12:27:19.492830 24532 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:19.491663 22221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.011s	sys 0.038s
I20260709 12:27:19.508486 24607 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.575528 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 475) took 1452 ms. Trace:
I20260709 12:27:19.537359 22806 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
W20260709 12:27:19.525426 24437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.017s	sys 0.045s
W20260709 12:27:19.535359 24456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.015s	sys 0.034s
W20260709 12:27:19.557549 22773 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 2.580s (SENT)
W20260709 12:27:19.534942 24452 consensus_meta.cc:287] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.693s	user 0.005s	sys 0.005s
I20260709 12:27:19.482393 24599 raft_consensus.cc:697] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:19.531510 24596 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.576821 22221 rpcz_store.cc:276] 0709 12:27:18.122795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.122973 (+   178us) service_pool.cc:224] Handling call
0709 12:27:18.128229 (+  5256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.128441 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:18.869875 (+741434us) log.cc:844] Serialized 14 byte log entry
0709 12:27:19.575180 (+705305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:19.575233 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:19.575283 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.575360 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:19.575471 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43277,"prepare.queue_time_us":137083,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"thread_start_us":1405637,"threads_started":2}
I20260709 12:27:19.527804 24615 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:19.573168 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:19.557144 24706 log.cc:927] Time spent T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.621s	user 0.000s	sys 0.001s
W20260709 12:27:19.607949 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 50442.3us
W20260709 12:27:19.560634 24690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.020s	sys 0.058s
I20260709 12:27:19.536943 24681 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:19.592890 24712 log.cc:927] Time spent T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:27:19.678311 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:19.680241 22068 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:19.578701 22215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.011s	sys 0.009s
W20260709 12:27:19.697917 22215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.011s	sys 0.009s
I20260709 12:27:19.131223 24695 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:19.579245 22808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.044s	sys 0.044s
W20260709 12:27:19.581002 24710 log.cc:927] Time spent T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260709 12:27:19.577943 24705 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:19.564476 24723 raft_consensus.cc:3055] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:19.715651 24723 raft_consensus.cc:740] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:19.716440 24688 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:19.717463 24731 log.cc:927] Time spent T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:27:19.716714 24723 consensus_queue.cc:260] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:19.564333 24381 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:19.535737 24692 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:19.718639 22808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.044s	sys 0.044s
I20260709 12:27:19.718251 22072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 532) took 1526 ms. Trace:
I20260709 12:27:19.574885 24453 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:19.709563 22773 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 2.580s (SENT)
W20260709 12:27:19.710511 22188 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.802s (SENT)
I20260709 12:27:19.592886 24458 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:19.586915 24698 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:19.717145 24688 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:19.566669 24274 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:19.738868 22773 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:19.678743 24535 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:19.708285 24681 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.743198 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:19.757339 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:19.721829 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:19.741182 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 383458us
I20260709 12:27:19.721268 22072 rpcz_store.cc:276] 0709 12:27:18.191889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.192018 (+   129us) service_pool.cc:224] Handling call
0709 12:27:18.193256 (+  1238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.193685 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.193712 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.194228 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.913284 (+719056us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:18.913345 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.913434 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:19.718004 (+804570us) raft_consensus.cc:1685] finished
0709 12:27:19.718024 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:19.718190 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1190,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":2013,"thread_start_us":718599,"threads_started":1,"wal-append.queue_time_us":909688}
I20260709 12:27:19.596220 24452 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:19.749058 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 391131us
W20260709 12:27:19.752666 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 157329us
I20260709 12:27:19.755489 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:19.743582 24723 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.719324 24695 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.775074 22112 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:19.756178 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:19.775668 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:19.776291 22142 raft_consensus.cc:2410] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:27:19.754678 24669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.013s	sys 0.009s
I20260709 12:27:19.768579 22036 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:19.772379 22144 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:27:19.748368 24717 log.cc:927] Time spent T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:27:19.738379 24592 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:19.756577 24675 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:19.748632 24698 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:19.805334 22068 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:19.796905 24253 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:19.807663 24726 log.cc:927] Time spent T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:27:19.775766 24593 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.808298 24730 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:19.808986 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:19.810417 24697 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:19.813740 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:19.814872 22807 raft_consensus.cc:2393] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:19.815418 24627 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:19.820174 22065 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 6: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:20.269462 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2062) took 1283 ms. Trace:
I20260709 12:27:20.106830 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 477) took 1858 ms. Trace:
W20260709 12:27:20.012574 22805 consensus_meta.cc:287] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.964s	user 0.008s	sys 0.000s
W20260709 12:27:20.163393 22803 consensus_meta.cc:287] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.029s	user 0.010s	sys 0.000s
I20260709 12:27:20.273912 22803 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:20.112118 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 533) took 1859 ms. Trace:
I20260709 12:27:19.829254 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.274850 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 707) took 1298 ms. Trace:
I20260709 12:27:19.827840 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:20.270990 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 561777us
I20260709 12:27:19.840009 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:19.878141 22072 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:20.277619 22142 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:20.276569 22805 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:20.278489 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 708) took 1302 ms. Trace:
I20260709 12:27:20.273873 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2061) took 1292 ms. Trace:
I20260709 12:27:19.762369 24703 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.279390 22067 rpcz_store.cc:276] 0709 12:27:18.981217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.981454 (+   237us) service_pool.cc:224] Handling call
0709 12:27:18.981839 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.982186 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.982212 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.996030 (+ 13818us) log.cc:844] Serialized 26 byte log entry
0709 12:27:19.492586 (+496556us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:19.492631 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.492702 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.133555 (+640853us) raft_consensus.cc:1685] finished
0709 12:27:20.133581 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.273811 (+140230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10022,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":496121,"threads_started":1,"wal-append.queue_time_us":1101813}
W20260709 12:27:20.270112 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.275440 22803 rpcz_store.cc:276] 0709 12:27:18.976209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.976686 (+   477us) service_pool.cc:224] Handling call
0709 12:27:20.274786 (+1298100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:20.272293 22806 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.283835 22144 raft_consensus.cc:2410] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:20.274820 22064 rpcz_store.cc:276] 0709 12:27:18.252962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.253111 (+   149us) service_pool.cc:224] Handling call
0709 12:27:18.273739 (+ 20628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.274065 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.274095 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.277107 (+  3012us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.640150 (+363043us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:18.640187 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.640254 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.111859 (+1471605us) raft_consensus.cc:1685] finished
0709 12:27:20.111882 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.112035 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1752,"raft.queue_time_us":34052,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3764,"thread_start_us":362663,"threads_started":1,"wal-append.queue_time_us":1212618}
I20260709 12:27:19.774222 24571 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:19.795399 24669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.014s	sys 0.009s
W20260709 12:27:20.275969 22773 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.538s (SENT) [suppressed 9 similar messages]
I20260709 12:27:20.279042 22805 rpcz_store.cc:276] 0709 12:27:18.976502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.976761 (+   259us) service_pool.cc:224] Handling call
0709 12:27:20.278434 (+1301673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:20.285759 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:20.104187 24677 log.cc:927] Time spent T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 1.993s	user 0.000s	sys 0.004s
W20260709 12:27:20.170742 24728 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.502s	user 0.000s	sys 0.001s
W20260709 12:27:20.017198 24748 log.cc:927] Time spent T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 12:27:20.319491 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:20.306000 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:20.321913 22805 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:20.322114 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:19.828333 24721 log.cc:927] Time spent T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
I20260709 12:27:20.323016 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:20.171404 24747 log.cc:927] Time spent T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:27:20.321367 22065 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:20.273573 22222 rpcz_store.cc:276] 0709 12:27:18.248055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.254446 (+  6391us) service_pool.cc:224] Handling call
0709 12:27:18.278063 (+ 23617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.300376 (+ 22313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.300432 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.319498 (+ 19066us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.916882 (+597384us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:18.916924 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.917006 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.098491 (+1181485us) raft_consensus.cc:1685] finished
0709 12:27:20.106571 (+  8080us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.106757 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11087,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":548428,"threads_started":1,"wal-append.queue_time_us":1626221}
W20260709 12:27:19.975244 24738 log.cc:927] Time spent T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260709 12:27:20.173457 24740 log.cc:927] Time spent T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
W20260709 12:27:19.828145 24707 log.cc:927] Time spent T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
W20260709 12:27:20.053026 24735 log.cc:927] Time spent T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.334s	user 0.000s	sys 0.000s
W20260709 12:27:20.171875 24737 log.cc:927] Time spent T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.342s	user 0.000s	sys 0.000s
I20260709 12:27:20.306356 22142 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:20.114540 24744 log.cc:927] Time spent T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.062s	user 0.003s	sys 0.002s
W20260709 12:27:20.200383 24512 consensus_meta.cc:287] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.385s	user 0.009s	sys 0.000s
I20260709 12:27:20.319700 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:20.271950 22070 rpcz_store.cc:276] 0709 12:27:18.985987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.986204 (+   217us) service_pool.cc:224] Handling call
0709 12:27:19.044731 (+ 58527us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:19.051262 (+  6531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:19.051296 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:19.090326 (+ 39030us) log.cc:844] Serialized 52 byte log entry
0709 12:27:19.737798 (+647472us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:19.737877 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.738052 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.269197 (+531145us) raft_consensus.cc:1685] finished
0709 12:27:20.269223 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.269399 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3277,"raft.queue_time_us":19670,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":27021,"thread_start_us":370199,"threads_started":1,"wal-append.queue_time_us":568045}
I20260709 12:27:19.798391 24690 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.104864 24727 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:20.091538 24743 log.cc:927] Time spent T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.373s	user 0.000s	sys 0.003s
I20260709 12:27:20.324268 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.324463 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:20.324936 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:19.976382 24693 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:20.297710 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 469102us
I20260709 12:27:19.771291 24274 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.166855 24381 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:20.078442 24453 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.269351 24592 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:20.170557 24751 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.054045 24749 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:20.328594 24593 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.280161 24458 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.332940 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:20.396162 22805 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 6: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:20.280238 24705 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.318300 24703 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:20.355134 22113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.002s	sys 0.037s
I20260709 12:27:20.285838 24615 raft_consensus.cc:476] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 12:27:20.104620 24752 raft_consensus.cc:2804] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:20.425918 22065 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:20.426074 22070 raft_consensus.cc:1275] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:19.974251 24732 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:20.308200 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 714) took 1223 ms. Trace:
I20260709 12:27:20.318125 24456 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.830238 24535 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.505s
I20260709 12:27:20.396601 24749 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:20.444502 24623 consensus_meta.cc:287] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.543s	user 0.006s	sys 0.005s
I20260709 12:27:20.372840 22803 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:20.398430 24458 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.170248 24695 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.447388 24458 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:20.448334 24695 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.329712 24755 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:20.449312 24755 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.431386 24752 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:20.451108 24752 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.451573 24755 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:20.367405 24742 log.cc:927] Time spent T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.570s	user 0.000s	sys 0.001s
I20260709 12:27:20.291543 24253 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.454339 24253 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:20.368613 24607 consensus_meta.cc:287] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.770s	user 0.004s	sys 0.013s
I20260709 12:27:20.455120 24607 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.383378 22144 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.435446 22807 rpcz_store.cc:276] 0709 12:27:19.085083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.598614 (+513531us) service_pool.cc:224] Handling call
0709 12:27:20.304366 (+705752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:20.386250 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 708) took 2032 ms. Trace:
I20260709 12:27:20.333061 24692 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:19.828235 24611 consensus_queue.cc:260] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.098178 24599 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.367889 24452 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.287132 24730 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:20.389299 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.865s (SENT)
I20260709 12:27:20.306926 24675 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.378026 24582 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.393709 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:19.889878 24595 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:20.398937 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:20.473053 22147 raft_consensus.cc:2393] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:20.473558 22805 raft_consensus.cc:2410] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:20.425412 24751 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.426237 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.475868 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.476774 22141 raft_consensus.cc:2393] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:20.477613 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.398553 24593 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:20.427691 22113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.043s
I20260709 12:27:20.387940 24758 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.458956 22809 rpcz_store.cc:276] 0709 12:27:18.353675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.353817 (+   142us) service_pool.cc:224] Handling call
0709 12:27:18.357911 (+  4094us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.358286 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.358310 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.365416 (+  7106us) log.cc:844] Serialized 564 byte log entry
0709 12:27:18.905229 (+539813us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:18.905274 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.905350 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.386037 (+1480687us) raft_consensus.cc:1685] finished
0709 12:27:20.386057 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.386190 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":539441,"threads_started":1,"wal-append.queue_time_us":1067038}
I20260709 12:27:20.479696 24758 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.380136 24512 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.433598 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:20.433499 24739 log.cc:927] Time spent T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:27:20.388137 24727 raft_consensus.cc:697] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:20.393853 24592 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.439338 22806 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:20.444953 24623 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.388046 24690 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.551963 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 704) took 1962 ms. Trace:
I20260709 12:27:20.560312 22142 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:20.592689 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:20.541960 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.594398 22148 raft_consensus.cc:2393] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:20.594556 22142 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:20.590982 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.592624 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 719) took 1065 ms. Trace:
I20260709 12:27:20.596783 22805 rpcz_store.cc:276] 0709 12:27:19.527289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.474299 (+947010us) service_pool.cc:224] Handling call
0709 12:27:20.592110 (+117811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.592305 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:20.592334 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:20.592376 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:20.592407 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.592460 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.592566 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:20.600930 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 170198us
I20260709 12:27:20.482967 22073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 531) took 2291 ms. Trace:
I20260709 12:27:20.481676 22809 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:20.560353 22144 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:27:20.551441 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 162161us
I20260709 12:27:20.862380 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.603382 22037 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:20.532366 21967 catalog_manager.cc:5697] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 5, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:20.863803 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 260480us
I20260709 12:27:20.667227 22071 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:20.464722 24681 consensus_meta.cc:287] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.003s
I20260709 12:27:20.720566 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.874632 22145 raft_consensus.cc:2393] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:20.609772 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:20.875288 22146 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.604893 22073 rpcz_store.cc:276] 0709 12:27:18.191627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.192378 (+   751us) service_pool.cc:224] Handling call
0709 12:27:18.199956 (+  7578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.200194 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.200220 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.274625 (+ 74405us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.638321 (+363696us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:19.075282 (+436961us) log.cc:844] Serialized 14 byte log entry
0709 12:27:19.076550 (+  1268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.076620 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.482474 (+1405854us) raft_consensus.cc:1685] finished
0709 12:27:20.482495 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.482899 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1020,"prepare.queue_time_us":853485,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":1171,"spinlock_wait_cycles":31197952,"thread_start_us":714534,"threads_started":2,"wal-append.queue_time_us":963256}
I20260709 12:27:20.876608 21967 catalog_manager.cc:5697] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.865810 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:20.668664 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:20.865360 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:20.878640 22065 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:20.708793 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 700) took 2194 ms. Trace:
I20260709 12:27:20.592041 22810 rpcz_store.cc:276] 0709 12:27:18.589172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.807781 (+218609us) service_pool.cc:224] Handling call
0709 12:27:18.808116 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.808459 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.808485 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.808976 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:27:19.478639 (+669663us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:19.478685 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.478763 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.551707 (+1072944us) raft_consensus.cc:1685] finished
0709 12:27:20.551727 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.551884 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1138,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4813,"thread_start_us":669222,"threads_started":1,"wal-append.queue_time_us":761796}
I20260709 12:27:20.742492 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51462 (request call id 2245) took 1767 ms. Trace:
I20260709 12:27:20.879873 22139 rpcz_store.cc:276] 0709 12:27:18.975027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.975376 (+   349us) service_pool.cc:224] Handling call
0709 12:27:20.742239 (+1766863us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b540039fb54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:20.742412 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147479424}
W20260709 12:27:20.655939 22188 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.873s (SENT)
I20260709 12:27:20.867585 22037 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:20.482126 24736 log.cc:927] Time spent T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.982s	user 0.006s	sys 0.006s
I20260709 12:27:20.878640 22070 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:20.880828 22188 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:20.879654 22036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.016s
W20260709 12:27:20.533399 24723 consensus_meta.cc:287] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.000s
W20260709 12:27:20.863955 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:20.528852 24596 consensus_meta.cc:287] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.901s	user 0.008s	sys 0.002s
I20260709 12:27:20.877568 22140 raft_consensus.cc:1240] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:20.607709 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:20.889191 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.552652 24751 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:20.609469 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:20.883709 22037 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:20.576443 24501 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:20.880488 21967 catalog_manager.cc:5697] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 2, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.595746 24573 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:20.900363 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:20.889145 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 557) took 1133 ms. Trace:
I20260709 12:27:20.904631 22140 rpcz_store.cc:276] 0709 12:27:19.755999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.745000 (+989001us) service_pool.cc:224] Handling call
0709 12:27:20.877093 (+132093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:20.888862 (+ 11769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.889088 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:20.480361 24593 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:20.886759 22067 raft_consensus.cc:1240] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:20.576047 24695 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:20.577742 24755 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:20.879532 22808 rpcz_store.cc:276] 0709 12:27:18.514124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.803370 (+289246us) service_pool.cc:224] Handling call
0709 12:27:18.809807 (+  6437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.819724 (+  9917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.819760 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.827232 (+  7472us) log.cc:844] Serialized 26 byte log entry
0709 12:27:19.719500 (+892268us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:19.719573 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.719698 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.708531 (+988833us) raft_consensus.cc:1685] finished
0709 12:27:20.708558 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.708718 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5187,"raft.queue_time_us":11283,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":101,"thread_start_us":891763,"threads_started":1,"wal-append.queue_time_us":1453081}
I20260709 12:27:20.886770 22148 raft_consensus.cc:1275] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 12:27:20.893929 24757 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.554311 24675 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.897502 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:20.943447 22809 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:20.898527 22069 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:20.712191 24718 raft_consensus.cc:3055] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:20.947190 22037 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:20.600670 22801 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:20.919121 24693 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.482211 24758 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:20.609025 24631 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:20.901343 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:20.901369 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:20.881402 24713 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:20.882705 24535 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:20.667495 24715 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.876490 24611 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.901284 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:20.972980 22222 raft_consensus.cc:3060] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:20.712093 24512 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.483000 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 692) took 2989 ms. Trace:
I20260709 12:27:20.723837 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2241) took 2270 ms. Trace:
I20260709 12:27:20.720920 24754 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.901680 24733 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:27:20.886332 22773 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.010s	sys 0.017s
W20260709 12:27:20.984655 22773 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.010s	sys 0.018s
W20260709 12:27:20.985056 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 709076us
I20260709 12:27:20.666886 24761 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:27:20.905663 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 249781us
I20260709 12:27:20.553717 24749 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.829118 24623 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:20.730533 24688 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.872793 24437 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:20.899833 21967 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.486824 24456 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.876694 24703 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:20.467581 24732 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.971943 24758 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:27:20.929034 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:20.930384 22186 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:20.887904 24680 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:20.890321 24619 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:20.905983 22810 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.931949 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:20.932628 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:20.670121 24690 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.007262 24437 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.041268 24437 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.044226 24732 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:21.009737 24733 raft_consensus.cc:697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:21.045586 24733 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.049811 24680 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.011650 24703 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:21.051465 24703 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.933956 22146 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:20.935441 22148 pending_rounds.cc:85] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 1
I20260709 12:27:21.053469 22148 pending_rounds.cc:107] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 12:27:20.884290 22036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.011s	sys 0.016s
I20260709 12:27:20.938055 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:20.894887 24730 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.887981 24681 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.054904 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:21.055548 22036 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:21.056030 24681 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:20.896194 22776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.011s	sys 0.022s
W20260709 12:27:21.056658 22776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.012s	sys 0.022s
I20260709 12:27:20.960559 22066 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.966395 22141 raft_consensus.cc:1240] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:21.059307 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.062747 22144 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:21.055984 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:21.064275 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 133973us
I20260709 12:27:20.968995 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 483) took 1615 ms. Trace:
W20260709 12:27:20.957331 24720 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:27:20.973037 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:20.938633 24751 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:20.962992 22802 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.020s	sys 0.022s
I20260709 12:27:20.947392 24718 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:20.969300 24752 consensus_meta.cc:287] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
I20260709 12:27:20.938467 24695 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:20.970000 24560 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:20.955003 24274 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:21.003432 21967 catalog_manager.cc:5697] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 3, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.925668 24501 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.947772 24573 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:20.969347 24697 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:20.670650 24727 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:21.009616 22188 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.188s (SENT)
I20260709 12:27:20.928068 22140 raft_consensus.cc:1240] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:20.978657 24713 raft_consensus.cc:697] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:21.033669 22215 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:21.034168 22214 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:20.998378 24761 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:21.090930 24763 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:21.038781 22220 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
I20260709 12:27:21.053354 22810 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:21.146899 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:21.146915 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 137359us
I20260709 12:27:21.056622 22148 raft_consensus.cc:2889] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:21.147801 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.894961 24596 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:21.064307 22805 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:21.066656 22186 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:21.149425 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:21.066439 22213 rpcz_store.cc:276] 0709 12:27:19.354014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.354779 (+   765us) service_pool.cc:224] Handling call
0709 12:27:19.433722 (+ 78943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:19.433946 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:19.459821 (+ 25875us) log.cc:844] Serialized 14 byte log entry
0709 12:27:20.534227 (+1074406us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18004bc400. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b 00007ff18c2a5d23 00007ff18c2a623a 00007ff18c710a2a
0709 12:27:20.966670 (+432443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:20.968681 (+  2011us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:20.968739 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.968806 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.968938 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25852,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":4907,"raft.queue_time_us":244,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4926,"spinlock_wait_cycles":23057792,"thread_start_us":431957,"threads_started":1}
W20260709 12:27:21.150126 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 83574.8us
I20260709 12:27:21.067654 22066 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:20.960105 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:21.147500 22810 raft_consensus.cc:2376] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7. Re-sending same reply.
I20260709 12:27:21.151032 22808 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:20.995679 24698 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:20.959800 24755 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.083474 22222 raft_consensus.cc:2468] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:21.064456 24690 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.948105 24757 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.088656 22773 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:20.994556 24754 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:21.100688 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.186518 22221 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.985515 22804 rpcz_store.cc:276] 0709 12:27:17.493228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.497317 (+  4089us) service_pool.cc:224] Handling call
0709 12:27:17.542084 (+ 44767us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:17.575573 (+ 33489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.577389 (+  1816us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:17.587794 (+ 10405us) log.cc:844] Serialized 527 byte log entry
0709 12:27:18.805162 (+1217368us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b18002b2f40. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b 00007ff18c2a5d23 00007ff18c2a60d1 00007ff18c6c1a0f
0709 12:27:19.574682 (+769520us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:19.578296 (+  3614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.588928 (+ 10632us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.482675 (+893747us) raft_consensus.cc:1685] finished
0709 12:27:20.482699 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.482919 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16159,"raft.queue_time_us":21727,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6983,"spinlock_wait_cycles":12138368,"thread_start_us":751707,"threads_started":1,"wal-append.queue_time_us":1972983}
I20260709 12:27:21.106715 24691 consensus_queue.cc:1059] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:21.116662 24456 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:21.085480 22802 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.020s	sys 0.022s
I20260709 12:27:21.118131 24718 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:21.119236 24752 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.203256 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:21.203723 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2257) took 1343 ms. Trace:
I20260709 12:27:21.204092 22145 rpcz_store.cc:276] 0709 12:27:19.860262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.881444 (+1021182us) service_pool.cc:224] Handling call
0709 12:27:20.895676 (+ 14232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.067863 (+172187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:21.067891 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:21.067933 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:21.067965 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.203518 (+135553us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003fc0d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:21.203561 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.203669 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395585408}
I20260709 12:27:21.204926 24752 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.978157 24535 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.206743 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.206923 24535 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.997155 24715 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.207350 22222 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:21.208449 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.209004 22215 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:21.209409 24715 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.209491 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:20.977819 24631 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:21.210779 22142 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:21.211148 22214 raft_consensus.cc:1240] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:21.212224 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.212968 22214 raft_consensus.cc:2410] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:21.120460 24751 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.214934 24751 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.121605 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:21.215181 22213 raft_consensus.cc:1240] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:21.129338 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.216342 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.131435 24703 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:20.977906 22143 rpcz_store.cc:276] 0709 12:27:18.453788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.453930 (+   142us) service_pool.cc:224] Handling call
0709 12:27:18.454313 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.550380 (+ 96067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.550425 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.557092 (+  6667us) log.cc:844] Serialized 26 byte log entry
0709 12:27:19.087682 (+530590us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:19.087724 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.723306 (+1635582us) spinlock_profiling.cc:243] Waited 95.6 ms on lock 0x7b5400058054. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:20.723357 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.723408 (+    51us) raft_consensus.cc:1685] finished
0709 12:27:20.723423 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.723685 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167409,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":219894144,"thread_start_us":493546,"threads_started":1,"wal-append.queue_time_us":978970,"wal-append.run_cpu_time_us":10784,"wal-append.run_wall_time_us":1421695}
I20260709 12:27:21.218170 22143 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:21.132673 22801 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:21.133141 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:21.133255 24680 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.133905 24560 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:21.135183 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:21.239579 22144 raft_consensus.cc:2393] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 3: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:21.138196 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:21.240190 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.141064 24697 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.142504 24573 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:21.037375 24619 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:21.148197 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.148442 22037 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:21.147430 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 250025us
W20260709 12:27:21.170253 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 284801us
I20260709 12:27:21.198772 22186 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:21.199332 24761 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:21.145690 24763 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.182701 24274 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.202021 24592 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:21.217123 22216 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:21.217073 22219 raft_consensus.cc:2410] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:21.215210 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:21.220093 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 131516us
I20260709 12:27:21.283514 22773 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:21.284823 22773 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:21.285954 22773 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:21.220904 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.221408 22215 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 12.
I20260709 12:27:21.220367 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.286856 22222 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.287351 22218 raft_consensus.cc:2410] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:21.226953 22148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2256) took 1398 ms. Trace:
I20260709 12:27:21.287808 22148 rpcz_store.cc:276] 0709 12:27:19.828715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.863556 (+1034841us) service_pool.cc:224] Handling call
0709 12:27:20.863835 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.226697 (+362862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.226894 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:21.218065 24770 log.cc:927] Time spent T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:27:21.244045 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:21.269518 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.276432 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:21.292021 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 93343.8us
W20260709 12:27:21.278479 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 130143us
I20260709 12:27:21.267053 24688 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.268010 24560 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.336380 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:21.273020 24732 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:21.197134 24698 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:27:21.332804 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:21.354189 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 110232us
I20260709 12:27:21.355188 22112 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:21.333442 22114 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:21.270295 24619 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:21.292969 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 205330us
I20260709 12:27:21.275759 24718 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:21.349539 22222 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:21.292747 24751 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:21.290149 24763 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.362213 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.362409 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:21.392589 22071 raft_consensus.cc:2368] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3.
I20260709 12:27:21.363166 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.393353 22069 raft_consensus.cc:2393] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:21.363346 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.363672 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.364670 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:21.364964 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.366029 22068 raft_consensus.cc:1275] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:27:21.373850 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:21.278177 24607 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.393573 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.442013 24761 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:21.443104 24761 raft_consensus.cc:2804] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:21.443766 24761 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.444236 24761 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:21.444597 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 89505.9us
I20260709 12:27:21.446159 22112 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:21.447274 24437 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:21.447511 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.448051 24730 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:21.454849 22064 raft_consensus.cc:2393] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:21.292974 24627 consensus_queue.cc:1059] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:27:21.279798 24512 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.289793 24274 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.389526 22776 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:21.333811 24573 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.390473 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.442392 22067 raft_consensus.cc:2393] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:21.360203 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 303819us
I20260709 12:27:21.468176 22222 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.448921 22072 raft_consensus.cc:2393] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:21.394141 22065 raft_consensus.cc:2368] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5.
I20260709 12:27:21.449507 22073 raft_consensus.cc:2393] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:21.450534 22066 raft_consensus.cc:2376] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4. Re-sending same reply.
I20260709 12:27:21.293215 22186 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:21.419497 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 86141.5us
I20260709 12:27:21.452597 22219 raft_consensus.cc:2410] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:21.471364 22114 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:21.339687 24723 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:21.389178 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:21.324476 24592 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:27:21.334699 24253 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:27:21.277282 24715 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 12:27:21.509987 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
W20260709 12:27:21.462877 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 73448.3us
I20260709 12:27:21.450913 22068 pending_rounds.cc:85] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: Aborting all ops after (but not including) 2
I20260709 12:27:21.351444 24695 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.517638 22068 pending_rounds.cc:107] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:27:21.468708 22036 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:21.518749 22068 raft_consensus.cc:2889] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:21.519270 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 50665.7us
W20260709 12:27:21.375787 24743 log.cc:927] Time spent T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:27:21.504016 22070 raft_consensus.cc:2368] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
W20260709 12:27:21.503464 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 210291us
I20260709 12:27:21.540477 22186 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:21.444229 24762 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:21.503566 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.521696 22036 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:21.543124 22067 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:21.545363 22067 raft_consensus.cc:1275] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:27:21.545975 22067 pending_rounds.cc:85] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: Aborting all ops after (but not including) 2
I20260709 12:27:21.546365 22067 pending_rounds.cc:107] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:27:21.546957 22067 raft_consensus.cc:2889] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:21.547627 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.548866 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.420900 24751 raft_consensus.cc:697] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:21.537248 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.549501 22072 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:21.448182 24437 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:21.551254 22065 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:21.469959 24599 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.468210 24274 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.557096 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:21.345834 24713 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.587143 22066 raft_consensus.cc:1240] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:21.575937 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.537849 24444 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.587291 22073 raft_consensus.cc:2393] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:21.580878 24680 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:21.530673 22222 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:21.598763 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.495036 24512 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.604514 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.605284 22219 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:21.547012 24456 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.577980 24693 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:21.390305 24688 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.591828 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 717) took 2483 ms. Trace:
I20260709 12:27:21.576092 24501 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:21.588512 24762 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:21.583309 24599 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:21.593418 24444 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.553448 24607 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:27:21.590754 24631 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:21.618302 22803 rpcz_store.cc:276] 0709 12:27:19.108465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.445530 (+1337065us) service_pool.cc:224] Handling call
0709 12:27:20.445904 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.446149 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:20.889222 (+443073us) log.cc:844] Serialized 14 byte log entry
0709 12:27:21.590172 (+700950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:21.590707 (+   535us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:21.591576 (+   869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.591648 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.591773 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68826,"prepare.queue_time_us":688258,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":125929,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"thread_start_us":1073798,"threads_started":3,"wal-append.queue_time_us":529709}
W20260709 12:27:21.612985 24452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.012s	sys 0.027s
I20260709 12:27:21.585165 24730 consensus_queue.cc:1059] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:27:21.598913 24727 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:21.650835 24715 raft_consensus.cc:3055] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:21.651319 24715 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:21.651943 24688 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.615063 24693 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.652654 24693 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.652307 24715 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.650512 24727 raft_consensus.cc:697] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:21.654799 24727 consensus_queue.cc:237] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:21.658578 24452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.013s	sys 0.028s
I20260709 12:27:21.605804 24596 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:21.641673 24444 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.640678 24762 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.627799 24732 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.661476 24762 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:21.648489 24772 log.cc:927] Time spent T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:27:21.642371 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.664331 22219 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:21.665460 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.675897 22185 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:21.636759 24599 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:21.707643 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:21.680208 24611 consensus_meta.cc:287] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.000s
I20260709 12:27:21.640844 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 716) took 2538 ms. Trace:
I20260709 12:27:21.642046 24778 raft_consensus.cc:2804] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:21.697887 24688 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:21.698998 24755 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.748147 24444 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.763599 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:21.768497 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 482589us
I20260709 12:27:21.769381 22773 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:21.698516 24501 consensus_queue.cc:1059] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:27:21.732554 24703 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.780212 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.780974 22215 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 1.
I20260709 12:27:21.785341 22773 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:21.787317 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.787184 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.738541 24757 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:21.645004 24751 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.750488 24444 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:21.825891 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.800565 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.833508 22215 raft_consensus.cc:2368] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4.
I20260709 12:27:21.756172 24754 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:21.757131 24778 raft_consensus.cc:697] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:21.845666 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.850090 22215 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:21.873219 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:21.873966 22213 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.841271 24733 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.875087 24733 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:21.875665 24691 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:21.876499 24691 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:21.877131 24691 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.877638 24691 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.878895 24682 consensus_queue.cc:1059] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:21.879709 24682 consensus_queue.cc:1243] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:21.881346 24774 raft_consensus.cc:3055] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:21.881806 24774 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:21.883991 24763 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:21.886765 24732 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:21.887328 24732 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.889294 22071 raft_consensus.cc:2368] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3.
I20260709 12:27:21.889568 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:21.890270 22215 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:21.893685 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:21.894483 22221 consensus_meta.cc:287] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
I20260709 12:27:21.895432 22221 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:21.837462 24596 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.886356 24763 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:21.917677 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 407389us
I20260709 12:27:21.791970 24703 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:21.927882 22145 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.006s	sys 0.047s
W20260709 12:27:21.928728 22145 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.006s	sys 0.047s
I20260709 12:27:21.913690 22214 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:21.912135 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:21.914247 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.871181 24444 consensus_queue.cc:1059] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:27:21.882663 24774 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:21.912972 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:22.118731 22113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.166070 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2326) took 1019 ms. Trace:
W20260709 12:27:21.927386 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 371018us
I20260709 12:27:22.345376 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2334) took 1136 ms. Trace:
W20260709 12:27:22.101423 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.547030 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.548153 24775 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:22.012913 24631 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.548789 24775 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:21.989244 24791 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:22.549676 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:22.127023 24592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.017s	sys 0.019s
W20260709 12:27:22.550455 24592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.018s	sys 0.037s
I20260709 12:27:22.551093 24592 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.551849 24775 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:22.167192 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:22.468515 22142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.019s
I20260709 12:27:21.934585 24512 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:22.051776 24619 consensus_meta.cc:287] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.000s
I20260709 12:27:22.553915 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:22.554260 22145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.006s	sys 0.035s
W20260709 12:27:22.554754 22145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.006s	sys 0.035s
W20260709 12:27:22.224509 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 439231us
I20260709 12:27:22.012012 22114 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:22.346200 22139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.011s	sys 0.010s
W20260709 12:27:22.556567 22139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.017s	sys 0.014s
W20260709 12:27:22.455087 22140 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.016s	sys 0.010s
I20260709 12:27:22.025992 24763 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:22.010457 22141 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.017s	sys 0.023s
W20260709 12:27:22.558506 22141 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.017s	sys 0.043s
I20260709 12:27:21.989425 24754 consensus_queue.cc:1059] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.564s
W20260709 12:27:22.109776 22216 consensus_meta.cc:287] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.816s	user 0.004s	sys 0.004s
W20260709 12:27:22.346381 22112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.001s	sys 0.021s
I20260709 12:27:22.572845 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1704) took 2175 ms. Trace:
I20260709 12:27:22.574522 22216 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
W20260709 12:27:22.574223 22112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.004s	sys 0.026s
I20260709 12:27:22.225512 22221 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:27:22.136042 24761 consensus_meta.cc:287] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.003s
W20260709 12:27:22.582814 22216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2331) took 1367 ms (client timeout 1819 ms). Trace:
W20260709 12:27:22.557457 22140 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.018s	sys 0.011s
I20260709 12:27:22.545688 22214 rpcz_store.cc:276] 0709 12:27:21.208751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.213430 (+  4679us) service_pool.cc:224] Handling call
0709 12:27:21.896513 (+683083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:22.224658 (+328145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:22.345041 (+120383us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b5400088ed0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:22.345266 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570310912}
I20260709 12:27:22.548869 24631 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:22.557965 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.026968 24718 consensus_meta.cc:287] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.002s
I20260709 12:27:22.495586 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44992 (request call id 1562) took 1109 ms. Trace:
I20260709 12:27:22.551599 24592 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:22.214744 22807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.021s	sys 0.045s
W20260709 12:27:22.658850 22807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.038s	sys 0.059s
I20260709 12:27:22.555828 22773 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:22.403772 24688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.015s
W20260709 12:27:22.230666 22146 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.009s	sys 0.007s
W20260709 12:27:22.192209 22036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.005s	sys 0.013s
W20260709 12:27:22.675817 22146 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.009s	sys 0.026s
I20260709 12:27:21.721808 22802 rpcz_store.cc:276] 0709 12:27:19.100562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.607952 (+507390us) service_pool.cc:224] Handling call
0709 12:27:19.750437 (+142485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:19.777668 (+ 27231us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:21.202980 (+1425312us) log.cc:844] Serialized 14 byte log entry
0709 12:27:21.592857 (+389877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:21.597394 (+  4537us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:21.600596 (+  3202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.611755 (+ 11159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.638186 (+ 26431us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38752,"prepare.queue_time_us":1256541,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":166094,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":16753,"thread_start_us":1523585,"threads_started":2,"wal-append.queue_time_us":667658}
I20260709 12:27:22.579669 22809 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:22.553192 22142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.000s	sys 0.022s
I20260709 12:27:22.424084 24691 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:22.560382 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 548443us
I20260709 12:27:22.580188 22145 rpcz_store.cc:276] 0709 12:27:20.397406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.205092 (+807686us) service_pool.cc:224] Handling call
0709 12:27:21.205380 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.205561 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:21.929732 (+724171us) log.cc:844] Serialized 14 byte log entry
0709 12:27:22.572488 (+642756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:22.572553 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:22.572606 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:22.572668 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:22.572785 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68003,"prepare.queue_time_us":454083,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":24,"thread_start_us":1231656,"threads_started":2}
I20260709 12:27:22.680997 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1705) took 2283 ms. Trace:
W20260709 12:27:22.581207 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 1.13309e+06us
W20260709 12:27:22.488283 24690 consensus_meta.cc:287] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 1.291s	user 0.011s	sys 0.001s
I20260709 12:27:22.681347 22142 rpcz_store.cc:276] 0709 12:27:20.397691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.212837 (+815146us) service_pool.cc:224] Handling call
0709 12:27:21.213104 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.213290 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:21.824512 (+611222us) log.cc:844] Serialized 14 byte log entry
0709 12:27:22.680532 (+856020us) log.cc:844] Serialized 14 byte log entry
0709 12:27:22.680678 (+   146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:22.680722 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:22.680772 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:22.680835 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:22.680943 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117005,"prepare.queue_time_us":446504,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"thread_start_us":1325978,"threads_started":2}
I20260709 12:27:22.683187 22221 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:22.683770 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2352) took 1040 ms. Trace:
I20260709 12:27:22.684067 22221 rpcz_store.cc:276] 0709 12:27:21.643437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.911847 (+268410us) service_pool.cc:224] Handling call
0709 12:27:22.683698 (+771851us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:21.927232 24437 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:22.336942 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:22.097600 24787 log.cc:927] Time spent T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:27:22.230585 24727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.009s	sys 0.009s
I20260709 12:27:22.673980 24749 raft_consensus.cc:2804] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:22.191255 24778 consensus_queue.cc:237] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:22.223826 24500 raft_consensus.cc:3055] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:22.735953 24500 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:22.736939 24500 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:22.211819 22185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.010s	sys 0.009s
W20260709 12:27:22.738701 22185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.012s	sys 0.021s
W20260709 12:27:22.739142 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 1.05302e+06us
W20260709 12:27:22.741080 22213 consensus_meta.cc:287] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.825s	user 0.007s	sys 0.003s
I20260709 12:27:22.741911 22213 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:22.673799 24444 raft_consensus.cc:3055] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:22.136384 24697 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:22.245973 22147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.000s	sys 0.020s
W20260709 12:27:22.748977 22147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.008s	sys 0.031s
I20260709 12:27:22.225800 22220 rpcz_store.cc:276] 0709 12:27:21.146395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.150092 (+  3697us) service_pool.cc:224] Handling call
0709 12:27:21.150398 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:21.197175 (+ 46777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:21.197205 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:21.227820 (+ 30615us) log.cc:844] Serialized 26 byte log entry
0709 12:27:21.700664 (+472844us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:21.700715 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.700810 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:22.165824 (+465014us) raft_consensus.cc:1685] finished
0709 12:27:22.165846 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:22.165999 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14729,"raft.queue_time_us":15857,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":372803,"threads_started":1,"wal-append.queue_time_us":777454}
I20260709 12:27:22.749966 22147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1697) took 2429 ms. Trace:
I20260709 12:27:22.750384 22147 rpcz_store.cc:276] 0709 12:27:20.322424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.982183 (+659759us) service_pool.cc:224] Handling call
0709 12:27:20.982475 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.983210 (+   735us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:21.339488 (+356278us) log.cc:844] Serialized 14 byte log entry
0709 12:27:22.749492 (+1410004us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:22.749574 (+    82us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:22.749635 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:22.749721 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:22.749886 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":606763,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":1751259,"threads_started":2}
I20260709 12:27:22.675367 24715 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:22.675876 22036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.007s	sys 0.025s
W20260709 12:27:22.246157 22776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.007s	sys 0.013s
I20260709 12:27:22.686944 22071 rpcz_store.cc:276] 0709 12:27:21.386272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.494272 (+108000us) service_pool.cc:224] Handling call
0709 12:27:22.495313 (+1001041us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54001d65d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:22.495501 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783838464}
W20260709 12:27:22.541178 24779 log.cc:927] Time spent T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.804s	user 0.003s	sys 0.000s
I20260709 12:27:22.689847 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:22.659174 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 746219us
I20260709 12:27:22.762723 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:22.763392 22038 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:22.765079 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:22.589265 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:22.766753 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1917) took 1070 ms. Trace:
I20260709 12:27:22.767117 22218 rpcz_store.cc:276] 0709 12:27:21.696091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.588937 (+892846us) service_pool.cc:224] Handling call
0709 12:27:22.766690 (+177753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:22.768167 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:22.768733 22218 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:22.769171 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2359) took 1118 ms. Trace:
I20260709 12:27:22.769444 22218 rpcz_store.cc:276] 0709 12:27:21.650277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.767892 (+1117615us) service_pool.cc:224] Handling call
0709 12:27:22.769121 (+  1229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:22.463762 24501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.006s	sys 0.015s
I20260709 12:27:22.718858 24774 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:22.230743 24452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.008s
W20260709 12:27:22.583853 22216 rpcz_store.cc:269] 0709 12:27:21.207775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.216102 (+  8327us) service_pool.cc:224] Handling call
0709 12:27:22.574985 (+1358883us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:22.777938 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 718) took 3646 ms. Trace:
I20260709 12:27:22.713819 24806 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:22.709385 22217 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 12.
W20260709 12:27:22.712477 22188 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.996s (SENT)
I20260709 12:27:22.712400 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:22.674855 24688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.006s	sys 0.020s
I20260709 12:27:22.717207 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:22.718194 22803 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:22.716941 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:22.717329 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:22.716939 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:22.769691 24693 consensus_meta.cc:287] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 1.117s	user 0.007s	sys 0.004s
W20260709 12:27:22.193295 24788 log.cc:927] Time spent T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 12:27:22.723599 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:22.572497 24775 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.365885 24593 raft_consensus.cc:3055] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:22.723021 24718 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.735424 24437 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.742493 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2351) took 1126 ms. Trace:
I20260709 12:27:22.817942 22213 rpcz_store.cc:276] 0709 12:27:21.615710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.836356 (+220646us) service_pool.cc:224] Handling call
0709 12:27:22.742413 (+906057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:22.819159 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:22.579276 24583 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:22.744313 22072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:22.660394 24733 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:22.751088 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:22.555382 24713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.015s	sys 0.010s
I20260709 12:27:21.926373 24596 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:22.554006 24619 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:22.717242 24727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.013s	sys 0.025s
I20260709 12:27:22.755323 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1694) took 2471 ms. Trace:
I20260709 12:27:22.698107 24690 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:22.757589 22776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.245s	user 0.016s	sys 0.020s
W20260709 12:27:22.757341 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 1.21404e+06us
I20260709 12:27:22.860028 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:22.600587 24767 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:22.212875 24785 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.771883 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2356) took 1122 ms. Trace:
I20260709 12:27:22.875075 22214 rpcz_store.cc:276] 0709 12:27:21.649269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.675493 (+1026224us) service_pool.cc:224] Handling call
0709 12:27:22.771820 (+ 96327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:22.770361 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:22.874811 22775 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.020s	sys 0.045s
I20260709 12:27:22.550089 24791 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:22.773607 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:22.783238 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:22.709815 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:22.784350 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:22.820855 24593 raft_consensus.cc:740] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:22.786717 24452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.010s	sys 0.043s
I20260709 12:27:22.722980 24749 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:22.788872 22188 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:22.789093 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1913) took 1201 ms. Trace:
I20260709 12:27:22.721975 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:22.783006 22807 rpcz_store.cc:276] 0709 12:27:19.131195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.458642 (+1327447us) service_pool.cc:224] Handling call
0709 12:27:20.470066 (+ 11424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.062066 (+592000us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:21.591162 (+529096us) log.cc:844] Serialized 14 byte log entry
0709 12:27:22.687900 (+1096738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:22.687966 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:22.688011 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:22.777634 (+ 89623us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400570154. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:22.777694 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:22.777866 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49657,"prepare.queue_time_us":72803,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"spinlock_wait_cycles":1360966400,"thread_start_us":1530264,"threads_started":2}
W20260709 12:27:22.771311 24501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.010s	sys 0.021s
W20260709 12:27:22.777478 24623 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.037s	sys 0.056s
I20260709 12:27:22.752938 24444 raft_consensus.cc:740] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:22.760788 24758 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:22.583585 24763 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:22.754247 24805 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:22.659848 24761 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:22.943156 24805 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:22.944604 24761 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:22.929737 24808 log.cc:927] Time spent T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:27:22.821851 22072 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:22.771102 24512 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:22.774533 24697 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:22.947623 24697 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:22.949378 24703 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:22.949671 24697 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:22.770712 24804 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:22.867960 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 1.35588e+06us
I20260709 12:27:22.951694 22776 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:22.869520 22070 raft_consensus.cc:2393] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
W20260709 12:27:22.876364 22775 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.020s	sys 0.045s
W20260709 12:27:22.954772 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 647326us
W20260709 12:27:22.832886 24713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.018s	sys 0.014s
I20260709 12:27:22.780223 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:22.878513 22219 raft_consensus.cc:2410] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:22.795514 24688 raft_consensus.cc:697] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:22.826119 24732 consensus_meta.cc:287] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.938s	user 0.008s	sys 0.004s
I20260709 12:27:22.905187 22145 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:22.906688 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:22.911489 22064 raft_consensus.cc:1240] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:22.957438 22775 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:22.998811 22147 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.006888 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:23.007468 22810 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:22.998286 22037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.045s	sys 0.056s
W20260709 12:27:23.009014 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.046s	sys 0.056s
I20260709 12:27:23.008947 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:22.826246 24718 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:23.009354 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 729612us
I20260709 12:27:22.828315 24730 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.909973 22217 rpcz_store.cc:276] 0709 12:27:21.587290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.336605 (+749315us) service_pool.cc:224] Handling call
0709 12:27:22.789023 (+452418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:22.919312 24749 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:22.827195 24583 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:22.920126 22216 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:23.051813 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1922) took 1126 ms. Trace:
I20260709 12:27:23.052237 22216 rpcz_store.cc:276] 0709 12:27:21.925228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.782945 (+857717us) service_pool.cc:224] Handling call
0709 12:27:23.051727 (+268782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:22.918599 22073 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:23.015924 24274 consensus_meta.cc:287] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 1.420s	user 0.008s	sys 0.004s
W20260709 12:27:22.929477 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 217038us
I20260709 12:27:22.870325 24817 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.798099 24806 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:22.823037 24693 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:22.940303 24763 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:22.904963 24785 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:22.929617 24444 consensus_queue.cc:260] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:22.942394 24592 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:22.959438 22805 raft_consensus.cc:1275] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:27:22.945510 24805 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:22.964589 24815 log.cc:927] Time spent T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 12:27:22.965241 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:22.923897 24623 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.038s	sys 0.056s
W20260709 12:27:22.969619 24560 consensus_meta.cc:287] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.610s	user 0.009s	sys 0.000s
W20260709 12:27:22.973310 24573 consensus_meta.cc:287] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 1.463s	user 0.009s	sys 0.003s
W20260709 12:27:22.977524 24456 consensus_meta.cc:287] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.361s	user 0.009s	sys 0.000s
I20260709 12:27:22.455435 24799 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:22.924420 24452 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:22.989104 24791 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:22.995165 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:22.996007 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:23.235905 22809 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:23.115113 24599 consensus_meta.cc:287] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.386s	user 0.009s	sys 0.003s
W20260709 12:27:22.917850 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 144307us
I20260709 12:27:22.830240 24691 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:22.828689 24437 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:22.928318 24767 raft_consensus.cc:697] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:23.034192 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:23.035477 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:22.860168 22139 rpcz_store.cc:276] 0709 12:27:20.283833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.919094 (+635261us) service_pool.cc:224] Handling call
0709 12:27:20.955547 (+ 36453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.182658 (+227111us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:21.538615 (+355957us) log.cc:844] Serialized 14 byte log entry
0709 12:27:22.572595 (+1033980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:22.572644 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:22.572691 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:22.754989 (+182298us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400406d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:22.755050 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:22.755243 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":476388,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":101990,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":71,"spinlock_wait_cycles":521695104,"thread_start_us":1336410,"threads_started":2}
I20260709 12:27:23.061993 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:23.062330 24818 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:27:23.062846 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:23.063174 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:23.255362 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1925) took 1200 ms. Trace:
I20260709 12:27:23.062884 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:23.003510 24802 raft_consensus.cc:2804] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:23.084317 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:23.255810 22217 rpcz_store.cc:276] 0709 12:27:22.055409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.020398 (+964989us) service_pool.cc:224] Handling call
0709 12:27:23.255289 (+234891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:23.256945 22216 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:23.083374 24274 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:23.176365 22221 raft_consensus.cc:2368] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4.
I20260709 12:27:23.235181 24573 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:23.052251 24730 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:23.196290 22222 raft_consensus.cc:2368] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5.
W20260709 12:27:23.231950 22186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.008s
I20260709 12:27:23.233040 22806 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:27:23.231966 22141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.012s	sys 0.005s
I20260709 12:27:23.234536 22143 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:23.097271 24631 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:22.997249 22801 raft_consensus.cc:1240] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:27:22.832314 24775 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:23.281886 24775 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:23.282727 22142 raft_consensus.cc:2393] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 2: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:23.283718 22111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.003s	sys 0.019s
W20260709 12:27:23.231178 24753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.011s	sys 0.010s
W20260709 12:27:23.240420 22219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1916) took 1599 ms (client timeout 1614 ms). Trace:
W20260709 12:27:23.246263 22146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.004s	sys 0.011s
W20260709 12:27:23.297096 22146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.005s	sys 0.011s
I20260709 12:27:23.022491 24593 consensus_queue.cc:260] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:23.246152 22038 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:23.235335 24560 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:23.249342 22144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.012s	sys 0.005s
I20260709 12:27:23.250496 22810 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.249913 22218 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:23.247864 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:23.181720 24592 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:23.257381 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1928) took 1154 ms. Trace:
I20260709 12:27:23.007437 24732 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:23.255745 22808 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
W20260709 12:27:23.236693 24595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.010s
I20260709 12:27:23.259057 22145 raft_consensus.cc:2368] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:23.238375 24456 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.331113 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:23.331772 24809 log.cc:927] Time spent T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 12:27:23.176964 22805 pending_rounds.cc:85] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting all ops after (but not including) 5
I20260709 12:27:23.332451 22805 pending_rounds.cc:107] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:27:23.332751 22805 raft_consensus.cc:2889] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.333880 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:23.260759 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:23.262682 22186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.007s	sys 0.008s
W20260709 12:27:23.262884 22141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.013s	sys 0.005s
W20260709 12:27:23.265056 22185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.013s
I20260709 12:27:23.271859 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:23.272318 22215 raft_consensus.cc:2410] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:27:23.284673 22111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.003s	sys 0.020s
I20260709 12:27:23.251543 24444 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:23.336052 22185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.005s	sys 0.013s
W20260709 12:27:23.336375 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 593828us
I20260709 12:27:23.337438 22068 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
W20260709 12:27:23.338861 22114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.008s	sys 0.034s
I20260709 12:27:23.095284 24817 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:23.296025 24753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.011s	sys 0.011s
W20260709 12:27:23.295931 22140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.012s	sys 0.007s
I20260709 12:27:23.258523 24802 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.083904 24816 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:23.323704 22144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.013s	sys 0.018s
I20260709 12:27:23.324137 22214 raft_consensus.cc:2410] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:27:23.296355 22219 rpcz_store.cc:269] 0709 12:27:21.641357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.665042 (+ 23685us) service_pool.cc:224] Handling call
0709 12:27:23.240201 (+1575159us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001f4354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:23.240354 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786985344}
I20260709 12:27:23.243378 24688 consensus_queue.cc:237] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:23.325920 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 79856.2us
I20260709 12:27:23.324342 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1918) took 1593 ms. Trace:
I20260709 12:27:23.325734 22216 rpcz_store.cc:276] 0709 12:27:22.103214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.053011 (+949797us) service_pool.cc:224] Handling call
0709 12:27:23.257325 (+204314us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:23.258559 24754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.004s	sys 0.013s
I20260709 12:27:23.260524 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1924) took 1269 ms. Trace:
W20260709 12:27:23.339141 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 612605us
I20260709 12:27:23.339799 22803 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:23.334520 22805 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
W20260709 12:27:23.285591 22071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.034s	sys 0.039s
I20260709 12:27:23.294936 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:23.347541 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.254679 24599 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:23.295526 22773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.006s	sys 0.014s
I20260709 12:27:23.347014 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1707) took 2948 ms. Trace:
W20260709 12:27:23.332178 24595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.005s	sys 0.010s
W20260709 12:27:23.327279 24778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.015s	sys 0.042s
W20260709 12:27:24.054251 22809 consensus_meta.cc:287] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.000s
W20260709 12:27:24.032511 22147 consensus_meta.cc:287] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.027s	user 0.010s	sys 0.000s
W20260709 12:27:23.873770 22072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.016s	sys 0.012s
W20260709 12:27:24.049261 22071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.041s	sys 0.049s
W20260709 12:27:24.054777 22214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2353) took 2406 ms (client timeout 2537 ms). Trace:
I20260709 12:27:24.070586 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2079) took 1385 ms. Trace:
W20260709 12:27:24.051203 22217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1909) took 2599 ms (client timeout 2965 ms). Trace:
I20260709 12:27:24.208443 22148 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:24.050426 22038 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:24.259931 22809 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:24.050312 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1717) took 1367 ms. Trace:
I20260709 12:27:23.832466 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1718) took 1149 ms. Trace:
I20260709 12:27:24.260597 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2090) took 1528 ms. Trace:
W20260709 12:27:24.261560 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:24.265532 22773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.015s	sys 0.031s
W20260709 12:27:24.249020 22810 consensus_meta.cc:287] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.925s	user 0.008s	sys 0.000s
I20260709 12:27:24.051939 22218 rpcz_store.cc:276] 0709 12:27:21.731135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.020241 (+1289106us) service_pool.cc:224] Handling call
0709 12:27:23.324256 (+304015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.258997 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 648) took 1240 ms. Trace:
I20260709 12:27:24.258214 22221 rpcz_store.cc:276] 0709 12:27:21.991089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.924069 (+932980us) service_pool.cc:224] Handling call
0709 12:27:23.260450 (+336381us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:24.027307 22807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.001s	sys 0.015s
W20260709 12:27:24.270583 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:23.889647 24827 log.cc:927] Time spent T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 12:27:23.888779 24836 log.cc:927] Time spent T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 12:27:23.729157 24821 log.cc:927] Time spent T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.641s	user 0.000s	sys 0.001s
I20260709 12:27:24.270169 22143 rpcz_store.cc:276] 0709 12:27:22.682794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.682931 (+   137us) service_pool.cc:224] Handling call
0709 12:27:23.832227 (+1149296us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400379bd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:23.832384 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007555840}
W20260709 12:27:23.918177 24680 consensus_meta.cc:287] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 2.074s	user 0.014s	sys 0.000s
I20260709 12:27:24.271754 22810 raft_consensus.cc:2468] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:23.334939 24763 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:24.055200 24754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.452s	user 0.018s	sys 0.019s
W20260709 12:27:24.267370 22214 rpcz_store.cc:269] 0709 12:27:21.648147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.247583 (+1599436us) service_pool.cc:224] Handling call
0709 12:27:24.054705 (+807122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:24.266110 22140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.579s	user 0.029s	sys 0.022s
W20260709 12:27:24.273236 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 222872us
I20260709 12:27:24.063867 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:23.385939 22036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.015s
W20260709 12:27:24.261090 22114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.580s	user 0.020s	sys 0.049s
I20260709 12:27:23.461957 22037 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:24.288677 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.288173 22038 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:24.288697 22036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.017s	sys 0.034s
I20260709 12:27:23.777565 24758 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:27:23.890496 24830 log.cc:927] Time spent T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 12:27:24.270509 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 1.71466e+06us
W20260709 12:27:24.105177 24715 consensus_meta.cc:287] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.330s	user 0.010s	sys 0.001s
W20260709 12:27:24.092092 24749 consensus_meta.cc:287] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.007s	user 0.009s	sys 0.000s
I20260709 12:27:24.269742 22144 rpcz_store.cc:276] 0709 12:27:22.682471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.682584 (+   113us) service_pool.cc:224] Handling call
0709 12:27:22.716933 (+ 34349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:22.717154 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:22.717468 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 12:27:24.049985 (+1332517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:24.050038 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:24.050095 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.050157 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.050260 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5934,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":4599,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":146,"thread_start_us":1332191,"threads_started":1,"wal-append.queue_time_us":1190898}
W20260709 12:27:23.543172 24807 log.cc:927] Time spent T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.480s	user 0.000s	sys 0.001s
I20260709 12:27:23.294994 24596 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:24.271121 22147 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:23.325580 24592 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:23.371721 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 414362us
W20260709 12:27:24.300153 22147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1723) took 1558 ms (client timeout 1792 ms). Trace:
W20260709 12:27:24.276876 22807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.003s	sys 0.018s
W20260709 12:27:23.708850 24727 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.013s	sys 0.014s
W20260709 12:27:24.119187 24799 consensus_meta.cc:287] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.000s
I20260709 12:27:23.785810 24698 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:27:24.067708 22804 consensus_meta.cc:287] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.000s
W20260709 12:27:24.006680 24623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.022s	sys 0.009s
I20260709 12:27:24.049747 22141 rpcz_store.cc:276] 0709 12:27:20.398154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.215900 (+817746us) service_pool.cc:224] Handling call
0709 12:27:21.216204 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.216396 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:22.572119 (+1355723us) log.cc:844] Serialized 14 byte log entry
0709 12:27:23.346583 (+774464us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:23.346665 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:23.346719 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:23.346791 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:23.346946 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144847,"prepare.queue_time_us":501898,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":11939,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":28029,"thread_start_us":1873202,"threads_started":2,"wal-append.queue_time_us":1521140}
W20260709 12:27:24.078135 24444 consensus_meta.cc:287] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.705s	user 0.006s	sys 0.000s
W20260709 12:27:24.261042 24778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.488s	user 0.028s	sys 0.071s
W20260709 12:27:23.775780 24814 log.cc:927] Time spent T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.589s	user 0.000s	sys 0.000s
I20260709 12:27:23.300405 24822 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.270004 22066 rpcz_store.cc:276] 0709 12:27:22.732769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.791296 (+ 58527us) service_pool.cc:224] Handling call
0709 12:27:22.824848 (+ 33552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:22.856861 (+ 32013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:22.856906 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:22.857542 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 12:27:23.397637 (+540095us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:23.397687 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:23.397765 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:24.222129 (+824364us) raft_consensus.cc:1685] finished
0709 12:27:24.222153 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.260536 (+ 38383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25248,"raft.queue_time_us":145,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":19877,"thread_start_us":461475,"threads_started":1,"wal-append.queue_time_us":1304001}
W20260709 12:27:24.281816 22810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 649) took 1262 ms (client timeout 1513 ms). Trace:
I20260709 12:27:24.271529 22805 rpcz_store.cc:276] 0709 12:27:23.018764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.333624 (+314860us) service_pool.cc:224] Handling call
0709 12:27:24.258933 (+925309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.282069 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.271212 22069 rpcz_store.cc:276] 0709 12:27:22.685644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.688654 (+  3010us) service_pool.cc:224] Handling call
0709 12:27:22.728861 (+ 40207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:22.729099 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:22.729127 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:22.739935 (+ 10808us) log.cc:844] Serialized 26 byte log entry
0709 12:27:23.247547 (+507612us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:23.247586 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:23.247650 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:24.070345 (+822695us) raft_consensus.cc:1685] finished
0709 12:27:24.070367 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.070520 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":485015,"threads_started":1,"wal-append.queue_time_us":1245422}
I20260709 12:27:24.015496 24834 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.067896 24583 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:24.284200 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.322417 22219 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:24.270123 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 641) took 1316 ms. Trace:
I20260709 12:27:24.303350 24837 consensus_queue.cc:1059] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:27:24.323503 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682"
I20260709 12:27:24.300438 24763 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:24.322945 22809 rpcz_store.cc:276] 0709 12:27:22.953760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.995763 (+ 42003us) service_pool.cc:224] Handling call
0709 12:27:24.270057 (+1274294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.324214 22068 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:24.324883 24500 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.325078 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:24.325877 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 654) took 1149 ms. Trace:
I20260709 12:27:24.326215 22809 rpcz_store.cc:276] 0709 12:27:23.176635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.324834 (+1148199us) service_pool.cc:224] Handling call
0709 12:27:24.325815 (+   981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.048903 24732 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:24.049152 24593 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.895534 24560 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:24.054664 24730 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:24.324375 24763 raft_consensus.cc:697] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:24.069995 24437 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:24.067907 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:24.066179 24817 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:24.149513 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:24.069109 24274 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:24.286578 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:24.287106 22142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1719) took 1604 ms (client timeout 1542 ms). Trace:
W20260709 12:27:24.288810 22216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 494) took 1705 ms (client timeout 1923 ms). Trace:
I20260709 12:27:24.305374 24698 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:23.502108 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 414620us
W20260709 12:27:24.267802 22217 rpcz_store.cc:269] 0709 12:27:21.451824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.263179 (+1811355us) service_pool.cc:224] Handling call
0709 12:27:24.051126 (+787947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:23.374403 22185 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:24.266548 22072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.021s	sys 0.015s
I20260709 12:27:24.267331 24718 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:24.059028 24806 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:24.382486 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 1.00811e+06us
W20260709 12:27:24.289759 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 1.42504e+06us
I20260709 12:27:24.272166 24845 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:24.288053 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1699) took 3921 ms. Trace:
W20260709 12:27:24.289438 22221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1919) took 2531 ms (client timeout 2828 ms). Trace:
W20260709 12:27:24.295814 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 833890us
W20260709 12:27:24.399688 22221 rpcz_store.cc:269] 0709 12:27:21.758363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.278339 (+2519976us) service_pool.cc:224] Handling call
0709 12:27:24.289368 (+ 11029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.273851 24802 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:24.300877 22147 rpcz_store.cc:269] 0709 12:27:22.741366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.779898 (+ 38532us) service_pool.cc:224] Handling call
0709 12:27:24.300086 (+1520188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.300160 24607 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.303011 24840 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:24.426007 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:24.298331 24754 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.301167 24775 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.295899 24758 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:24.320003 22218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1931) took 1958 ms (client timeout 2213 ms). Trace:
W20260709 12:27:24.447137 22218 rpcz_store.cc:269] 0709 12:27:22.361592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.276272 (+1914680us) service_pool.cc:224] Handling call
0709 12:27:24.319933 (+ 43661us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.448314 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:24.320463 22810 rpcz_store.cc:269] 0709 12:27:23.019047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.035192 (+ 16145us) service_pool.cc:224] Handling call
0709 12:27:24.281757 (+1246565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.323720 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:23.783702 24785 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:24.324478 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:24.467815 22073 raft_consensus.cc:2393] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 3: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:24.468700 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:24.468854 24775 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.469363 22073 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:24.449676 24840 raft_consensus.cc:697] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:24.324541 22219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2346) took 2981 ms (client timeout 3226 ms). Trace:
I20260709 12:27:24.328822 22114 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:24.332078 22068 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:24.472007 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:23.544649 24767 consensus_queue.cc:237] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:24.470866 22219 rpcz_store.cc:269] 0709 12:27:21.343610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.275158 (+2931548us) service_pool.cc:224] Handling call
0709 12:27:24.324481 (+ 49323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.303632 24592 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:24.474473 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.475368 22219 raft_consensus.cc:2410] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:24.337399 22069 raft_consensus.cc:1240] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:24.475850 22219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1905) took 3137 ms (client timeout 3909 ms). Trace:
W20260709 12:27:24.321869 24623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.028s	sys 0.010s
I20260709 12:27:24.336549 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2089) took 1648 ms. Trace:
I20260709 12:27:24.306968 24596 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:24.358157 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:24.485765 22218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 498) took 1771 ms (client timeout 2244 ms). Trace:
W20260709 12:27:24.381470 22142 rpcz_store.cc:269] 0709 12:27:22.683061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.709514 (+ 26453us) service_pool.cc:224] Handling call
0709 12:27:24.286912 (+1577398us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54000c99d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:24.287047 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932400512}
W20260709 12:27:24.382442 22188 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 3.143s (SENT)
W20260709 12:27:24.486239 22218 rpcz_store.cc:269] 0709 12:27:22.714726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.447998 (+1733272us) service_pool.cc:224] Handling call
0709 12:27:24.485693 (+ 37695us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.486811 22188 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:24.381274 22216 rpcz_store.cc:269] 0709 12:27:22.583240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.063609 (+1480369us) service_pool.cc:224] Handling call
0709 12:27:24.288757 (+225148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.385444 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 656) took 1132 ms. Trace:
I20260709 12:27:24.487816 22809 rpcz_store.cc:276] 0709 12:27:23.253275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.326869 (+1073594us) service_pool.cc:224] Handling call
0709 12:27:24.384859 (+ 57990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.385056 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.385084 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:24.385151 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:24.385186 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.385240 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.385372 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.390295 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:24.489940 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:24.490866 22141 raft_consensus.cc:2410] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:24.491668 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:24.394469 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:24.492655 22143 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:24.397236 22144 raft_consensus.cc:1240] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:24.399693 22140 rpcz_store.cc:276] 0709 12:27:20.366647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.204173 (+837526us) service_pool.cc:224] Handling call
0709 12:27:21.204461 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.204655 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:22.686507 (+1481852us) log.cc:844] Serialized 14 byte log entry
0709 12:27:24.287785 (+1601278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:24.287835 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:24.287879 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.287928 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.288009 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23252,"prepare.queue_time_us":454656,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":2479,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":3013090,"threads_started":2,"wal-append.queue_time_us":711634}
I20260709 12:27:24.307422 22804 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:24.418663 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.497788 22217 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:24.486124 22805 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:24.498363 22217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 491) took 1919 ms (client timeout 2069 ms). Trace:
I20260709 12:27:24.498574 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 657) took 1227 ms. Trace:
W20260709 12:27:24.499095 22217 rpcz_store.cc:269] 0709 12:27:22.579420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.381682 (+1802262us) service_pool.cc:224] Handling call
0709 12:27:24.498303 (+116621us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:24.397773 22185 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 1.542s (SENT)
I20260709 12:27:24.430469 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:24.500270 22145 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.300981 24749 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:24.441097 24852 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 12:27:23.300758 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:51416 (local address 127.20.109.68:41677)
0709 12:27:24.216840 (+916082us) server_negotiation.cc:207] Beginning negotiation
0709 12:27:24.216874 (+    34us) server_negotiation.cc:400] Waiting for connection header
0709 12:27:24.216943 (+    69us) server_negotiation.cc:408] Connection header received
0709 12:27:24.217151 (+   208us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 12:27:24.217181 (+    30us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 12:27:24.217487 (+   306us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 12:27:24.217750 (+   263us) server_negotiation.cc:227] Negotiated authn=SASL
0709 12:27:24.229687 (+ 11937us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51416: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":888368,"thread_start_us":342010,"threads_started":1}
I20260709 12:27:24.442556 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.444507 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:24.498993 22805 rpcz_store.cc:276] 0709 12:27:23.271719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.327705 (+1055986us) service_pool.cc:224] Handling call
0709 12:27:24.498514 (+170809us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:24.502998 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 105297us
I20260709 12:27:24.398869 22801 raft_consensus.cc:1813] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Handling vote request from an unknown peer 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:24.456907 24763 consensus_queue.cc:237] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:24.397838 24444 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:24.424912 24845 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.462710 22802 raft_consensus.cc:2393] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:24.431849 24560 consensus_queue.cc:1048] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:27:24.464856 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:24.334271 24834 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:24.466364 24786 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 12:27:21.141355 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.20.109.68:41677 (local address 127.0.0.1:51416)
0709 12:27:21.883298 (+741943us) negotiation.cc:107] Waiting for socket to connect
0709 12:27:21.883399 (+   101us) client_negotiation.cc:175] Beginning negotiation
0709 12:27:21.883957 (+   558us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 12:27:24.218438 (+2334481us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.20.109.68:41677: received 0 of 34 requested bytes
Metrics: {"client-negotiator.queue_time_us":605084,"thread_start_us":329697,"threads_started":1}
I20260709 12:27:24.432655 24607 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.510604 22070 raft_consensus.cc:2410] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:24.335753 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:24.476643 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:24.468619 24698 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.333775 24822 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.480048 24801 raft_consensus.cc:3055] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:24.480885 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 152394us
I20260709 12:27:24.481933 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 723) took 1929 ms. Trace:
I20260709 12:27:24.472654 22068 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:24.470295 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:24.483673 22071 rpcz_store.cc:276] 0709 12:27:22.688371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.763956 (+ 75585us) service_pool.cc:224] Handling call
0709 12:27:22.764292 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:22.764670 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:22.764697 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:22.765288 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.267242 (+1501954us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:24.267279 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.267352 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:24.336299 (+ 68947us) raft_consensus.cc:1685] finished
0709 12:27:24.336319 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.336480 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6223,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":1501542,"threads_started":1,"wal-append.queue_time_us":565512}
W20260709 12:27:24.476222 22219 rpcz_store.cc:269] 0709 12:27:21.338246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.474173 (+3135927us) service_pool.cc:224] Handling call
0709 12:27:24.475784 (+  1611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.495762 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:24.503010 22147 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:24.383906 24595 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.503212 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:24.504741 22221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 493) took 1924 ms (client timeout 2090 ms). Trace:
W20260709 12:27:24.616258 22221 rpcz_store.cc:269] 0709 12:27:22.580035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.400586 (+1820551us) service_pool.cc:224] Handling call
0709 12:27:24.504684 (+104098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.505669 22185 leader_election.cc:400] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:24.450376 24754 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:24.509027 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:24.503249 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 202086us
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Timed out: Client connection negotiation failed: client connection to 127.20.109.68:41677: received 0 of 34 requested bytes
I20260709 12:27:24.497498 24810 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:24.514358 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:24.579700 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 179622us
I20260709 12:27:24.614488 22144 raft_consensus.cc:2410] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:24.615410 22066 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:24.613816 22069 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:24.617033 22185 leader_election.cc:403] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:24.613858 22806 rpcz_store.cc:276] 0709 12:27:22.552811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.552923 (+   112us) service_pool.cc:224] Handling call
0709 12:27:22.553203 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:23.262304 (+709101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.481648 (+1219344us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540027b5d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:24.481858 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562576768}
I20260709 12:27:24.641788 24607 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:24.640940 22072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2093) took 1775 ms. Trace:
I20260709 12:27:24.644378 22214 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:24.644761 20917 tablet_server.cc:179] TabletServer@127.20.109.65:0 shutting down...
W20260709 12:27:24.634713 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.659479 22072 rpcz_store.cc:276] 0709 12:27:22.865663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.947195 (+ 81532us) service_pool.cc:224] Handling call
0709 12:27:22.947527 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:22.947743 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:23.283155 (+335412us) log.cc:844] Serialized 14 byte log entry
0709 12:27:24.579410 (+1296255us) log.cc:844] Serialized 14 byte log entry
0709 12:27:24.640572 (+ 61162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:24.640625 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:24.640681 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.640757 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.640876 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78260,"prepare.queue_time_us":810873,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":76,"raft.queue_time_us":134202,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":190,"thread_start_us":1612639,"threads_started":3,"wal-append.queue_time_us":931516}
I20260709 12:27:24.646705 24793 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:24.655282 24810 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.661417 24865 consensus_queue.cc:1059] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:27:24.509975 24817 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:24.661630 24793 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.662922 24810 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.647159 24785 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.669842 24785 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.672178 24785 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:24.675988 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.504482 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 646) took 1491 ms. Trace:
I20260709 12:27:24.647599 24855 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:24.648257 22809 raft_consensus.cc:1240] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:27:24.555040 22802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 655) took 1322 ms (client timeout 1744 ms). Trace:
I20260709 12:27:24.648146 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:24.687422 22805 raft_consensus.cc:2376] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4. Re-sending same reply.
I20260709 12:27:24.648388 24801 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:24.559036 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 176649us
I20260709 12:27:24.649446 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:24.692528 22810 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:24.511224 22143 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
W20260709 12:27:24.504540 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 216439us
I20260709 12:27:24.651353 22114 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:24.701122 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 49847.2us
W20260709 12:27:24.653882 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 148343us
I20260709 12:27:24.650255 22073 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:24.656198 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:24.657967 22216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1926) took 2589 ms (client timeout 3325 ms). Trace:
I20260709 12:27:24.662256 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
W20260709 12:27:24.702282 22216 rpcz_store.cc:269] 0709 12:27:22.068176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.504053 (+2435877us) service_pool.cc:224] Handling call
0709 12:27:24.657896 (+153843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.664650 22147 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:27:24.703152 22147 pending_rounds.cc:85] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 5
I20260709 12:27:24.559814 22801 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:24.655562 24682 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:24.668675 24754 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:24.668965 24782 consensus_queue.cc:1059] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:24.708856 24782 raft_consensus.cc:3055] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:24.709196 24782 raft_consensus.cc:740] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:24.698582 24859 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:27:24.710587 22114 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:24.676853 22221 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:24.647790 24834 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:24.617473 24799 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44986 (request call id 89) took 27898 ms (client timeout 29999 ms). Trace:
I20260709 12:27:24.614526 24762 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.673558 22037 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:24.507897 24444 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:24.702889 22068 raft_consensus.cc:2393] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:24.703395 22147 pending_rounds.cc:107] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:27:24.728026 22147 raft_consensus.cc:2889] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:24.703783 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2357) took 3054 ms. Trace:
I20260709 12:27:24.728865 22219 rpcz_store.cc:276] 0709 12:27:21.649609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.615076 (+2965467us) service_pool.cc:224] Handling call
0709 12:27:24.703721 (+ 88645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.727818 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:24.703320 22038 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:24.704663 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:24.704960 22073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d465f3cb42174eb89615dcd747f9e682" is_pre_election: true
I20260709 12:27:24.705166 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:24.652846 24595 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.731599 22073 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
W20260709 12:27:24.705754 22188 leader_election.cc:336] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 3.222s (SENT)
I20260709 12:27:24.706247 24801 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:24.691740 22802 rpcz_store.cc:269] 0709 12:27:23.233129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.332182 (+ 99053us) service_pool.cc:224] Handling call
0709 12:27:24.552807 (+1220625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.705780 24623 consensus_queue.cc:1059] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:27:24.733242 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:24.707785 22801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 651) took 1643 ms (client timeout 2079 ms). Trace:
I20260709 12:27:24.698077 24855 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.717620 24754 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:24.704705 24607 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:24.712260 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.471005 24840 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.703269 22185 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:24.775156 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 72093.9us
I20260709 12:27:24.713184 22114 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:24.719859 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 46693.1us
W20260709 12:27:24.779135 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 66019.6us
I20260709 12:27:24.779345 22037 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:24.732164 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:24.734791 22809 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:24.780882 22216 raft_consensus.cc:2410] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:24.729789 24444 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:24.786419 22185 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:24.736420 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:24.787024 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 81292.6us
I20260709 12:27:24.784935 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1934) took 2312 ms. Trace:
I20260709 12:27:24.683396 22804 rpcz_store.cc:276] 0709 12:27:23.009801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.013186 (+  3385us) service_pool.cc:224] Handling call
0709 12:27:24.501511 (+1488325us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:24.787617 22188 connection.cc:256] RPC call timeout handler was delayed by -1.9145626059998904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 12:27:24.787644 22216 rpcz_store.cc:276] 0709 12:27:22.473092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.715401 (+2242309us) service_pool.cc:224] Handling call
0709 12:27:24.784867 (+ 69466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.790539 22114 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:24.788316 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2358) took 3138 ms. Trace:
W20260709 12:27:24.791437 22188 connection.cc:256] RPC call timeout handler was delayed by -1.5237758899997971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 12:27:24.792418 22219 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:27:24.793524 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2339) took 3570 ms. Trace:
W20260709 12:27:24.792557 22188 connection.cc:256] RPC call timeout handler was delayed by -1.4832758899997316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 12:27:24.795358 22219 rpcz_store.cc:276] 0709 12:27:21.222883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.733402 (+3510519us) service_pool.cc:224] Handling call
0709 12:27:24.777281 (+ 43879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.793253 (+ 15972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.793461 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.803021 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:24.803820 22809 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:24.805493 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:24.806192 22806 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.792105 22221 rpcz_store.cc:276] 0709 12:27:21.649931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.711962 (+3062031us) service_pool.cc:224] Handling call
0709 12:27:24.788240 (+ 76278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.755427 24754 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.736101 24866 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:24.758075 24607 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:24.731225 24762 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:24.792310 24801 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.828125 22219 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:27:24.785112 24817 raft_consensus.cc:2764] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:24.784564 24793 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:24.793533 24730 raft_consensus.cc:2804] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:24.735742 22801 rpcz_store.cc:269] 0709 12:27:23.064128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.439180 (+375052us) service_pool.cc:224] Handling call
0709 12:27:24.707713 (+1268533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.839735 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1903) took 3502 ms. Trace:
I20260709 12:27:24.805370 24865 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:24.849582 22221 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:24.851044 22219 rpcz_store.cc:276] 0709 12:27:21.337783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.799192 (+3461409us) service_pool.cc:224] Handling call
0709 12:27:24.827874 (+ 28682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.839259 (+ 11385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.839671 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.818024 24274 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:24.817577 24623 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:24.911815 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 63279us
I20260709 12:27:24.817307 24754 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.817502 24866 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.797400 24715 consensus_queue.cc:1059] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:27:24.832566 24607 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:24.848551 24749 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:24.918905 24862 log.cc:927] Time spent T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:27:24.923877 22219 raft_consensus.cc:1275] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:24.923882 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 133440us
I20260709 12:27:24.944197 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1908) took 3553 ms. Trace:
I20260709 12:27:24.944525 22114 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:24.921231 24623 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.909934 24688 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:27:24.797684 24782 consensus_queue.cc:260] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:24.923112 24866 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:25.023223 22145 consensus_meta.cc:287] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.003s
I20260709 12:27:25.030942 22145 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:24.923748 24859 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:25.026834 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.925803 24274 raft_consensus.cc:697] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:24.925393 24730 raft_consensus.cc:697] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:25.034318 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.033866 22806 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
W20260709 12:27:24.973948 24867 log.cc:927] Time spent T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:27:24.999495 24718 raft_consensus.cc:2804] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:25.018729 24860 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:27:24.959595 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:24.976523 24619 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:24.717944 24799 rpcz_store.cc:269] 0709 12:26:56.719182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.727849 (+  8667us) service_pool.cc:224] Handling call
0709 12:26:58.234941 (+1507092us) log.cc:844] Serialized 501 byte log entry
0709 12:27:24.617341 (+26382400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46916,"raft.queue_time_us":123078,"raft.run_cpu_time_us":1156,"raft.run_wall_time_us":1283,"thread_start_us":75622,"threads_started":1}
I20260709 12:27:25.049259 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:25.050558 22775 connection.cc:256] RPC call timeout handler was delayed by -1.3540257159997964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 12:27:24.944605 22219 rpcz_store.cc:276] 0709 12:27:21.391060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.908033 (+3516973us) service_pool.cc:224] Handling call
0709 12:27:24.923590 (+ 15557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.943891 (+ 20301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.944131 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:24.966521 24874 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:25.044119 22113 connection.cc:256] RPC call timeout handler was delayed by -1.7962148890001117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 12:27:25.075451 22113 connection.cc:256] RPC call timeout handler was delayed by -1.7890148890001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 12:27:25.075852 22113 connection.cc:256] RPC call timeout handler was delayed by -1.7836148890000914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 12:27:25.076778 22113 connection.cc:256] RPC call timeout handler was delayed by -1.3886879090000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 12:27:25.076653 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 340276us
W20260709 12:27:25.077343 22113 connection.cc:256] RPC call timeout handler was delayed by -1.3387744419997034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 12:27:25.078279 22038 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:25.078464 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.034754 24623 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:25.080399 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:25.053097 22188 connection.cc:256] RPC call timeout handler was delayed by -1.0412700380002207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 12:27:25.081212 22142 raft_consensus.cc:2393] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:25.081429 22038 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:25.084434 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.087273 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.082773 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.088806 22142 raft_consensus.cc:2410] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:25.039852 24845 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:25.092242 24767 raft_consensus.cc:3055] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:27:25.092706 24870 log.cc:927] Time spent T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:27:25.096931 24761 raft_consensus.cc:3055] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:25.047595 24822 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:25.098979 24861 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:25.099550 24762 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:25.100031 24874 raft_consensus.cc:697] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:25.102033 24802 consensus_meta.cc:287] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.000s
I20260709 12:27:25.103358 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 639) took 2150 ms. Trace:
I20260709 12:27:25.104683 22069 raft_consensus.cc:1240] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:25.068095 24833 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:25.107290 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:25.189195 22806 raft_consensus.cc:2376] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4. Re-sending same reply.
I20260709 12:27:25.108899 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:25.109417 22188 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.806s (SENT)
W20260709 12:27:25.112187 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.190086 22188 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:25.190331 22140 raft_consensus.cc:2410] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:25.113484 24859 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:25.114393 24730 consensus_queue.cc:237] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:25.114964 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1907) took 3754 ms. Trace:
I20260709 12:27:25.192565 22221 rpcz_store.cc:276] 0709 12:27:21.360398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.810172 (+3449774us) service_pool.cc:224] Handling call
0709 12:27:24.837226 (+ 27054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.908293 (+ 71067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.114719 (+206426us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5400295254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:25.114894 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27862784}
I20260709 12:27:25.119462 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:25.120745 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.121400 24444 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:25.122061 22214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1933) took 2668 ms (client timeout 2169 ms). Trace:
W20260709 12:27:25.195323 22214 rpcz_store.cc:269] 0709 12:27:22.453205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.286330 (+1833125us) service_pool.cc:224] Handling call
0709 12:27:25.121812 (+835482us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001f5754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:25.121930 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605517696}
I20260709 12:27:25.196903 22216 raft_consensus.cc:1240] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:25.122220 24592 consensus_meta.cc:287] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.000s
I20260709 12:27:25.050287 24718 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.122852 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.214570 22803 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
W20260709 12:27:25.215106 22803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 653) took 2081 ms (client timeout 2213 ms). Trace:
I20260709 12:27:25.123594 24855 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:25.088292 22219 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 2.
W20260709 12:27:25.127506 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 348261us
I20260709 12:27:25.219080 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.219635 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:25.219770 22144 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:25.049741 24782 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:25.086035 24863 log.cc:927] Time spent T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:27:25.049695 24793 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:25.134706 24758 consensus_meta.cc:287] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.660s	user 0.011s	sys 0.000s
I20260709 12:27:25.154891 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.238835 22810 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
W20260709 12:27:25.155043 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 67135.4us
I20260709 12:27:25.158157 22801 raft_consensus.cc:2410] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:25.240053 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.240676 22144 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
W20260709 12:27:25.159695 22148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1716) took 2477 ms (client timeout 2912 ms). Trace:
W20260709 12:27:25.241396 22148 rpcz_store.cc:269] 0709 12:27:22.682206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.712101 (+ 29895us) service_pool.cc:224] Handling call
0709 12:27:25.159463 (+2447362us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400330254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:25.159593 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3262611840}
I20260709 12:27:25.164078 24599 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:25.136476 24675 raft_consensus.cc:3055] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:27:25.168797 24825 log.cc:927] Time spent T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 1.425s	user 0.002s	sys 0.016s
W20260709 12:27:25.182303 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 106632us
W20260709 12:27:25.190505 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.252918 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:25.254078 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:25.185185 22807 rpcz_store.cc:276] 0709 12:27:22.953176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.953996 (+   820us) service_pool.cc:224] Handling call
0709 12:27:22.954350 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.265513 (+311163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.265608 (+    95us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.266132 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.301511 (+1035379us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:24.301549 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.102987 (+801438us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54006a0254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:25.103032 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.103076 (+    44us) raft_consensus.cc:1685] finished
0709 12:27:25.103088 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.103298 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3156,"raft.queue_time_us":4035,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":22245,"spinlock_wait_cycles":707267840,"thread_start_us":954317,"threads_started":1,"wal-append.queue_time_us":917623}
I20260709 12:27:25.255151 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:25.198933 24874 consensus_queue.cc:237] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:25.200444 24607 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:25.201721 24754 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:25.202654 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.265102 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.203090 24274 consensus_queue.cc:237] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.171983 24810 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:25.172399 24767 raft_consensus.cc:740] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:25.174177 24761 raft_consensus.cc:740] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:25.210453 22213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1920) took 3406 ms (client timeout 2115 ms). Trace:
I20260709 12:27:25.211220 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:25.211243 22215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1911) took 3690 ms (client timeout 2004 ms). Trace:
W20260709 12:27:25.215044 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 105655us
W20260709 12:27:25.270735 22213 rpcz_store.cc:269] 0709 12:27:21.790639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.818811 (+1028172us) service_pool.cc:224] Handling call
0709 12:27:25.196474 (+2377663us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b540031bfd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:25.196618 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4112424192}
I20260709 12:27:25.113255 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.215831 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:25.215574 22803 rpcz_store.cc:269] 0709 12:27:23.133375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.063256 (+929881us) service_pool.cc:224] Handling call
0709 12:27:25.122704 (+1059448us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:27:25.215044 (+ 92340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191639808}
I20260709 12:27:25.276948 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.245862 24675 raft_consensus.cc:740] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:25.277585 22803 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
W20260709 12:27:25.189364 24751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.425s	user 0.016s	sys 0.046s
I20260709 12:27:25.220403 22219 raft_consensus.cc:2410] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:25.232466 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.192283 24859 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:25.214273 24817 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:25.158787 24560 raft_consensus.cc:3055] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:25.218174 24718 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:25.237466 22804 raft_consensus.cc:2368] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4.
I20260709 12:27:25.225747 24732 raft_consensus.cc:3055] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:25.245323 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:25.301368 22810 raft_consensus.cc:2376] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4. Re-sending same reply.
I20260709 12:27:25.302403 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.303028 22810 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:25.195948 24833 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.260811 22141 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:25.265326 22806 raft_consensus.cc:1813] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Handling vote request from an unknown peer 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:25.204655 24698 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:25.265411 22144 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:25.267324 22143 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:25.193117 24802 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:25.274907 22215 rpcz_store.cc:269] 0709 12:27:21.506921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.893399 (+386478us) service_pool.cc:224] Handling call
0709 12:27:25.196776 (+3303377us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001f5c54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:25.196883 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3168323840}
I20260709 12:27:25.312194 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.313386 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.314208 22215 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:25.314301 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:25.273664 22145 raft_consensus.cc:1240] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:25.185084 24861 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.279842 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:25.315946 22803 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:25.273574 22808 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:25.220829 24592 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:25.273092 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.115s (SENT)
I20260709 12:27:25.320243 22188 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:25.268400 24864 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:25.286079 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.240736 24758 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:25.299669 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:25.238329 24793 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.283203 24560 raft_consensus.cc:740] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:25.280469 24751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.516s	user 0.016s	sys 0.046s
I20260709 12:27:25.258662 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.407299 24560 consensus_queue.cc:260] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.408066 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:25.408664 22142 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:25.408301 24767 consensus_queue.cc:260] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.409596 24767 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.410921 22065 raft_consensus.cc:1240] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:27:25.307732 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.308461 22806 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
W20260709 12:27:25.412122 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.412618 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:25.413859 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.280614 24859 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:25.414851 24775 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:25.415580 24775 consensus_queue.cc:1048] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:25.310745 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:25.422204 24801 consensus_meta.cc:287] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.000s
I20260709 12:27:25.319063 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.449275 22215 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:25.450346 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.329610 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.329914 24444 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:25.330651 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:25.331055 24882 log.cc:927] Time spent T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:27:25.322777 22219 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:25.331499 22186 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:25.301110 24732 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:25.369468 24886 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:25.377238 22113 leader_election.cc:336] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.589s (SENT)
I20260709 12:27:25.378960 22773 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:25.378614 24675 consensus_queue.cc:260] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:25.379737 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:25.381412 24810 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:25.382844 24884 log.cc:927] Time spent T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:27:25.386387 24833 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:25.386682 24887 log.cc:927] Time spent T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.065s	user 0.000s	sys 0.006s
W20260709 12:27:25.405207 24500 consensus_meta.cc:287] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 1.080s	user 0.005s	sys 0.008s
I20260709 12:27:25.406126 22037 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:25.314941 22810 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.335111 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:25.427685 22142 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:25.436156 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1698) took 5008 ms. Trace:
I20260709 12:27:25.442919 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:25.443804 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 170726us
I20260709 12:27:25.461126 22803 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
W20260709 12:27:25.474614 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.477787 22807 raft_consensus.cc:2368] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5.
W20260709 12:27:25.485553 22776 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.024s	sys 0.026s
I20260709 12:27:25.335002 24761 consensus_queue.cc:260] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:25.790807 22776 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.032s	sys 0.036s
W20260709 12:27:25.791414 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 973369us
I20260709 12:27:25.594682 24803 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:25.793061 24803 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.793306 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.794178 22221 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 12.
W20260709 12:27:25.489488 24881 log.cc:927] Time spent T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:27:25.795327 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.796067 22073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 545) took 1453 ms. Trace:
I20260709 12:27:25.811355 22073 rpcz_store.cc:276] 0709 12:27:24.343108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.733035 (+389927us) service_pool.cc:224] Handling call
0709 12:27:24.735844 (+  2809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.841804 (+105960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.841839 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:24.842567 (+   728us) log.cc:844] Serialized 26 byte log entry
0709 12:27:25.184001 (+341434us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:25.221260 (+ 37259us) log.cc:844] Serialized 14 byte log entry
0709 12:27:25.231517 (+ 10257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.231593 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.795860 (+564267us) raft_consensus.cc:1685] finished
0709 12:27:25.795877 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.796012 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13791,"prepare.queue_time_us":47826,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":107131,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":68165,"spinlock_wait_cycles":23234816,"thread_start_us":266605,"threads_started":2,"wal-append.queue_time_us":305085}
I20260709 12:27:25.796170 24592 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:25.796396 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 464978us
I20260709 12:27:25.796876 22146 rpcz_store.cc:276] 0709 12:27:20.329163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.053595 (+724432us) service_pool.cc:224] Handling call
0709 12:27:21.053892 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:21.241021 (+187129us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:22.677966 (+1436945us) log.cc:844] Serialized 14 byte log entry
0709 12:27:23.297554 (+619588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:23.297620 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:23.297678 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.337607 (+2039929us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400407254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:25.337662 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.337808 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207886,"prepare.queue_time_us":477604,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":650,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":27476,"spinlock_wait_cycles":429848832,"thread_start_us":1837201,"threads_started":2,"wal-append.queue_time_us":821373,"wal-append.run_cpu_time_us":13911,"wal-append.run_wall_time_us":1760804}
W20260709 12:27:25.713654 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 342219us
W20260709 12:27:25.489511 24880 log.cc:927] Time spent T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:27:25.710711 24793 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:25.802353 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.825591 22142 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:25.803517 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.804206 24675 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.654758 22808 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:25.827754 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 729) took 1177 ms. Trace:
I20260709 12:27:25.828138 22808 rpcz_store.cc:276] 0709 12:27:24.650358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.595601 (+945243us) service_pool.cc:224] Handling call
0709 12:27:25.654549 (+ 58948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.827458 (+172909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.827690 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:25.805441 22806 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:25.806972 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 731) took 1156 ms. Trace:
I20260709 12:27:25.842727 22803 rpcz_store.cc:276] 0709 12:27:24.650929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.806113 (+1155184us) service_pool.cc:224] Handling call
0709 12:27:25.806436 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.806647 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:25.806677 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:25.806717 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:25.806751 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.806805 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.806912 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:25.808421 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 431234us
W20260709 12:27:25.844542 22113 leader_election.cc:336] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.614s (SENT)
W20260709 12:27:25.845239 22113 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.674s (SENT)
I20260709 12:27:25.487941 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:25.847432 22186 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:25.847704 22219 raft_consensus.cc:2410] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:25.848697 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.848853 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:25.790910 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:25.792128 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:25.850452 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:25.850894 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:25.792181 22776 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.541s (SENT) [suppressed 62 similar messages]
I20260709 12:27:25.816952 22810 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:25.850380 22146 raft_consensus.cc:1240] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:25.820488 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.853029 22146 raft_consensus.cc:1240] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:25.853628 22143 raft_consensus.cc:2393] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:25.821549 22112 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:25.818665 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:25.851733 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 59585.8us
W20260709 12:27:25.846496 22113 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.834s (SENT)
I20260709 12:27:25.858637 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:25.859993 22146 raft_consensus.cc:1240] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:25.861821 22143 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:25.863559 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.812047 24583 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.867653 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:25.868408 22145 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:25.866365 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:25.866806 22113 leader_election.cc:336] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.868s (SENT)
I20260709 12:27:25.869524 22215 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:25.865594 22776 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:25.869776 22113 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.923s (SENT)
I20260709 12:27:25.814139 24833 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:25.872561 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 732) took 1221 ms. Trace:
I20260709 12:27:25.820585 24560 raft_consensus.cc:3060] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:25.874788 22113 leader_election.cc:336] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.988s (SENT)
I20260709 12:27:25.873030 22808 rpcz_store.cc:276] 0709 12:27:24.651643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.829072 (+1177429us) service_pool.cc:224] Handling call
0709 12:27:25.872034 (+ 42962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.872239 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:25.872265 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:25.872311 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:25.872348 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.872399 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.872497 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:25.888628 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:25.883675 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 62215.8us
I20260709 12:27:25.908560 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:25.910722 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.919831 22808 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:25.865348 24793 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:25.923126 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 544) took 1585 ms. Trace:
I20260709 12:27:25.919651 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 738) took 1183 ms. Trace:
I20260709 12:27:25.889729 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:25.907577 22113 leader_election.cc:336] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.004s (SENT)
I20260709 12:27:25.924283 22113 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:25.923770 22068 rpcz_store.cc:276] 0709 12:27:24.337384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.737468 (+400084us) service_pool.cc:224] Handling call
0709 12:27:24.737835 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.738086 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.738114 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:24.748996 (+ 10882us) log.cc:844] Serialized 26 byte log entry
0709 12:27:25.261529 (+512533us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:25.261569 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.261637 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.922923 (+661286us) raft_consensus.cc:1685] finished
0709 12:27:25.922942 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.923067 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":429366,"threads_started":1,"wal-append.queue_time_us":489688}
I20260709 12:27:25.925503 22142 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:25.925652 22803 rpcz_store.cc:276] 0709 12:27:24.736723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.873625 (+1136902us) service_pool.cc:224] Handling call
0709 12:27:25.919118 (+ 45493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.919309 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:25.919337 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:25.919375 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:25.919410 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.919461 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.919587 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:25.904594 24866 consensus_meta.cc:287] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.000s
I20260709 12:27:25.863965 24886 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:25.930167 24893 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:25.931092 24893 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:25.873351 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 737) took 1177 ms. Trace:
I20260709 12:27:25.884768 24833 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:25.909657 24623 consensus_meta.cc:287] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.772s	user 0.008s	sys 0.002s
I20260709 12:27:25.912405 24810 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:25.904708 24592 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:25.962246 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 583307us
I20260709 12:27:25.927992 24861 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:25.970934 22222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1914) took 4357 ms (client timeout 1589 ms). Trace:
I20260709 12:27:25.949646 22808 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:27:25.974702 22222 rpcz_store.cc:269] 0709 12:27:21.597064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.598240 (+  1176us) service_pool.cc:224] Handling call
0709 12:27:25.954194 (+4355954us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400117e54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:25.954372 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3670820608}
I20260709 12:27:25.975859 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:25.976521 22222 raft_consensus.cc:2368] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5.
I20260709 12:27:25.977283 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.977792 22222 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:25.971290 22147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2279) took 1571 ms. Trace:
I20260709 12:27:25.978930 22147 rpcz_store.cc:276] 0709 12:27:24.399894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.616231 (+216337us) service_pool.cc:224] Handling call
0709 12:27:24.616481 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.728613 (+112132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.971020 (+1242407us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b540039fb54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:25.971224 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109762304}
I20260709 12:27:25.978508 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:25.980715 22222 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:25.969475 24810 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:25.980940 22142 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:25.948458 24886 raft_consensus.cc:697] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:25.945422 24833 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.904520 24583 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.944571 24891 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:25.969537 22773 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:25.947289 24802 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:25.993444 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:25.997187 22222 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:25.942979 22804 rpcz_store.cc:276] 0709 12:27:24.693351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.324127 (+630776us) service_pool.cc:224] Handling call
0709 12:27:25.870125 (+545998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:25.942394 24866 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:25.993959 24859 consensus_meta.cc:287] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.005s
I20260709 12:27:25.968708 24592 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:25.999029 22773 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:25.999398 24782 consensus_meta.cc:287] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.001s
I20260709 12:27:25.911665 24732 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:25.993659 24810 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:26.002614 24785 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:26.006114 24592 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:26.006970 24889 log.cc:927] Time spent T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:25.998538 24861 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:26.000998 22773 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:26.027724 24894 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:27:26.029814 24758 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.032294 22220 raft_consensus.cc:2410] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:25.973569 24896 consensus_queue.cc:1059] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:27:26.000774 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:26.071336 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:26.072484 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:26.073304 22222 raft_consensus.cc:2410] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:26.027632 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:26.049238 22142 raft_consensus.cc:3055] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:26.044348 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:26.073820 22142 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:26.074340 22218 raft_consensus.cc:3060] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:27:26.063356 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 62426.5us
I20260709 12:27:26.073851 22214 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 1.
I20260709 12:27:25.952239 24623 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:26.066625 24767 consensus_meta.cc:287] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.001s
W20260709 12:27:26.068928 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 161420us
I20260709 12:27:26.078773 22222 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:27:26.079350 22113 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.018s (SENT)
W20260709 12:27:26.065745 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 159236us
I20260709 12:27:26.077540 22214 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:26.079988 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.046070 24785 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:26.026361 24754 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.080338 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1910) took 4616 ms. Trace:
I20260709 12:27:26.074683 21958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:27:26.070165 24718 consensus_meta.cc:287] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.000s
I20260709 12:27:26.081736 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1912) took 4524 ms. Trace:
W20260709 12:27:26.082377 24892 log.cc:927] Time spent T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:27:26.081808 22142 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.068305 24732 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:26.078948 24893 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.095100 24893 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.096192 24274 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.096698 24274 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.097292 24893 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.098745 24444 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.099272 24444 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.100142 22215 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:27:26.100492 22215 pending_rounds.cc:85] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting all ops after (but not including) 4
I20260709 12:27:26.100719 22215 pending_rounds.cc:107] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:27:26.100925 22215 raft_consensus.cc:2889] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:26.101475 24444 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.102770 24718 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.104898 24718 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.090878 22142 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:26.106832 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2350) took 4519 ms. Trace:
I20260709 12:27:26.107609 24866 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:25.911386 22801 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:27:26.084374 22113 leader_election.cc:336] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.020s (SENT)
I20260709 12:27:26.110927 22113 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.084789 22222 rpcz_store.cc:276] 0709 12:27:21.555625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.076999 (+4521374us) service_pool.cc:224] Handling call
0709 12:27:26.077312 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.079263 (+  1951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.079463 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.084465 22214 rpcz_store.cc:276] 0709 12:27:21.464222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.077013 (+4612791us) service_pool.cc:224] Handling call
0709 12:27:26.077371 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.080093 (+  2722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.080283 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12928}
I20260709 12:27:26.111485 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2342) took 4845 ms. Trace:
I20260709 12:27:26.111896 22216 rpcz_store.cc:276] 0709 12:27:21.266616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.791815 (+3525199us) service_pool.cc:224] Handling call
0709 12:27:25.196724 (+404909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.197382 (+   658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.111210 (+913828us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540031bfd0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:26.111422 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882365696}
I20260709 12:27:26.113090 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1915) took 4498 ms. Trace:
I20260709 12:27:26.113523 22214 rpcz_store.cc:276] 0709 12:27:21.614831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.112027 (+4497196us) service_pool.cc:224] Handling call
0709 12:27:26.112331 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.112676 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.112704 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.112748 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:26.112786 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.112864 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.113013 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.089087 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2081) took 3402 ms. Trace:
I20260709 12:27:26.031194 24886 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.041494 24859 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:26.090943 24698 consensus_meta.cc:287] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.003s
I20260709 12:27:26.091835 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 664) took 1441 ms. Trace:
I20260709 12:27:26.122361 22806 rpcz_store.cc:276] 0709 12:27:24.649947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.419474 (+769527us) service_pool.cc:224] Handling call
0709 12:27:25.805264 (+385790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.829306 (+ 24042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.091642 (+262336us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540076af50. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:26.091774 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886444800}
I20260709 12:27:26.092804 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45000 (request call id 2086) took 3405 ms. Trace:
I20260709 12:27:26.120544 22218 raft_consensus.cc:2468] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:26.124934 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1948) took 1039 ms. Trace:
I20260709 12:27:26.125495 22218 rpcz_store.cc:276] 0709 12:27:25.085482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.044062 (+958580us) service_pool.cc:224] Handling call
0709 12:27:26.124860 (+ 80798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.126235 22214 raft_consensus.cc:1275] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:26.127072 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2355) took 4478 ms. Trace:
I20260709 12:27:26.114961 22065 rpcz_store.cc:276] 0709 12:27:22.686292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.711237 (+ 24945us) service_pool.cc:224] Handling call
0709 12:27:22.711634 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:25.411398 (+2699764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.088830 (+677432us) spinlock_profiling.cc:243] Waited 2.7 s on lock 0x7b5400185bd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:26.089023 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6207243008}
I20260709 12:27:26.130538 22214 rpcz_store.cc:276] 0709 12:27:21.648881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.114469 (+4465588us) service_pool.cc:224] Handling call
0709 12:27:26.117186 (+  2717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.126779 (+  9593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.127009 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.107209 22215 rpcz_store.cc:276] 0709 12:27:21.587003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.099438 (+4512435us) service_pool.cc:224] Handling call
0709 12:27:26.099762 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.101364 (+  1602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.106773 (+  5409us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:26.132158 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 47812.2us
I20260709 12:27:26.124523 22067 rpcz_store.cc:276] 0709 12:27:22.687639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.688903 (+  1264us) service_pool.cc:224] Handling call
0709 12:27:22.689218 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:22.946301 (+257083us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:23.284140 (+337839us) log.cc:844] Serialized 14 byte log entry
0709 12:27:23.727573 (+443433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:23.727648 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:23.727705 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.824684 (+2096979us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b1800318e80. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895e72a6 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419
0709 12:27:26.092595 (+267911us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400315454. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:26.092642 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.092751 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":777116,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":267,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3396,"spinlock_wait_cycles":678567936,"thread_start_us":780025,"threads_started":2,"wal-append.queue_time_us":927938,"wal-append.run_cpu_time_us":1146,"wal-append.run_wall_time_us":1004089}
I20260709 12:27:26.137814 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49866 (request call id 554) took 1494 ms. Trace:
W20260709 12:27:26.143850 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 737788us
W20260709 12:27:26.144119 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.105094 24623 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.157824 22036 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:26.159312 24866 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:26.159840 24866 raft_consensus.cc:697] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:26.160635 24866 consensus_queue.cc:237] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.110347 24822 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:27:26.162885 24274 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.163283 22036 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:26.164463 24846 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:26.165238 24846 raft_consensus.cc:697] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:26.166643 24859 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.167351 24751 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:26.169713 24878 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:26.175518 22141 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:27:26.175870 22141 pending_rounds.cc:85] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 6
I20260709 12:27:26.176079 22141 pending_rounds.cc:107] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:27:26.176288 22141 raft_consensus.cc:2889] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:26.178604 22141 raft_consensus.cc:1240] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:26.133778 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 879727us
I20260709 12:27:26.144508 22216 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:26.086941 24785 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:26.142783 24458 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:26.142997 24888 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.148869 22070 rpcz_store.cc:276] 0709 12:27:24.643542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.123702 (+480160us) service_pool.cc:224] Handling call
0709 12:27:25.124034 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.124267 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:25.124554 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 12:27:26.137415 (+1012861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.137477 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:26.137535 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.137612 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.137745 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":658518,"prepare.queue_time_us":1291,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1398,"raft.queue_time_us":652088,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"thread_start_us":361274,"threads_started":1,"wal-append.queue_time_us":785684}
W20260709 12:27:26.152112 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:26.183043 22038 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:26.183229 22114 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:26.184134 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.121186 24592 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.143632 24804 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:26.150112 22113 leader_election.cc:336] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.068s (SENT)
I20260709 12:27:26.186978 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:26.127499 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 492) took 3547 ms. Trace:
I20260709 12:27:26.188427 22218 rpcz_store.cc:276] 0709 12:27:22.579737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.126381 (+3546644us) service_pool.cc:224] Handling call
0709 12:27:26.126723 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.127160 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.127191 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.127237 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:26.127270 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.127327 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.127443 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:26.186538 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.190141 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 497) took 3492 ms. Trace:
I20260709 12:27:26.156454 22213 raft_consensus.cc:2410] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:26.145958 24865 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.180940 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2354) took 4532 ms. Trace:
I20260709 12:27:26.209583 22216 rpcz_store.cc:276] 0709 12:27:21.648513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.112843 (+4464330us) service_pool.cc:224] Handling call
0709 12:27:26.144330 (+ 31487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.180692 (+ 36362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.180868 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.150491 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:26.210064 22038 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.210516 22806 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:26.178391 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 269908us
I20260709 12:27:26.212823 22112 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:26.147239 24753 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:26.190451 22218 rpcz_store.cc:276] 0709 12:27:22.698134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.189413 (+3491279us) service_pool.cc:224] Handling call
0709 12:27:26.189691 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.189853 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.189875 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.189911 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:26.189943 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.190003 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.190092 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.221485 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 499) took 1945 ms. Trace:
I20260709 12:27:26.221858 22218 rpcz_store.cc:276] 0709 12:27:24.276173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.220608 (+1944435us) service_pool.cc:224] Handling call
0709 12:27:26.220957 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.221142 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.221168 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.221212 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:26.221251 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.221309 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.221424 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.223263 22218 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:26.223857 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 501) took 1186 ms. Trace:
I20260709 12:27:26.224184 22218 rpcz_store.cc:276] 0709 12:27:25.037266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.222770 (+1185504us) service_pool.cc:224] Handling call
0709 12:27:26.223082 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.223623 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.223800 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.225387 22218 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:26.225991 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 506) took 1118 ms. Trace:
I20260709 12:27:26.154266 22037 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:26.187218 22113 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 2.115s (SENT)
I20260709 12:27:26.134060 24799 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:26.216857 22038 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.185551 24458 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:26.186012 24804 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:26.226284 22218 rpcz_store.cc:276] 0709 12:27:25.107241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.224876 (+1117635us) service_pool.cc:224] Handling call
0709 12:27:26.225207 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.225725 (+   518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.225934 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.237392 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 510) took 1085 ms. Trace:
I20260709 12:27:26.230116 22113 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.217126 22112 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:26.123333 24596 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:27:26.237704 22218 rpcz_store.cc:276] 0709 12:27:25.152268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.236767 (+1084499us) service_pool.cc:224] Handling call
0709 12:27:26.237041 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.237167 (+   126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.237183 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.237211 (+    28us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:26.237235 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.237272 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.237349 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.239126 22112 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.166077 24846 consensus_queue.cc:237] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.217881 24859 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:26.146317 24833 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.181950 24840 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:26.219650 24693 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.219429 24822 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:26.251667 22216 raft_consensus.cc:1275] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:26.260396 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 509) took 1123 ms. Trace:
I20260709 12:27:26.260921 22216 rpcz_store.cc:276] 0709 12:27:25.137279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.229751 (+1092472us) service_pool.cc:224] Handling call
0709 12:27:26.244843 (+ 15092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.259876 (+ 15033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.260255 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:26.243389 24804 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:26.247153 24623 raft_consensus.cc:2804] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:26.266309 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:26.236096 24458 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:26.215755 24733 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:27:26.218923 24751 consensus_queue.cc:1059] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:27:26.228579 24758 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:26.288676 24758 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:26.289147 24758 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:26.250811 24875 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:26.216250 24865 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.292570 24865 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.293169 24865 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:26.270385 22221 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
W20260709 12:27:26.273159 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.275933 22222 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:26.283072 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:26.295694 24592 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.296361 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:26.296806 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 109611us
I20260709 12:27:26.288172 24733 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:26.301014 22806 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
W20260709 12:27:26.269079 22112 connection.cc:256] RPC call timeout handler was delayed by -1.5758667820000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 12:27:26.296988 22805 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:26.298194 24754 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:26.304076 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:26.306944 22809 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:26.305241 24802 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:26.314355 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:26.209583 24888 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.305513 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:26.318960 22147 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:26.315232 22141 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:26.322467 22145 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:26.325399 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.326658 22148 raft_consensus.cc:1275] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:26.332273 22113 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:26.333359 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 496) took 3645 ms. Trace:
I20260709 12:27:26.333932 22214 rpcz_store.cc:276] 0709 12:27:22.683632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.148561 (+3464929us) service_pool.cc:224] Handling call
0709 12:27:26.149039 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.149277 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:26.258474 (+109197us) log.cc:844] Serialized 14 byte log entry
0709 12:27:26.328727 (+ 70253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.328786 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:26.328840 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.328909 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.329056 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138325,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1437,"thread_start_us":173498,"threads_started":2}
I20260709 12:27:26.316167 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:26.339661 22113 leader_election.cc:400] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5.
I20260709 12:27:26.345137 22113 leader_election.cc:403] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:27:26.346987 22113 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.343107 22112 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:26.320621 24733 raft_consensus.cc:3055] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:26.349161 22112 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.350342 22112 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:26.318535 24623 raft_consensus.cc:697] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:26.353219 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:26.328058 24903 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.352658 24753 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:26.354952 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 143058us
I20260709 12:27:26.332381 24754 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:26.337265 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 730) took 1682 ms. Trace:
I20260709 12:27:26.352329 24902 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:26.354472 24718 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:26.361970 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:26.351878 24875 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5.
I20260709 12:27:26.358549 22805 raft_consensus.cc:2468] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:26.354646 24715 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:26.382109 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:26.352108 24733 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:26.357285 22804 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:26.386323 22776 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:26.351406 24775 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:27:26.402055 24698 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:26.407123 24733 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.409053 24733 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:26.390993 24715 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:26.398532 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 729) took 1090 ms. Trace:
I20260709 12:27:26.418383 24623 consensus_queue.cc:237] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.419135 22808 rpcz_store.cc:276] 0709 12:27:25.307626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.940438 (+632812us) service_pool.cc:224] Handling call
0709 12:27:25.949280 (+  8842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.949506 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:26.176519 (+227013us) log.cc:844] Serialized 14 byte log entry
0709 12:27:26.397879 (+221360us) log.cc:844] Serialized 14 byte log entry
0709 12:27:26.398095 (+   216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.398150 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:26.398212 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.398302 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.398459 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3592,"raft.queue_time_us":3802,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":8561,"thread_start_us":206099,"threads_started":2}
I20260709 12:27:26.418928 24715 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:26.399137 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 244949us
I20260709 12:27:26.422271 22037 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:26.423332 24833 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.384837 24754 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:26.387639 24901 log.cc:927] Time spent T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:27:26.387511 24730 raft_consensus.cc:2764] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:26.416857 24810 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.367199 24903 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.442639 24903 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.442451 24758 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:26.402951 22776 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:26.444486 22776 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:26.445098 22776 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:26.445649 22776 leader_election.cc:336] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:26.445978 24758 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.412290 24458 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.379087 24902 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:26.447208 24902 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:26.447619 24906 log.cc:927] Time spent T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:27:26.448244 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 736) took 1759 ms. Trace:
I20260709 12:27:26.448580 24458 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.448652 22810 rpcz_store.cc:276] 0709 12:27:24.689283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.851878 (+1162595us) service_pool.cc:224] Handling call
0709 12:27:25.863316 (+ 11438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.033429 (+170113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.033467 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.033516 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:26.033568 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.447999 (+414431us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54006e0354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:26.448059 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.448183 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390627072}
W20260709 12:27:26.450280 24905 log.cc:927] Time spent T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:27:26.450425 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1930) took 4224 ms. Trace:
I20260709 12:27:26.450868 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 495) took 3789 ms. Trace:
I20260709 12:27:26.451231 22215 rpcz_store.cc:276] 0709 12:27:22.661322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.134693 (+3473371us) service_pool.cc:224] Handling call
0709 12:27:26.135318 (+   625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.135647 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.135692 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:26.136410 (+   718us) log.cc:844] Serialized 26 byte log entry
0709 12:27:26.261880 (+125470us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:26.261916 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.261981 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:26.450664 (+188683us) raft_consensus.cc:1685] finished
0709 12:27:26.450687 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.450812 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":108777,"threads_started":1,"wal-append.queue_time_us":185423}
I20260709 12:27:26.452067 24864 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:26.452616 24864 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:26.394881 24718 raft_consensus.cc:697] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:26.430179 22037 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:26.440747 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 90452.3us
I20260709 12:27:26.450825 22222 rpcz_store.cc:276] 0709 12:27:22.225997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.123729 (+3897732us) service_pool.cc:224] Handling call
0709 12:27:26.124103 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.295183 (+171080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.450196 (+155013us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400029754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:26.450354 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348605696}
W20260709 12:27:26.459676 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 661) took 1810 ms (client timeout 2236 ms). Trace:
W20260709 12:27:26.528312 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 98229.1us
W20260709 12:27:26.528901 22807 rpcz_store.cc:269] 0709 12:27:24.649335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.254916 (+605581us) service_pool.cc:224] Handling call
0709 12:27:26.459467 (+1204551us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400622d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:26.459611 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510299520}
I20260709 12:27:26.527652 22112 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:26.531773 22112 leader_election.cc:400] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4.
I20260709 12:27:26.532289 22112 leader_election.cc:403] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:26.533221 22112 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:26.538641 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 274462us
W20260709 12:27:26.537573 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 320784us
I20260709 12:27:26.542692 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:26.435635 24560 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:26.536633 24799 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:26.424082 24754 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:26.558429 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:26.481386 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.541826 24758 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4.
I20260709 12:27:26.561213 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 730) took 1248 ms. Trace:
W20260709 12:27:26.465401 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:26.567414 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:26.565665 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.566838 22803 rpcz_store.cc:276] 0709 12:27:25.312394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.941072 (+628678us) service_pool.cc:224] Handling call
0709 12:27:25.953289 (+ 12217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.181755 (+228466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.181790 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:26.182677 (+   887us) log.cc:844] Serialized 26 byte log entry
0709 12:27:26.324067 (+141390us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:26.324100 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.326117 (+  2017us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:26.560953 (+234836us) raft_consensus.cc:1685] finished
0709 12:27:26.560980 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.561140 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27053,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":1093,"thread_start_us":315250,"threads_started":2,"wal-append.queue_time_us":179385}
I20260709 12:27:26.564425 22038 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:26.563450 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 210347us
I20260709 12:27:26.541682 24753 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:26.569614 22113 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.528105 24458 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.555547 24840 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:26.578755 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 111932us
I20260709 12:27:26.594115 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:26.583343 24753 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:26.545055 24437 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:26.567484 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 102133us
I20260709 12:27:26.438120 24596 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 12:27:26.588493 22140 pending_rounds.cc:85] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 6
I20260709 12:27:26.540771 24878 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:26.555636 24810 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.591688 22185 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:26.593051 22112 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:26.568440 24754 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:26.601085 22140 pending_rounds.cc:107] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:27:26.603739 22140 raft_consensus.cc:2889] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:26.556622 24816 consensus_queue.cc:1059] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:27:26.604463 22114 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:26.454494 24804 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:26.602344 22776 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:26.577740 24560 raft_consensus.cc:697] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:26.588500 24869 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.597041 24840 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:26.557269 24833 consensus_queue.cc:1059] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:27:26.593864 24903 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:26.600934 24730 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:26.598635 24753 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:26.596894 24751 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:26.606235 22185 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:26.581001 24444 consensus_queue.cc:1059] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:27:26.609336 24274 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:26.596143 24458 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.563915 24902 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:26.611438 22776 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:26.750046 22188 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.542s (SENT)
I20260709 12:27:26.609963 22112 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:26.623411 24914 log.cc:927] Time spent T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:27:26.599517 24733 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 12:27:26.595655 24922 consensus_queue.cc:1059] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
W20260709 12:27:26.764729 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 154811us
I20260709 12:27:26.601630 24715 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.622956 24680 raft_consensus.cc:3055] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:26.625938 24840 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:26.793308 22143 raft_consensus.cc:1240] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:26.755118 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 143707us
W20260709 12:27:26.794447 22776 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:26.795192 22776 leader_election.cc:336] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:26.795809 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.755491 22188 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:26.606555 24785 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.614863 24623 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.145s
W20260709 12:27:26.752709 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 160153us
I20260709 12:27:26.791989 24458 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.617813 24607 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:26.815578 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 65593.1us
W20260709 12:27:26.816460 22188 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.569s (SENT)
I20260709 12:27:26.816892 22188 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:26.796348 22776 leader_election.cc:336] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:26.818619 22776 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.823709 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.606884 24718 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.748669 24923 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:26.751943 24927 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:26.625499 24869 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:26.792498 24925 log.cc:927] Time spent T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:27:26.928149 24869 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.785470 24865 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:26.928959 24865 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.931037 24865 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.909891 24804 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.911468 24595 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.785343 24875 raft_consensus.cc:2804] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:26.932523 24888 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.376192 22801 rpcz_store.cc:276] 0709 12:27:24.650671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.739332 (+1088661us) service_pool.cc:224] Handling call
0709 12:27:25.825294 (+ 85962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.905623 (+ 80329us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:26.138362 (+232739us) log.cc:844] Serialized 14 byte log entry
0709 12:27:26.280432 (+142070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.299214 (+ 18782us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:26.301296 (+  2082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.321321 (+ 20025us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.332667 (+ 11346us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13135,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4261,"spinlock_wait_cycles":9796992,"thread_start_us":123551,"threads_started":1,"wal-append.queue_time_us":178061}
I20260709 12:27:26.758649 24912 consensus_queue.cc:1048] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 12:27:26.925671 24918 log.cc:927] Time spent T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:27:26.933261 24875 raft_consensus.cc:697] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:26.828893 24921 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.785104 24680 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:26.935379 24680 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.771521 24878 raft_consensus.cc:697] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:26.937386 24878 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.827265 24730 raft_consensus.cc:3055] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:26.939234 24730 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:26.940183 24730 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.765868 24274 raft_consensus.cc:697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:26.942396 24274 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.915635 24560 consensus_queue.cc:237] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.924376 24923 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:26.947000 24923 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:26.948397 24902 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:26.936323 24680 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:26.765480 24928 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.166s
I20260709 12:27:26.943936 24675 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:26.762058 24799 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:26.839231 24833 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:26.950565 24500 raft_consensus.cc:3055] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:26.954156 24816 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:26.978498 24833 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.987851 24833 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:26.990074 24864 consensus_meta.cc:287] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.537s	user 0.001s	sys 0.005s
I20260709 12:27:26.995863 24833 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.000204 24833 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:26.951535 24921 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.006614 24785 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:27.000118 24803 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:27.015686 24921 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:27.020895 24761 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:27.024847 24802 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:27.025905 24802 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:27.036760 24861 raft_consensus.cc:3055] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:27.037303 24861 raft_consensus.cc:740] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:27.038177 24861 consensus_queue.cc:260] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.039675 24861 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:27.043784 24908 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.699s	user 0.007s	sys 0.002s
I20260709 12:27:26.990540 24864 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.069494 24864 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:27.070477 24934 log.cc:927] Time spent T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:27:26.983105 24875 consensus_queue.cc:237] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:27.099826 20917 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 22074)
I20260709 12:27:27.107833 21970 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:27.122742 22038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.004s
W20260709 12:27:27.123190 22038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.004s	sys 0.004s
W20260709 12:27:27.123585 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 513446us
I20260709 12:27:27.126127 21970 catalog_manager.cc:5697] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 3, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.128800 21970 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 3, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.131244 21970 catalog_manager.cc:5697] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 3, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:27.136656 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.765609 22112 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:27.140844 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 375205us
I20260709 12:27:27.140952 22142 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:27:27.143050 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 327133us
I20260709 12:27:27.134568 21970 catalog_manager.cc:5697] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 3, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:27:26.832731 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:27.121910 21967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 330) took 11779 ms (client timeout 15000 ms). Trace:
I20260709 12:27:27.142338 22112 leader_election.cc:400] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5.
W20260709 12:27:27.213903 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 586158us
W20260709 12:27:27.225196 22220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1921) took 5377 ms (client timeout 1868 ms). Trace:
W20260709 12:27:27.225801 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:27.225765 22220 rpcz_store.cc:269] 0709 12:27:21.847231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.750664 (+903433us) service_pool.cc:224] Handling call
0709 12:27:27.224596 (+4473932us) spinlock_profiling.cc:243] Waited 3.21 s on lock 0x7b540031b5d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:27.224867 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7375658368}
I20260709 12:27:27.226945 24715 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:27.228286 22221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 507) took 2120 ms (client timeout 2209 ms). Trace:
W20260709 12:27:27.240648 22213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1943) took 2156 ms (client timeout 1674 ms). Trace:
I20260709 12:27:27.268846 24929 raft_consensus.cc:3055] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:27.271958 24929 raft_consensus.cc:740] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:27.287173 24929 consensus_queue.cc:260] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:26.980060 24500 raft_consensus.cc:740] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:27.289876 24500 consensus_queue.cc:260] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:27.290927 24928 consensus_queue.cc:1059] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:27.292132 24500 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:27.285485 24583 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:27.275116 24920 consensus_queue.cc:1059] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:27.310096 24920 consensus_queue.cc:1243] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Peer ecc1814bfd604baa9cc66be8c02c5cfa log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:27:27.242146 22221 rpcz_store.cc:269] 0709 12:27:25.107504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.873642 (+766138us) service_pool.cc:224] Handling call
0709 12:27:27.227843 (+1354201us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400382cd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:27.228070 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791947136}
W20260709 12:27:27.279229 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:27.242499 22213 rpcz_store.cc:269] 0709 12:27:25.084218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.288377 (+204159us) service_pool.cc:224] Handling call
0709 12:27:27.240008 (+1951631us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54000889d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:27.240369 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695484160}
I20260709 12:27:27.303385 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2286) took 2045 ms. Trace:
I20260709 12:27:27.304095 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.305176 24767 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:27.306082 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.307497 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.308920 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.291970 24903 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:27.319396 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 673) took 1039 ms. Trace:
I20260709 12:27:27.311520 22139 rpcz_store.cc:276] 0709 12:27:25.257460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.257660 (+   200us) service_pool.cc:224] Handling call
0709 12:27:25.272761 (+ 15101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.272970 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:25.286833 (+ 13863us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.139853 (+1853020us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b18003ab820. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b 00007ff18c2a5d23 00007ff18c2a623a 00007ff18c710a2a
0709 12:27:27.302528 (+162675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:27.302661 (+   133us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:27.302773 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.302929 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.303165 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13744,"prepare.run_cpu_time_us":270,"prepare.run_wall_time_us":5684,"raft.queue_time_us":74764,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":6823,"spinlock_wait_cycles":10298112,"thread_start_us":64125,"threads_started":1,"wal-append.queue_time_us":1914621}
I20260709 12:27:27.326299 22803 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:27.329497 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:27.332968 24592 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.337426 24903 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:27.337905 22806 rpcz_store.cc:276] 0709 12:27:26.280083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.314069 (+ 33986us) service_pool.cc:224] Handling call
0709 12:27:26.949110 (+635041us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:26.949321 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.949753 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.949785 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:26.950286 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:27:27.198305 (+248019us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:27.199082 (+   777us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.199469 (+   387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.199787 (+   318us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:27.318729 (+118942us) raft_consensus.cc:1685] finished
0709 12:27:27.318869 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.319115 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":2753,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":4405,"spinlock_wait_cycles":5971072,"thread_start_us":244490,"threads_started":1,"wal-append.queue_time_us":246956}
I20260709 12:27:27.377796 24923 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.380331 24923 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:27.387691 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.388566 22213 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:27.388639 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.389530 22219 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:27.389977 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.390717 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.391023 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.392545 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.394223 22220 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:27.396760 24730 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:27.402870 24592 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.404857 24912 raft_consensus.cc:3055] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:27.405369 24912 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:27.405917 24592 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:27.407510 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 590947us
W20260709 12:27:27.408536 22188 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.587s (SENT)
I20260709 12:27:27.409005 22188 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:27.402948 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 807050us
W20260709 12:27:27.411213 22114 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:27.415740 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.416705 22139 raft_consensus.cc:2468] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:27.406366 24912 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:27.419476 24912 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:27.422653 24840 consensus_meta.cc:287] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.006s
I20260709 12:27:27.423266 24840 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:27.425992 24840 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:27.426733 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 125165us
W20260709 12:27:27.209125 21967 rpcz_store.cc:269] 0709 12:27:15.344468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.441010 (+ 96542us) service_pool.cc:224] Handling call
0709 12:27:16.267026 (+826016us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54003f70d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c670090 00007ff18c70ef3a 00007ff1924c4e9c 00007ff1925c304e 00007ff190a842a4 00007ff190a84232 00007ff190a84161 00007ff190a840dc 00007ff190a83392 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:27.121621 (+10854595us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:21.900088 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:22.096126 (+196038us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:22.096170 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:27:22.096188 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:22.122823 (+ 26635us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:22.177274 (+ 54451us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:22.191983 (+ 14709us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:27:22.506526 (+314543us) tablet.cc:701] Row locks acquired
0709 12:27:22.506554 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:27:22.583418 (+ 76864us) write_op.cc:270] Start()
0709 12:27:22.679940 (+ 96522us) write_op.cc:276] Timestamp: P: 1783600042579577 usec, L: 0
0709 12:27:22.679969 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:27:22.816327 (+136358us) log.cc:844] Serialized 2084 byte log entry
0709 12:27:24.323684 (+1507357us) op_driver.cc:464] REPLICATION: finished
0709 12:27:24.642275 (+318591us) write_op.cc:301] APPLY: starting
0709 12:27:24.642357 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:24.642501 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:24.642638 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:25.086453 (+443815us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:25.155909 (+ 69456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:27:25.171171 (+ 15262us) write_op.cc:312] APPLY: finished
0709 12:27:25.181309 (+ 10138us) log.cc:844] Serialized 47 byte log entry
0709 12:27:25.187811 (+  6502us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:25.187948 (+   137us) write_op.cc:454] Released schema lock
0709 12:27:25.197086 (+  9138us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:25.242669 (+ 45583us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:25.245322 (+  2653us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6417,"reported_tablets":14,"spinlock_wait_cycles":1087837952,"child_traces":[["op",{"apply.queue_time_us":318352,"apply.run_cpu_time_us":8941,"apply.run_wall_time_us":589909,"num_ops":5,"prepare.queue_time_us":546084,"prepare.run_cpu_time_us":24958,"prepare.run_wall_time_us":1508859,"raft.queue_time_us":508080,"raft.run_cpu_time_us":39218,"raft.run_wall_time_us":230073,"replication_time_us":1636128,"thread_start_us":1548458,"threads_started":4,"wal-append.queue_time_us":855815,"wal-append.run_cpu_time_us":14290,"wal-append.run_wall_time_us":2533984}]]}
W20260709 12:27:27.433862 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 291868us
I20260709 12:27:27.430554 22037 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:27.442335 22185 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:27.443377 22220 raft_consensus.cc:2468] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
W20260709 12:27:27.370889 24859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.008s	sys 0.014s
I20260709 12:27:27.370236 24903 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:27.436983 24437 consensus_meta.cc:287] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.008s
W20260709 12:27:27.440747 24753 consensus_meta.cc:287] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.003s
I20260709 12:27:27.432240 24595 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:27.458649 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 50127.5us
I20260709 12:27:27.464764 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:27.442471 24782 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:27.441028 24878 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:27.479689 24878 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:27.482077 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 108781us
I20260709 12:27:27.483161 24782 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.485324 24675 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:27.485875 24675 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.485922 24782 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:27.486397 24675 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:27.491318 22147 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:27.496595 24754 consensus_meta.cc:287] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.882s	user 0.017s	sys 0.003s
I20260709 12:27:27.497113 24754 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:27.500432 22775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.504946 24437 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:27.506742 24942 log.cc:927] Time spent T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:27:27.507535 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 178267us
I20260709 12:27:27.507236 24802 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.513090 24675 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.513964 24888 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.478767 24952 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:27.462193 24859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.008s	sys 0.015s
I20260709 12:27:27.504566 24592 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:27.494261 22036 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:27.524310 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.510339 24802 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:27.526950 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 96556.9us
I20260709 12:27:27.482272 24878 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:27.531840 24680 consensus_meta.cc:287] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.004s
I20260709 12:27:27.531584 24595 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.532364 22803 raft_consensus.cc:1240] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:27.523895 24859 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:27.532990 22188 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.650s (SENT)
I20260709 12:27:27.535084 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.539531 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.540048 24583 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.540565 24274 consensus_queue.cc:1048] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:27.515978 24929 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:27.541206 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.542156 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.542227 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.514572 24888 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.543274 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.545728 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:27.547897 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.556196 22143 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:27.557730 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.552050 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.515480 24675 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:27.552050 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:27.575039 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 44950.3us
I20260709 12:27:27.580608 22805 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:27:27.589159 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 95180.7us
I20260709 12:27:27.593806 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.595109 22806 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:27.517714 24753 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.494812 24876 consensus_queue.cc:1059] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 12:27:27.519081 24940 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:27:27.597970 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.620090 24754 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:27.599054 24782 raft_consensus.cc:2804] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:27.622819 24782 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.600211 24888 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:27.603001 22187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.038s	sys 0.051s
I20260709 12:27:27.603685 24799 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.604590 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.557390 24859 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:27.492436 24938 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 12:27:27.608278 22141 raft_consensus.cc:1240] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:27.609587 24946 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:27.617962 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.626984 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.625295 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.634213 22803 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
W20260709 12:27:27.629362 22187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.039s	sys 0.051s
I20260709 12:27:27.631693 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.636445 22222 raft_consensus.cc:2393] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:27.638559 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:27.639416 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:27.640301 22148 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:27.642910 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:27.623270 24782 raft_consensus.cc:3060] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:27.645488 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 49273.9us
W20260709 12:27:27.646688 22114 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:27.651921 24876 raft_consensus.cc:3055] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:27.652455 24876 raft_consensus.cc:740] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:27.631413 24946 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:27.642930 24761 consensus_meta.cc:287] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.006s
I20260709 12:27:27.631142 24799 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.580588 24583 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:27.663951 22145 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:27.673408 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2299) took 1179 ms. Trace:
I20260709 12:27:27.675067 24583 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:27.672392 22147 raft_consensus.cc:2376] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4. Re-sending same reply.
I20260709 12:27:27.664925 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:27.674988 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 142109us
I20260709 12:27:27.661592 24946 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:27.688113 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.691221 22144 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:27.673830 22140 rpcz_store.cc:276] 0709 12:27:26.459112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.563030 (+103918us) service_pool.cc:224] Handling call
0709 12:27:26.588247 (+ 25217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.609166 (+ 20919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.609195 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:27.335005 (+725810us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b2c00010828. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18afffa11 00007ff18b00f372 00007ff18c741a01 00007ff18c70643a 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2
0709 12:27:27.335781 (+   776us) log.cc:844] Serialized 26 byte log entry
0709 12:27:27.449234 (+113453us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:27.449271 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.459770 (+ 10499us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:27.623325 (+163555us) raft_consensus.cc:1685] finished
0709 12:27:27.623344 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.637944 (+ 14600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9974656,"thread_start_us":112974,"threads_started":1,"wal-append.queue_time_us":216737}
I20260709 12:27:27.699323 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:27.702332 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.667495 24680 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.708520 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.708990 22142 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:27.709210 22141 raft_consensus.cc:1240] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:27.653455 24876 consensus_queue.cc:260] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:27.704649 22188 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.655s (SENT)
I20260709 12:27:27.716382 22188 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:27.696249 24767 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.722260 22805 raft_consensus.cc:1240] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:27.686031 24928 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:27:27.719558 22114 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:27.721736 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 179992us
I20260709 12:27:27.726027 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.722337 22036 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:27.725684 22221 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:27.731331 22803 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
W20260709 12:27:27.737349 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.740494 22806 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:27.741945 22147 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:27.743070 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.743845 22801 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:27.744042 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.742146 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.745868 22810 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:27.746871 24861 consensus_meta.cc:287] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.658s	user 0.013s	sys 0.004s
I20260709 12:27:27.750309 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.750967 22222 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:27.752071 24444 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:27.747846 22808 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:27.754377 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:27.742496 22144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 569) took 2461 ms (client timeout 1541 ms). Trace:
I20260709 12:27:27.762586 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:27.759951 22144 rpcz_store.cc:269] 0709 12:27:25.280875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.307481 (+ 26606us) service_pool.cc:224] Handling call
0709 12:27:27.729284 (+2421803us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54003fc5d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:27.742364 (+ 13080us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5229461888}
I20260709 12:27:27.769516 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:27.770088 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.772024 22140 raft_consensus.cc:2393] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:27.775167 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.775904 22221 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:27.778085 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.778848 22220 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:27.779744 22802 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:27.787225 22803 raft_consensus.cc:2393] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:27.789274 22145 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:27.729460 24767 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.792321 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.779773 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:27.769902 22114 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:27.781579 24878 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:27.757879 24680 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:27.795161 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 90574.6us
I20260709 12:27:27.799368 22147 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:27.803275 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:27.798231 22114 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:27.806521 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:27.806744 22114 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:27.808104 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:27.809890 22148 raft_consensus.cc:2393] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:27.811489 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.812013 22145 raft_consensus.cc:2393] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:27.809209 22804 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:27.815394 22809 raft_consensus.cc:1275] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:27.817312 24680 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:27.819589 24903 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:27.822466 22143 raft_consensus.cc:1240] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:27.804713 24595 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:27.826820 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.827457 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.828773 22221 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:27.831282 22773 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:27.832767 22773 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:27.833721 22773 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:27.835182 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.836309 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.840008 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.840673 22805 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:27.844274 22803 raft_consensus.cc:1240] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:27.853677 24753 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:27.854060 22810 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:27.828456 24680 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:27.861363 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 125060us
I20260709 12:27:27.862653 22037 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:27.863909 24840 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:27.864317 24840 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:27.864763 24840 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:27.844398 24595 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:27.868959 22147 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:27.840448 24861 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:27.840221 24799 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:27.871017 22809 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:27.873093 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.873878 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.855122 24675 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.875531 22221 raft_consensus.cc:2410] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:27:27.877301 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 73059.8us
I20260709 12:27:27.877652 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:27.877985 22114 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:27.878525 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 44952us
I20260709 12:27:27.855363 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.881407 22809 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:27.882629 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.876950 24960 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:27.891144 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.891871 22221 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:27.890796 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 168568us
I20260709 12:27:27.883756 22139 raft_consensus.cc:2410] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:27.892452 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.893301 22803 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:27.894997 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.901835 22802 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:27.903030 22188 connection.cc:256] RPC call timeout handler was delayed by -1.05289866000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 12:27:27.906863 24675 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:27.907707 22805 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
W20260709 12:27:27.908396 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.945273 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 55254.8us
I20260709 12:27:27.914459 22112 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:27.916215 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.917994 24938 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:27.891172 24960 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:27.880949 24680 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:27.921944 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:27.922879 22773 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:27.926786 22775 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:27.928711 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.929814 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:27.953327 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 61837.5us
I20260709 12:27:27.954145 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.954983 22217 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:27.931409 22802 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:27.932045 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.934127 22221 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:27.935585 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.938946 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:27.941386 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45074.9us
I20260709 12:27:27.956955 22809 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
W20260709 12:27:27.946648 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:27.945951 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:27.946897 22808 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:27.956941 22807 raft_consensus.cc:2393] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:27.952283 22222 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:27.956980 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:27.960485 22213 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:27.961735 22220 raft_consensus.cc:2410] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:27.953958 24938 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:27.966415 22112 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:27.966724 22216 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:27.945629 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:27.977700 22805 raft_consensus.cc:2393] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:27.973178 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:27.973840 22806 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:27.981315 22147 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:27.971438 22807 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:27:27.968236 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.972294 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.988215 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.988935 22222 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:27.989549 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:27.984889 22776 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:27.953446 22801 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:27.990195 22808 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:27.956532 24960 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:27.993058 22216 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:28.002808 22144 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:28.003371 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:27.977900 24437 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:28.003945 22809 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:27:28.007633 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.001246 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:28.008198 22216 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:28.007125 22221 raft_consensus.cc:2468] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:27.972793 24730 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:28.009744 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.985707 24595 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:28.011997 22114 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:27.989923 24861 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:28.018731 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:28.020246 22221 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:28.020591 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:28.024880 22217 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:27.975315 24864 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:27:28.007238 24437 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:28.043781 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 47551.3us
I20260709 12:27:28.037011 22222 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:28.038293 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:27.970338 24822 consensus_queue.cc:1059] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:27:28.042024 22185 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:28.028594 22114 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:28.046727 24822 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:28.047271 22114 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:28.048169 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.048893 22147 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
W20260709 12:27:28.049674 22114 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:28.050168 22147 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:28.045394 24974 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:27:28.042899 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 120110us
I20260709 12:27:28.052040 22773 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:28.052781 24592 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:28.053647 22773 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:28.054868 24888 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:28.055495 24888 raft_consensus.cc:697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:28.056505 24888 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.059351 22773 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:28.061335 22773 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:28.061758 22216 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:28.063266 22773 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:28.071668 22140 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:28.073911 22139 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:28.067679 22215 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:27.970731 24938 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.078022 22218 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:28.078372 24886 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:28.078734 24938 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:28.078970 24886 raft_consensus.cc:697] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:28.079195 24966 consensus_queue.cc:1059] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:27:28.080114 24886 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.080928 24966 raft_consensus.cc:3055] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:28.081300 24966 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:28.081738 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:28.083509 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 193429us
I20260709 12:27:28.085078 22775 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:28.077890 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 56027.1us
I20260709 12:27:28.037878 24730 raft_consensus.cc:697] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:28.084949 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:28.089197 22216 raft_consensus.cc:1275] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:28.089579 22147 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:28.092311 22810 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:28.066610 24437 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:28.096568 22114 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:28.098737 22216 pending_rounds.cc:85] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting all ops after (but not including) 1
I20260709 12:27:28.106626 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.107254 22215 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:28.090024 24929 consensus_meta.cc:287] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.005s
I20260709 12:27:28.102979 22216 pending_rounds.cc:107] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:28.110831 22216 raft_consensus.cc:2889] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:28.113001 22221 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:28.115154 24785 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:28.116309 22146 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:27:28.116791 22146 pending_rounds.cc:85] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 5
I20260709 12:27:28.117090 22146 pending_rounds.cc:107] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:27:28.117348 22146 raft_consensus.cc:2889] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:28.113842 22114 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.120508 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:28.106156 24595 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:28.106979 24940 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.082139 24966 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:28.117453 24970 log.cc:927] Time spent T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:27:28.134485 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 71269.6us
I20260709 12:27:28.136447 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:28.137059 22773 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:28.139003 22147 raft_consensus.cc:2393] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:28.139201 22112 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:28.138702 22185 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:28.106498 24893 consensus_queue.cc:1048] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 12:27:28.133023 24595 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:28.146226 22112 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:28.146921 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:28.150846 24965 log.cc:927] Time spent T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:27:28.154898 22214 raft_consensus.cc:2955] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:28.149284 24753 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:28.160918 24940 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:28.162503 22216 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:28.163741 24940 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:28.166875 24785 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:28.167531 24785 raft_consensus.cc:697] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:28.168499 24785 consensus_queue.cc:237] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.147959 24876 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:28.172161 22801 raft_consensus.cc:1275] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:28.174885 24966 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:28.149150 24730 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.148216 22808 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:28.111208 24840 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.109494 24782 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:28.129041 24946 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.143537 24274 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:27:28.176360 24595 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:28.203970 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.149682 24500 consensus_queue.cc:1059] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:27:28.213416 24500 raft_consensus.cc:3055] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:28.217773 24500 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:28.219099 24718 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:28.220839 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.194644 24444 consensus_queue.cc:1059] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:27:28.223459 24444 raft_consensus.cc:3055] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:28.223834 24444 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:28.188220 22213 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:28.146282 24929 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:28.218765 24500 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.199432 24753 raft_consensus.cc:697] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:28.215788 22114 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:28.250183 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.199357 24864 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:28.255472 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.256603 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.194983 24940 consensus_queue.cc:1059] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:27:28.261139 22114 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:28.186219 22215 raft_consensus.cc:2468] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:28.264779 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.266220 24864 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:28.267262 24958 log.cc:927] Time spent T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.490s	user 0.002s	sys 0.002s
I20260709 12:27:28.266803 24753 consensus_queue.cc:237] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.268715 24864 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:28.279810 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 89582.4us
I20260709 12:27:28.255770 24929 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:28.282147 22213 raft_consensus.cc:2468] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:28.284034 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:28.264060 24500 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:28.291144 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.291885 22808 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:28.295274 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:28.319993 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.284322 24444 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.322881 24444 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:28.323323 24840 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:28.325282 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:28.344894 24437 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:28.349982 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:28.351672 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.352363 22215 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
W20260709 12:27:28.369968 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:28.373796 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 288841us
I20260709 12:27:28.373936 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.375200 22775 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:28.392416 22142 raft_consensus.cc:1240] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:28.392658 22213 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:28.294278 24929 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:28.397253 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:28.406581 22803 consensus_meta.cc:287] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.000s
I20260709 12:27:28.407229 22803 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
W20260709 12:27:28.412063 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 217937us
I20260709 12:27:28.412945 22112 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:28.454093 22213 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
W20260709 12:27:28.484287 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 76707.4us
I20260709 12:27:28.484905 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:28.485476 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 76638.8us
I20260709 12:27:28.483706 24903 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:28.488502 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 75656.1us
I20260709 12:27:28.410228 24802 raft_consensus.cc:2764] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:28.496616 24595 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.497973 22807 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:28.504396 24980 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:28.486690 24782 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:28.507139 24886 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:28.515892 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:28.484966 24946 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:28.494306 24730 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:28.510759 22112 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:28.519317 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:28.535238 24730 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:28.536355 24730 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.524776 24592 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:28.539791 24437 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:28.540217 24595 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:28.545754 24988 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:28.491370 24753 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:28.591182 22186 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Timed out: RequestConsensusVote RPC to 127.20.109.68:41677 timed out after 2.522s (SENT)
W20260709 12:27:28.594367 24993 log.cc:927] Time spent T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:27:28.596062 24753 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.605541 22215 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:28.649399 24274 raft_consensus.cc:3055] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:28.649926 24274 raft_consensus.cc:740] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:28.652105 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.663846 24992 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.664808 24992 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.678369 22220 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:28.693928 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 201364us
W20260709 12:27:28.720875 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.748296 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1744) took 1141 ms. Trace:
I20260709 12:27:28.761688 24946 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.748828 22146 rpcz_store.cc:276] 0709 12:27:27.606732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.606941 (+   209us) service_pool.cc:224] Handling call
0709 12:27:27.990804 (+383863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.117964 (+127160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.739737 (+621773us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400057150. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:28.748180 (+  8443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882098048}
I20260709 12:27:28.762490 24946 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:28.701927 24274 consensus_queue.cc:260] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.764528 24274 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:28.764954 24946 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:28.769579 22037 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:28.771216 24866 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:28.772257 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.716249 24437 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:28.777176 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:28.776046 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.783746 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.784669 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:28.785071 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:28.785537 22220 raft_consensus.cc:2376] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4. Re-sending same reply.
W20260709 12:27:28.785944 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 274546us
W20260709 12:27:28.784186 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 289764us
I20260709 12:27:28.599617 24988 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:28.787665 22114 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:28.788457 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:28.785683 22221 raft_consensus.cc:2376] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5. Re-sending same reply.
I20260709 12:27:28.791492 22213 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:28.792594 22213 raft_consensus.cc:1240] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:27:28.793901 22213 raft_consensus.cc:1275] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:28.795681 22213 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:28.774124 24866 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.799877 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:28.800652 22222 raft_consensus.cc:2376] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6. Re-sending same reply.
I20260709 12:27:28.800789 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:28.801404 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:28.790202 24437 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:28.801348 22803 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:28.806761 24437 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.800135 24866 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:28.815531 22803 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:28.820500 24988 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:28.827764 22037 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:28.842166 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.730s (SENT)
I20260709 12:27:28.842825 22188 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:28.843091 24949 consensus_queue.cc:1059] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:27:28.844820 24996 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:28.844087 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.867s (SENT)
I20260709 12:27:28.845852 22188 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:28.836102 24782 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:28.847007 24782 raft_consensus.cc:697] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:28.847922 24782 consensus_queue.cc:237] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.836166 24886 consensus_queue.cc:1048] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:27:28.853048 24997 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:28.853777 24997 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.858955 24767 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:28.858613 24979 log.cc:927] Time spent T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.645s	user 0.003s	sys 0.003s
I20260709 12:27:28.861099 24946 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.861918 24946 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:28.863286 24799 raft_consensus.cc:3055] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:28.863721 24799 raft_consensus.cc:740] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:28.865031 24997 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:28.864629 24799 consensus_queue.cc:260] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:28.844039 24949 raft_consensus.cc:3055] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:28.866305 24949 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:28.867238 24949 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:28.838768 24960 consensus_meta.cc:287] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.829s	user 0.009s	sys 0.003s
I20260709 12:27:28.869307 24500 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:28.869437 24960 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:28.873307 22188 leader_election.cc:336] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.881s (SENT)
I20260709 12:27:28.874047 22188 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:28.876039 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 222581us
W20260709 12:27:28.876792 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:28.877054 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.884598 22215 raft_consensus.cc:1275] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:28.886700 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 47072.4us
I20260709 12:27:28.878906 24949 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:28.890527 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.891117 24886 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:28.892865 24753 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:28.915853 22188 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.211s (SENT)
I20260709 12:27:28.932791 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:28.933578 22215 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:28.915262 22114 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:28.936062 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:28.939395 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.901221 24992 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:28.952927 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 54658.1us
W20260709 12:27:28.912359 24966 consensus_meta.cc:287] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.003s
I20260709 12:27:28.904028 24960 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:28.975510 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 69499.7us
I20260709 12:27:28.991948 22215 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:27:28.993908 24999 log.cc:927] Time spent T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:27:28.997742 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.972397 24966 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.020933 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:29.023298 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.239s (SENT)
I20260709 12:27:28.980504 24946 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.022503 24966 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.036994 24966 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.037498 24966 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.039956 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2378) took 1102 ms. Trace:
I20260709 12:27:29.038035 24966 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.044924 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:29.045023 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:29.045755 22220 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:29.040320 22217 rpcz_store.cc:276] 0709 12:27:27.937381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.039167 (+101786us) service_pool.cc:224] Handling call
0709 12:27:28.040955 (+  1788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:28.044112 (+  3157us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:28.153738 (+109626us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b18000d9f00. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189616455 00007ff1900fe3c7 00007ff18c7109a7 00007ff18c7200bf 00007ff18c720038
0709 12:27:28.365511 (+211773us) log.cc:844] Serialized 14 byte log entry
0709 12:27:28.537564 (+172053us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b18000d9f00. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895e72a6 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1
0709 12:27:28.538506 (+   942us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b18000d9f00. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:27:28.775315 (+236809us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:28.798523 (+ 23208us) log.cc:844] Serialized 26 byte log entry
0709 12:27:28.798821 (+   298us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:28.799121 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 12:27:28.827065 (+ 27944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.827137 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:28.867881 (+ 40744us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18000d9f00. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff189619522 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:27:29.039757 (+171876us) raft_consensus.cc:1685] finished
0709 12:27:29.039777 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.039891 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67473,"prepare.queue_time_us":2342,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":99,"raft.queue_time_us":200148,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":17618,"spinlock_wait_cycles":110373120,"thread_start_us":405510,"threads_started":2,"wal-append.queue_time_us":480285}
I20260709 12:27:29.040601 24782 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.045678 22215 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:29.053153 22775 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:29.055760 22220 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:29.044171 24946 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:29.057653 22038 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:29.060657 22215 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:29.044411 24988 consensus_queue.cc:1048] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:27:29.060838 24960 raft_consensus.cc:2764] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:29.084651 24966 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.058952 24946 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.092546 24946 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:29.093119 25017 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.093729 25017 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:29.075354 22188 leader_election.cc:336] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.436s (SENT)
W20260709 12:27:29.103765 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 50704.9us
I20260709 12:27:29.106241 22188 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:29.102802 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:29.107834 22775 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:29.059595 24782 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:29.110546 22776 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:29.111984 22776 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:29.114439 24929 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:29.109284 24966 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:29.115990 24966 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:29.116364 24966 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:29.116530 24866 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.120525 24675 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:29.123492 22775 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:29.115623 22188 leader_election.cc:336] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 3.136s (SENT)
I20260709 12:27:29.125538 22775 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.133674 22188 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:29.135231 22805 raft_consensus.cc:1240] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:29.136385 24802 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:29.126137 24785 raft_consensus.cc:2764] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:29.142957 22036 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:29.144248 24876 raft_consensus.cc:3060] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:29.146799 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.125779 24988 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:29.109157 25013 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.151842 22144 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:29.153285 24274 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:29.173723 24966 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:29.174669 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.191958 24966 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.193972 24966 consensus_queue.cc:1059] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:29.203604 24874 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.204252 24874 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:29.207026 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 81614.4us
I20260709 12:27:29.207897 22775 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.208256 24782 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.209060 22775 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:29.198766 25017 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.210798 24785 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:29.211591 24785 raft_consensus.cc:2804] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:29.212147 22775 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.216353 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:29.137584 24980 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:29.203604 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 88007.9us
I20260709 12:27:29.222469 22218 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:29.239444 22144 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:29.240550 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:29.241101 22141 raft_consensus.cc:1275] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:29.241494 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:29.243281 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:29.243942 22145 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:29.245795 22775 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.241160 22144 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:27:29.248445 22776 leader_election.cc:336] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:29.249123 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:29.242952 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:29.239254 24866 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:29.212074 24785 raft_consensus.cc:697] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:29.155526 24988 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:29.255414 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 204356us
I20260709 12:27:29.269958 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:29.270278 22140 raft_consensus.cc:1240] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:29.257895 22188 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 3.211s (SENT)
I20260709 12:27:29.271561 22188 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:29.262249 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.267055 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:29.208997 25013 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.273288 22139 raft_consensus.cc:2393] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:29.281396 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:29.282181 22808 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:29.283687 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:29.284158 22217 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:29.285888 22113 leader_election.cc:336] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.744s (SENT)
I20260709 12:27:29.287288 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.280740 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1964) took 1160 ms. Trace:
I20260709 12:27:29.284484 22146 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:29.289723 22216 rpcz_store.cc:276] 0709 12:27:28.119935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.136144 (+ 16209us) service_pool.cc:224] Handling call
0709 12:27:29.280483 (+1144339us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5400118854. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:29.280652 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58230144}
I20260709 12:27:29.293869 22805 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:27:29.296028 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.254469 24592 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:29.298007 22803 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:27:29.269855 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 118839us
I20260709 12:27:29.274130 24988 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:29.274405 24980 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:29.304219 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:29.314891 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:29.315539 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:29.316190 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:29.316833 22222 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:29.303061 24274 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:29.320458 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:29.319954 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:29.325409 22146 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:29.320727 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:29.322818 22113 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.322365 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:29.340030 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.323493 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:29.322978 22807 raft_consensus.cc:2368] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:29.319433 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2373) took 1378 ms. Trace:
W20260709 12:27:29.331534 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 46687.8us
I20260709 12:27:29.376323 22145 raft_consensus.cc:2393] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:29.325785 22219 raft_consensus.cc:2376] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5. Re-sending same reply.
W20260709 12:27:29.339879 20917 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 22054)
I20260709 12:27:29.322712 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:29.378470 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 46136.6us
W20260709 12:27:29.393299 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.318876 24997 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.377228 22214 rpcz_store.cc:276] 0709 12:27:27.928976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.932627 (+  3651us) service_pool.cc:224] Handling call
0709 12:27:27.933206 (+   579us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:27.933843 (+   637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:27.933874 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:27.988614 (+ 54740us) log.cc:844] Serialized 527 byte log entry
0709 12:27:28.087668 (+ 99054us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:28.346630 (+258962us) log.cc:844] Serialized 14 byte log entry
0709 12:27:29.213861 (+867231us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18001964e0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189616455 00007ff1900fe3c7 00007ff18c7109a7 00007ff18c7200bf 00007ff18c720038
0709 12:27:29.303417 (+ 89556us) log.cc:844] Serialized 14 byte log entry
0709 12:27:29.303779 (+   362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.303848 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:29.307437 (+  3589us) raft_consensus.cc:1685] finished
0709 12:27:29.307456 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.307581 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":171858,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":8436,"raft.run_cpu_time_us":417,"raft.run_wall_time_us":41058,"spinlock_wait_cycles":3940224,"thread_start_us":133355,"threads_started":2,"wal-append.queue_time_us":80609}
I20260709 12:27:29.317914 24991 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:29.495213 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:29.497814 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 96335.3us
I20260709 12:27:29.319751 25022 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.320928 24767 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:29.306946 24929 consensus_queue.cc:1059] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:27:29.322872 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:29.514017 22806 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:29.518123 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:29.518864 22803 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:27:29.505692 24978 log.cc:927] Time spent T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:27:29.317422 24952 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
I20260709 12:27:29.320966 24995 consensus_queue.cc:1059] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.204s
I20260709 12:27:29.401276 24680 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:29.498116 24437 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:29.551469 24990 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:29.551371 24995 raft_consensus.cc:3055] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:29.562572 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:29.584125 22807 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
W20260709 12:27:29.563143 25018 log.cc:927] Time spent T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:27:29.576398 24592 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.401676 24912 consensus_queue.cc:1059] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 12:27:29.596118 24592 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.596843 24912 raft_consensus.cc:3055] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:27:29.597169 24949 consensus_meta.cc:287] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.698s	user 0.005s	sys 0.005s
I20260709 12:27:29.597764 24995 raft_consensus.cc:740] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:29.524173 24785 consensus_queue.cc:237] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.598769 24995 consensus_queue.cc:260] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.600608 22146 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
W20260709 12:27:29.617136 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 222795us
I20260709 12:27:29.618430 24949 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:29.636940 25020 consensus_queue.cc:1048] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:29.642181 24992 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:29.642975 24992 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.637091 22036 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:29.656594 25020 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:29.548242 24675 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:29.500787 24997 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.543264 22801 raft_consensus.cc:2376] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6. Re-sending same reply.
W20260709 12:27:29.703011 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.463s (SENT)
I20260709 12:27:29.596105 24876 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:29.503065 24991 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.597301 24912 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:29.700766 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:29.731490 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 424185us
I20260709 12:27:29.516646 25022 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.732714 22113 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:29.734864 22803 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:29.665931 24988 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:29.737187 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 70193.9us
I20260709 12:27:29.744059 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:29.752324 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 249363us
I20260709 12:27:29.703032 24952 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:29.755028 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 360145us
I20260709 12:27:29.599977 24990 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.763104 24592 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.763749 24592 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.764313 24592 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:29.767098 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 166232us
I20260709 12:27:29.769109 22038 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.739675 24995 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:29.716272 24675 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:29.783460 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 50886.4us
I20260709 12:27:29.794827 22113 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:29.795747 22188 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.522s (SENT)
I20260709 12:27:29.796262 22188 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:29.757442 24876 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:29.799170 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:29.750780 22148 raft_consensus.cc:1240] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:29.756760 24802 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:29.798120 22186 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:29.766517 24592 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:29.774991 24923 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:29.839530 22186 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:29.848297 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.801772 24876 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.770126 24992 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:29.858175 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.912s (SENT)
I20260709 12:27:29.768591 24952 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.862625 25033 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:29.864578 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 105288us
I20260709 12:27:29.803921 25017 consensus_queue.cc:1059] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:27:29.891158 25017 consensus_queue.cc:1243] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:27:29.803031 24680 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:27:29.892552 24680 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:29.892969 24680 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.893329 24680 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:29.841913 24912 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.851408 25013 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:29.895486 22038 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.896668 24990 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.897236 22038 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:29.883987 24675 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:29.835353 24802 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.887221 25022 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.889621 24997 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:29.902410 22218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 1980) took 1644 ms (client timeout 2146 ms). Trace:
W20260709 12:27:29.903045 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 50094.3us
I20260709 12:27:29.854393 24876 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:29.804363 24753 consensus_queue.cc:1048] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:27:29.932423 25013 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:29.864219 24992 raft_consensus.cc:2804] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:29.933555 24992 raft_consensus.cc:697] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:29.915633 22218 rpcz_store.cc:269] 0709 12:27:28.257769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.669011 (+411242us) service_pool.cc:224] Handling call
0709 12:27:29.902201 (+1233190us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54000e79d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:29.902319 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818918656}
I20260709 12:27:29.854154 25029 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:29.934477 24992 consensus_queue.cc:237] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:29.898993 24929 raft_consensus.cc:2764] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:29.902675 24988 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:29.958647 24799 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:29.960353 24274 raft_consensus.cc:3055] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:29.949152 25017 raft_consensus.cc:3060] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:29.978168 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:29.979027 22143 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:29.975956 24274 raft_consensus.cc:740] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:29.983314 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2389) took 1091 ms. Trace:
I20260709 12:27:29.983675 24274 consensus_queue.cc:260] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:29.983734 22217 rpcz_store.cc:276] 0709 12:27:28.891499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.048907 (+157408us) service_pool.cc:224] Handling call
0709 12:27:29.280644 (+231737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:29.284581 (+  3937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.983091 (+698510us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400118850. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:29.983250 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514637056}
I20260709 12:27:29.984776 24274 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:29.988391 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:29.989451 22802 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
W20260709 12:27:30.006843 25000 log.cc:927] Time spent T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 1.089s	user 0.005s	sys 0.017s
W20260709 12:27:30.040759 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:30.041394 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:30.046847 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 149650us
W20260709 12:27:30.050895 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 211427us
W20260709 12:27:30.052250 22188 leader_election.cc:336] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 3.102s (SENT)
I20260709 12:27:30.053149 22188 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.059973 22186 leader_election.cc:400] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
I20260709 12:27:30.060477 22186 leader_election.cc:403] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:30.058198 24859 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.063509 24859 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.059245 24929 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:27:30.072604 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:30.073577 22218 raft_consensus.cc:2393] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:30.061270 24840 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.083839 22038 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:30.085925 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.092693 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:30.092937 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 298181us
I20260709 12:27:30.094141 22113 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.095850 22145 raft_consensus.cc:1240] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:30.099002 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.066865 24802 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.099972 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:30.103492 22141 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:30.103351 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.104681 22142 raft_consensus.cc:1240] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:30.105636 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:30.106254 22219 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:30.108304 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.108917 22803 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:30.109162 22805 raft_consensus.cc:1275] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:30.111586 22145 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:30.113281 25020 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:30.114467 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 66148.5us
I20260709 12:27:30.115293 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:30.114866 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:30.117461 22112 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.120078 22112 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.120478 22221 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:30.123311 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.092736 24437 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:30.100548 24991 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:30.096240 25033 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 3. Current term is 4.
W20260709 12:27:30.124755 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 76252.5us
I20260709 12:27:30.070124 24996 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:27:30.126228 22143 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:30.124167 22218 raft_consensus.cc:1240] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:30.107072 24923 raft_consensus.cc:697] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:30.130069 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.110137 24878 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.115172 24753 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:30.113937 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.096060 24840 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:30.134889 22188 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 3.213s (SENT)
I20260709 12:27:30.134752 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.119488 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.169364 22806 raft_consensus.cc:2393] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:30.149561 25039 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.150250 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:30.157320 22219 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:30.117306 24929 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:27:30.129776 24952 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.145159 24761 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:27:30.123777 24990 consensus_queue.cc:1048] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:27:30.131541 24437 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.181388 22801 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:30.245965 25042 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:30.167423 22218 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:30.161033 25041 raft_consensus.cc:2804] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:30.249887 24923 consensus_queue.cc:237] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.250078 25039 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:30.253093 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 78275.6us
I20260709 12:27:30.255935 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:30.180485 22803 raft_consensus.cc:1240] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:30.235615 25043 log.cc:927] Time spent T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:27:30.263463 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 128596us
W20260709 12:27:30.266813 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.245622 24859 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:30.237022 24822 raft_consensus.cc:3055] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:30.268486 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 145383us
W20260709 12:27:30.269263 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 149276us
I20260709 12:27:30.234241 24874 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:30.235904 24730 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:30.275192 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:30.280067 22215 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:30.266664 24680 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.180275 24753 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:30.261884 24861 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.285918 22221 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:30.261632 24988 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:30.292493 25040 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:30.161173 25036 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 12:27:30.251492 25041 raft_consensus.cc:697] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:30.294559 22113 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:30.298382 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 183156us
I20260709 12:27:30.317725 22217 raft_consensus.cc:2393] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:30.206432 24878 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.278939 24822 raft_consensus.cc:740] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:30.323119 22037 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:30.325333 22037 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:30.325609 22113 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:30.280889 24592 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:27:30.335503 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.295855 24437 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:30.337360 22808 raft_consensus.cc:2410] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:27:30.353960 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 235349us
I20260709 12:27:30.355289 22221 raft_consensus.cc:2468] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:30.336623 24785 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.356122 22112 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:30.358392 25042 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:30.359004 25042 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.359380 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:30.360957 21970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46372 (request call id 298) took 9150 ms. Trace:
I20260709 12:27:30.362326 24928 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:30.333506 24874 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:30.361490 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:30.364145 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 104590us
I20260709 12:27:30.364915 22775 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.295351 24753 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.335803 24859 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:30.335963 24990 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:30.372000 22775 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:30.374147 22113 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.374686 25031 raft_consensus.cc:2804] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:30.323969 25030 consensus_queue.cc:1059] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:27:30.376068 22038 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:30.377281 25035 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:27:30.377964 24980 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:30.366524 24928 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:30.375183 25020 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.297914 24861 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.367118 24730 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:30.374704 25038 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.364425 24802 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:30.369482 24874 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.371749 24437 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:30.395877 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.361510 21970 rpcz_store.cc:276] 0709 12:27:21.210752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.214739 (+  3987us) service_pool.cc:224] Handling call
0709 12:27:30.360871 (+9146132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:27.518322 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:27.651894 (+133572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:27.651950 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:27:27.651970 (+    20us) tablet.cc:662] Decoding operations
0709 12:27:27.652785 (+   815us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:27.652853 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:27.652880 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:27:27.653609 (+   729us) tablet.cc:701] Row locks acquired
0709 12:27:27.653659 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:27:27.653839 (+   180us) write_op.cc:270] Start()
0709 12:27:27.654003 (+   164us) write_op.cc:276] Timestamp: P: 1783600047653769 usec, L: 0
0709 12:27:27.654026 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:27:27.712585 (+ 58559us) log.cc:844] Serialized 2079 byte log entry
0709 12:27:28.111008 (+398423us) op_driver.cc:464] REPLICATION: finished
0709 12:27:28.700600 (+589592us) write_op.cc:301] APPLY: starting
0709 12:27:28.700710 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:28.700932 (+   222us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:28.714245 (+ 13313us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:28.718215 (+  3970us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:28.718619 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:27:28.718669 (+    50us) write_op.cc:312] APPLY: finished
0709 12:27:28.719049 (+   380us) log.cc:844] Serialized 47 byte log entry
0709 12:27:28.719299 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:28.719458 (+   159us) write_op.cc:454] Released schema lock
0709 12:27:28.719525 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:28.822195 (+102670us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:28.824646 (+  2451us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1074092,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":577620,"apply.run_cpu_time_us":3808,"apply.run_wall_time_us":77874,"num_ops":5,"prepare.queue_time_us":294927,"prepare.run_cpu_time_us":13914,"prepare.run_wall_time_us":408365,"raft.queue_time_us":175677,"raft.run_cpu_time_us":18125,"raft.run_wall_time_us":347667,"replication_time_us":432885,"spinlock_wait_cycles":2944,"thread_start_us":486991,"threads_started":4,"wal-append.queue_time_us":134917,"wal-append.run_cpu_time_us":23298,"wal-append.run_wall_time_us":1869862}]]}
I20260709 12:27:30.361547 25042 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.382879 25031 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:30.387219 24960 raft_consensus.cc:2804] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:30.405905 22807 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:30.388113 24859 raft_consensus.cc:697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:30.390048 24990 raft_consensus.cc:697] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:30.388717 24992 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:30.394846 25017 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:30.381547 24761 consensus_queue.cc:1048] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:27:30.396432 24929 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.416399 22038 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:30.372005 24785 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.406504 24874 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:30.405673 24437 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:30.425508 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 136255us
I20260709 12:27:30.437726 24840 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:30.450968 22188 leader_election.cc:336] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:30.451560 22188 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.409829 25031 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:30.403654 25040 consensus_queue.cc:1059] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:27:30.418653 24992 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:30.462510 24992 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:30.463510 25034 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:30.464435 24990 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.466801 24866 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:30.467598 25039 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:30.468115 25045 log.cc:927] Time spent T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 12:27:30.468688 25042 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:30.468833 24878 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:30.425684 24929 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.405562 24822 consensus_queue.cc:260] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:30.471796 22188 leader_election.cc:336] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:30.375263 25041 consensus_queue.cc:237] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.449353 24437 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:30.404337 25038 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:30.480098 25048 log.cc:927] Time spent T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:27:30.470515 25040 raft_consensus.cc:3055] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:30.461149 24928 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.524657 25038 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:30.525779 22803 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:30.482880 25034 raft_consensus.cc:697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:30.527304 25034 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.529172 24680 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:30.405751 24802 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.532195 24802 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.533573 24802 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:30.483624 24866 raft_consensus.cc:697] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:30.411710 24730 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:27:30.535279 25040 raft_consensus.cc:740] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:30.535640 24730 consensus_queue.cc:1243] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer ecc1814bfd604baa9cc66be8c02c5cfa log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:30.422432 24960 raft_consensus.cc:697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:30.536787 24960 consensus_queue.cc:237] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.538574 22804 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:30.539388 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 766) took 1262 ms. Trace:
I20260709 12:27:30.534373 25031 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.478627 25046 consensus_queue.cc:1048] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:27:30.456874 24859 consensus_queue.cc:237] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.541749 25031 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:30.499933 24995 consensus_meta.cc:287] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.013s
W20260709 12:27:30.500739 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 84425.5us
I20260709 12:27:30.509892 24822 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:30.550091 24785 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:30.512233 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:30.553936 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.518730 22188 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.506464 22037 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:30.554977 22036 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:30.512168 24929 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.534083 24802 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:30.474109 24876 consensus_meta.cc:287] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.545s	user 0.015s	sys 0.008s
W20260709 12:27:30.557994 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 51664.3us
I20260709 12:27:30.640473 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.641263 22147 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
W20260709 12:27:30.645848 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.576610 24946 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:30.662722 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:30.677614 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.684777 22036 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:30.709920 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.727236 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.535370 24866 consensus_queue.cc:237] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:30.732968 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 70390.2us
I20260709 12:27:30.725837 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:30.733103 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 261356us
I20260709 12:27:30.733920 22805 raft_consensus.cc:2393] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:30.539810 22804 rpcz_store.cc:276] 0709 12:27:29.277387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.283785 (+  6398us) service_pool.cc:224] Handling call
0709 12:27:30.538143 (+1254358us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1e9c 00007ff1895e1a5b 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:30.538368 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.539093 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.539306 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10837760}
I20260709 12:27:30.734313 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:30.641409 24767 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:30.733916 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 336571us
W20260709 12:27:30.726087 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 85182.3us
I20260709 12:27:30.539402 24992 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.740181 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.742373 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:30.744951 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:30.621953 24876 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.756378 22038 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:30.695719 24995 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.732080 24946 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.683632 24929 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:30.737341 25039 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:30.714546 24966 consensus_queue.cc:1048] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:27:30.739284 25031 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:30.772920 22038 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:30.763425 22036 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:30.726186 24878 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:27:30.777486 24802 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.779738 25032 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:30.780215 25032 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.780575 25032 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:30.782938 24675 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.782810 24929 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:30.783618 24929 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.783522 24675 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.785852 24929 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.770387 25042 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:30.747066 24767 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.785964 24675 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:30.787107 25042 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.787949 25017 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:30.788358 25017 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:30.788713 25017 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:30.789268 25042 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.789409 24767 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:30.765925 24799 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:30.761482 24785 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.765573 24946 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:30.809692 22113 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.794162 25021 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:30.725816 25040 consensus_queue.cc:260] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:30.814710 22185 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.66:46283 timed out after 2.529s (SENT) [suppressed 127 similar messages]
I20260709 12:27:30.847848 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:30.769703 24995 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:30.848603 22219 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 3.
I20260709 12:27:30.805051 25013 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:30.851965 22113 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.843096 25030 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:30.854457 25030 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.856617 25030 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:30.857442 25049 log.cc:927] Time spent T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:27:30.856597 24995 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:30.839233 24923 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:30.858918 24923 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:30.837476 25021 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.872805 22214 raft_consensus.cc:1240] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:30.887312 22218 raft_consensus.cc:1275] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:27:30.864936 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 495945us
I20260709 12:27:30.859338 24923 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:30.890434 22112 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.805302 25039 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:27:30.895340 22775 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:30.896716 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 44822.5us
I20260709 12:27:30.900261 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:30.862614 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:30.814559 24785 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:30.904503 22112 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:30.907955 22188 leader_election.cc:336] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.548s (SENT)
I20260709 12:27:30.904749 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.909083 22139 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:30.928310 22112 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:30.928855 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.930891 22810 raft_consensus.cc:1240] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:30.893294 25021 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:30.946208 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.949640 22144 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:30.950517 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.952565 22143 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:30.852906 25013 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.930074 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.951746 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.957757 22141 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:30.959671 22147 raft_consensus.cc:2393] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:30.907371 25030 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:30.862054 25042 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:27:30.923058 24997 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:30.973083 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 44884.8us
I20260709 12:27:31.027241 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:31.025666 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:30.953166 24767 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:30.963056 25013 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:30.908077 25057 raft_consensus.cc:2804] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:31.055336 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.034444 22810 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:31.006659 22802 raft_consensus.cc:1240] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:31.069476 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:31.053748 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:31.063515 25065 log.cc:927] Time spent T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:27:30.931833 25064 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 12:27:31.004918 24990 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:31.059819 22773 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:31.038144 24767 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:31.074808 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:31.088634 22219 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 3.
I20260709 12:27:31.075197 22218 raft_consensus.cc:3055] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:31.089315 22218 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:31.075770 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:31.090174 22221 raft_consensus.cc:2376] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7. Re-sending same reply.
I20260709 12:27:31.076639 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:31.091089 22214 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:31.058755 24675 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:31.060020 24437 consensus_meta.cc:287] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
I20260709 12:27:31.063361 25038 raft_consensus.cc:3055] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:31.078341 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:31.078722 25063 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.093479 22773 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:31.099654 25054 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:31.101109 25044 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.101225 25042 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:31.104554 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 654359us
I20260709 12:27:31.156438 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:31.103737 22218 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.157027 22219 raft_consensus.cc:1813] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Handling vote request from an unknown peer 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:31.072775 24992 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:31.149482 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:31.154047 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:31.153910 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 60507.2us
I20260709 12:27:31.158862 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.159334 22773 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:31.160485 22773 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:31.151849 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:31.157555 22219 raft_consensus.cc:2393] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 8: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:31.091773 24767 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:31.233300 22114 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:31.108693 24876 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:31.108108 24988 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:31.246394 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.251075 25058 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:31.250787 25059 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:27:31.251655 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:31.273248 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 112819us
I20260709 12:27:31.164935 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.276281 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.112497 25038 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:31.163460 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.162694 24960 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:31.111384 24675 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:31.262058 22148 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:31.157270 25057 raft_consensus.cc:697] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:31.140352 24437 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:31.277995 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.285646 22140 raft_consensus.cc:2393] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:31.163894 24929 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
W20260709 12:27:31.289760 25067 log.cc:927] Time spent T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.336s	user 0.000s	sys 0.000s
W20260709 12:27:31.290745 25071 log.cc:927] Time spent T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 12:27:31.291103 25056 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:31.291963 25069 log.cc:927] Time spent T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:27:31.383944 24437 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:31.243958 25035 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:31.387553 25061 log.cc:927] Time spent T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:27:31.388166 25038 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:31.389047 25079 log.cc:927] Time spent T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:27:31.389263 25038 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:31.382519 24785 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:31.393077 25073 log.cc:927] Time spent T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:27:31.394568 25078 log.cc:927] Time spent T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
W20260709 12:27:31.398123 25017 consensus_meta.cc:287] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.000s
W20260709 12:27:31.349970 22114 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:31.267196 25066 log.cc:927] Time spent T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.180s	user 0.000s	sys 0.005s
I20260709 12:27:31.238417 24802 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:31.165371 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:31.380051 25052 log.cc:927] Time spent T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.419s	user 0.009s	sys 0.000s
I20260709 12:27:31.294463 24960 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.283810 25022 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.381959 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:31.384784 22143 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:31.233687 25044 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:31.411718 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.145977 25063 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:31.408311 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 60915us
W20260709 12:27:31.356504 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 246945us
I20260709 12:27:31.407917 24929 consensus_queue.cc:1243] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:27:31.429453 22036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.002s	sys 0.003s
W20260709 12:27:31.410188 24980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.005s	sys 0.024s
W20260709 12:27:31.431284 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 49437.5us
I20260709 12:27:31.158301 25054 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.443527 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:31.434306 22114 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:31.444939 22114 leader_election.cc:336] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:31.435601 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:31.439436 22036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.002s	sys 0.003s
I20260709 12:27:31.445359 22114 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:31.449633 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 651918us
I20260709 12:27:31.431296 24960 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:31.426295 22038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.000s	sys 0.004s
W20260709 12:27:31.442227 24980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.006s	sys 0.025s
I20260709 12:27:31.398586 25017 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.438544 24753 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:31.458010 24874 consensus_meta.cc:287] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.005s	user 0.008s	sys 0.003s
W20260709 12:27:31.465972 22038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.001s	sys 0.004s
I20260709 12:27:31.443222 25035 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:27:31.471948 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 668350us
I20260709 12:27:31.495142 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:31.498435 22145 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:31.438650 25022 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.466585 25046 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:31.510630 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 773) took 1336 ms. Trace:
I20260709 12:27:31.467077 24980 raft_consensus.cc:697] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:31.402058 24767 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.518206 22806 rpcz_store.cc:276] 0709 12:27:30.173807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.206245 (+ 32438us) service_pool.cc:224] Handling call
0709 12:27:30.206678 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.230006 (+ 23328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.230036 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:30.251801 (+ 21765us) log.cc:844] Serialized 26 byte log entry
0709 12:27:30.731563 (+479762us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:30.731604 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.731671 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:31.510368 (+778697us) raft_consensus.cc:1685] finished
0709 12:27:31.510388 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:31.510545 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15829,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3131,"thread_start_us":442396,"threads_started":1,"wal-append.queue_time_us":570839}
I20260709 12:27:31.416788 25056 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.471622 24753 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:31.533895 22142 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:31.474272 25086 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:31.545864 25080 log.cc:927] Time spent T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:27:31.540792 24753 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:31.551839 24912 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:31.553419 25022 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:31.555236 22142 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:31.503926 25035 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.555444 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 777) took 1184 ms. Trace:
I20260709 12:27:31.558303 22809 rpcz_store.cc:276] 0709 12:27:30.370738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.370859 (+   121us) service_pool.cc:224] Handling call
0709 12:27:30.572260 (+201401us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:30.572481 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.641497 (+ 69016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.641533 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.641575 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:30.641607 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.555203 (+913596us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b54006d3154. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:31.555254 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:31.555381 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161154688}
I20260709 12:27:31.572804 22185 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:31.573403 24861 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:31.573621 24996 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.574664 24592 raft_consensus.cc:3055] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:31.494966 24874 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.578863 22145 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
W20260709 12:27:31.544548 25030 consensus_meta.cc:287] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.003s
I20260709 12:27:31.551743 25017 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:31.597935 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.601397 22145 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:31.607156 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.608184 22145 raft_consensus.cc:2410] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:27:31.574829 25086 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:31.578846 24929 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.495862 25057 consensus_queue.cc:237] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:31.596578 24996 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.746387 25044 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:31.598387 24592 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:31.749797 25087 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.750192 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:31.750365 25087 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.751662 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:31.751770 22775 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:31.752746 25087 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:31.753291 25087 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.753712 25059 raft_consensus.cc:2804] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:31.754128 25059 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.754477 25059 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:31.754844 25042 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.754700 25094 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.220s
I20260709 12:27:31.758491 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:31.740295 22143 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:31.684166 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:31.763387 22215 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:31.601231 25083 log.cc:927] Time spent T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:27:31.799780 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:31.587034 24886 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:31.768587 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:31.809051 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:31.784178 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.810863 22216 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:31.590370 25031 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.606017 25030 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:31.840991 20917 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 22044)
W20260709 12:27:31.738266 25089 log.cc:927] Time spent T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 12:27:31.602530 24923 consensus_meta.cc:287] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.000s
W20260709 12:27:31.895401 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.749274 24996 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:31.720708 25017 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.733846 25093 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.636402 24802 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:31.746483 25091 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.596233 24675 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:31.669381 24822 consensus_meta.cc:287] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.121s	user 0.013s	sys 0.001s
I20260709 12:27:31.755414 25042 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:31.899709 25021 consensus_meta.cc:287] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.879s	user 0.013s	sys 0.001s
I20260709 12:27:31.808630 25041 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:32.018262 22215 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:31.805614 25064 consensus_queue.cc:1048] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.206s
I20260709 12:27:32.136086 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:31.905508 25063 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:31.691630 25046 raft_consensus.cc:697] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:31.812095 24886 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.098028 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:32.104020 24802 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:32.134305 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.097985 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 529) took 1991 ms. Trace:
I20260709 12:27:31.905807 24992 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:31.807365 25087 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:31.807307 24929 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:32.137176 22215 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:32.217484 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1994) took 1159 ms. Trace:
I20260709 12:27:32.217993 22220 rpcz_store.cc:276] 0709 12:27:31.058108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.060333 (+  2225us) service_pool.cc:224] Handling call
0709 12:27:31.060693 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.061049 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.061229 (+   180us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:31.062003 (+   774us) log.cc:844] Serialized 26 byte log entry
0709 12:27:31.282892 (+220889us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:31.282934 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.283008 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:32.217230 (+934222us) raft_consensus.cc:1685] finished
0709 12:27:32.217254 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.217416 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1762,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":49,"thread_start_us":220488,"threads_started":1,"wal-append.queue_time_us":362808}
W20260709 12:27:32.220109 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.220413 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:32.212792 22213 rpcz_store.cc:276] 0709 12:27:30.106892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.107072 (+   180us) service_pool.cc:224] Handling call
0709 12:27:30.119210 (+ 12138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.262167 (+142957us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:30.262201 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:30.281615 (+ 19414us) log.cc:844] Serialized 26 byte log entry
0709 12:27:30.514544 (+232929us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b180043af80. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b 00007ff18c2a5d23 00007ff18c2a60d1 00007ff18c6c1a0f
0709 12:27:30.738402 (+223858us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:30.738445 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.097607 (+1359162us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400294d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:32.097666 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:32.097709 (+    43us) raft_consensus.cc:1685] finished
0709 12:27:32.097723 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.097882 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":245,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14127,"spinlock_wait_cycles":300324352,"thread_start_us":223655,"threads_started":1,"wal-append.queue_time_us":562475}
W20260709 12:27:32.179827 25013 consensus_meta.cc:287] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.116s	user 0.011s	sys 0.000s
I20260709 12:27:31.767048 25086 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:32.262393 22810 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:31.916491 25031 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:32.260201 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:32.263657 22809 raft_consensus.cc:2393] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:32.100518 24996 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.215344 24886 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:32.099673 25017 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:32.235177 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 391197us
I20260709 12:27:32.273313 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:32.272804 22808 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:32.272799 22186 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:32.221125 22220 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:27:32.265137 22188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.059s	sys 0.064s
W20260709 12:27:32.278880 22188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.059s	sys 0.065s
I20260709 12:27:32.280174 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:32.135895 25036 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.221315 25063 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.221071 25084 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.297529 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:32.283972 22215 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:31.922180 24923 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:32.171988 25035 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:32.137806 25054 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:32.240912 24767 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:32.216009 25085 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:31.689080 24980 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:32.297199 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1996) took 1231 ms. Trace:
I20260709 12:27:32.298281 22809 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 3.
I20260709 12:27:32.303076 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:32.158108 24675 consensus_queue.cc:1059] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 12:27:32.265199 24785 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:32.106562 25093 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:32.135758 25091 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:32.135052 25021 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:32.242004 24992 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:32.756524 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.909560 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 602) took 1408 ms. Trace:
I20260709 12:27:32.354872 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:32.891158 22188 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.337s (SENT)
I20260709 12:27:32.922534 22220 raft_consensus.cc:2393] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:32.918408 22218 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:32.838042 22038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.000s	sys 0.018s
I20260709 12:27:32.304951 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:32.672078 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:32.273949 25099 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:32.908505 22219 rpcz_store.cc:276] 0709 12:27:31.065533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.234210 (+168677us) service_pool.cc:224] Handling call
0709 12:27:31.250707 (+ 16497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.251118 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.251147 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:31.251647 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:27:31.431962 (+180315us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:31.432004 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.432074 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:32.296919 (+864845us) raft_consensus.cc:1685] finished
0709 12:27:32.296949 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.297125 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23182,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":46059,"thread_start_us":179931,"threads_started":1,"wal-append.queue_time_us":211036}
I20260709 12:27:32.278394 25013 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:32.298215 24997 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.972427 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:32.281875 24996 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:32.938459 22038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.000s	sys 0.020s
W20260709 12:27:32.484534 22141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.001s	sys 0.009s
I20260709 12:27:32.953809 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:32.997488 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:32.907910 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:32.964753 22188 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:32.997377 22141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.311s	user 0.002s	sys 0.020s
W20260709 12:27:32.329845 24753 consensus_meta.cc:287] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.000s
I20260709 12:27:32.304631 25100 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:32.360668 25042 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:32.460736 24912 consensus_meta.cc:287] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.900s	user 0.008s	sys 0.002s
W20260709 12:27:32.709019 24960 consensus_meta.cc:287] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.235s	user 0.008s	sys 0.003s
I20260709 12:27:32.998862 22219 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:32.998533 22220 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:32.894944 25064 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:32.323344 25036 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:32.911506 24861 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.008s	sys 0.012s
I20260709 12:27:32.906037 24802 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:32.355458 25105 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.659s
I20260709 12:27:32.328250 24437 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:33.058586 25122 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:32.906069 25087 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:32.545076 25070 log.cc:927] Time spent T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 1.385s	user 0.004s	sys 0.010s
W20260709 12:27:32.304052 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 388280us
W20260709 12:27:32.671115 22804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.007s	sys 0.009s
I20260709 12:27:33.056985 24878 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:32.908339 22776 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:32.658735 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 375416us
I20260709 12:27:33.029770 24929 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:32.459858 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:33.100293 22217 raft_consensus.cc:2410] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:32.999284 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2399) took 1399 ms. Trace:
I20260709 12:27:32.569717 24680 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.066231 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:32.899606 25033 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:32.355870 24946 consensus_meta.cc:287] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.518s	user 0.009s	sys 0.002s
I20260709 12:27:33.058753 25042 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.071450 25017 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.114246 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:32.930605 25085 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.075299 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:33.115072 22222 raft_consensus.cc:2393] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:33.115258 22214 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:32.299818 25063 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.115528 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2403) took 1515 ms. Trace:
I20260709 12:27:33.115918 22222 rpcz_store.cc:276] 0709 12:27:31.600373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.113952 (+1513579us) service_pool.cc:224] Handling call
0709 12:27:33.115469 (+  1517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:33.117055 25085 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.117362 25063 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:33.118099 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 550) took 1277 ms. Trace:
I20260709 12:27:33.074982 25013 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.118470 22214 rpcz_store.cc:276] 0709 12:27:31.840450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.075043 (+1234593us) service_pool.cc:224] Handling call
0709 12:27:33.118027 (+ 42984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:32.995646 25099 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.118120 25042 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.122120 25099 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.122278 25042 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:32.304593 25084 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.092437 25087 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.123425 25087 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.124555 25084 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:33.125368 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 603) took 1600 ms. Trace:
I20260709 12:27:33.125710 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2405) took 1485 ms. Trace:
I20260709 12:27:32.971935 25020 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:33.091104 22804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.335s	user 0.007s	sys 0.016s
I20260709 12:27:33.077975 22215 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:27:32.327978 25107 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:33.000250 25038 consensus_meta.cc:287] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.611s	user 0.013s	sys 0.001s
I20260709 12:27:32.327829 24874 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.135509 24680 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.173508 24680 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:33.178898 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 341681us
I20260709 12:27:32.935737 24785 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:32.500526 25032 consensus_meta.cc:287] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.720s	user 0.008s	sys 0.008s
I20260709 12:27:33.203881 22219 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:33.000314 24997 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.000510 25086 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.020512 25091 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:33.077033 24861 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.013s	sys 0.012s
W20260709 12:27:33.075423 25059 consensus_meta.cc:287] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.320s	user 0.007s	sys 0.005s
I20260709 12:27:33.025533 25104 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.546370 25056 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:33.100646 22213 rpcz_store.cc:276] 0709 12:27:31.599314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:32.271754 (+672440us) service_pool.cc:224] Handling call
0709 12:27:32.999170 (+727416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:32.544878 24886 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.065287 25021 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:32.758006 25035 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:33.094455 22776 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:33.229030 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 320717us
W20260709 12:27:33.229914 22776 leader_election.cc:336] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:33.231168 22776 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:33.231570 22776 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:33.109640 24990 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:33.072453 25036 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.073611 25093 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.111006 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:33.126060 22217 rpcz_store.cc:276] 0709 12:27:31.640031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:32.305423 (+665392us) service_pool.cc:224] Handling call
0709 12:27:33.125646 (+820223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:33.059083 24960 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.132411 25042 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:33.125975 22145 rpcz_store.cc:276] 0709 12:27:31.524716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.608792 (+ 84076us) service_pool.cc:224] Handling call
0709 12:27:31.764366 (+155574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.920700 (+156334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.920738 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:32.133412 (+212674us) log.cc:844] Serialized 26 byte log entry
0709 12:27:32.327187 (+193775us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:32.327237 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.327324 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:33.125146 (+797822us) raft_consensus.cc:1685] finished
0709 12:27:33.125166 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.125304 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190805,"raft.queue_time_us":254910,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":33728,"thread_start_us":85952,"threads_started":1,"wal-append.queue_time_us":933805}
I20260709 12:27:33.083441 24923 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:32.939158 22142 rpcz_store.cc:276] 0709 12:27:31.500791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.556076 (+ 55285us) service_pool.cc:224] Handling call
0709 12:27:31.556364 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.645722 (+ 89358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.645763 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:31.646386 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 12:27:31.905833 (+259447us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:31.905894 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.906023 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:32.361527 (+455504us) raft_consensus.cc:1685] finished
0709 12:27:32.361554 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.909497 (+547943us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17984,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":188498,"threads_started":2,"wal-append.queue_time_us":670946}
I20260709 12:27:33.147356 25084 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:33.147881 24992 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.058383 25100 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.142237 25063 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:33.076107 25064 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.159683 24996 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.118335 25040 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:33.105170 24878 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.092655 25122 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.163880 25107 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.164897 22808 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:32.359236 25046 consensus_queue.cc:237] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.069831 24753 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.297454 24923 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.315125 24923 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.140673 25020 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.316637 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2404) took 1681 ms. Trace:
I20260709 12:27:33.297701 25063 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.300369 25108 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.317502 25108 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.320022 25108 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.309592 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 772) took 2966 ms. Trace:
I20260709 12:27:33.323021 22802 rpcz_store.cc:276] 0709 12:27:30.333639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.335356 (+  1717us) service_pool.cc:224] Handling call
0709 12:27:30.393140 (+ 57784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:31.080376 (+687236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.279961 (+2199585us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54007652d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:33.300412 (+ 20451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297881856}
I20260709 12:27:33.324278 24753 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:33.326030 25068 log.cc:927] Time spent T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 2.246s	user 0.000s	sys 0.012s
I20260709 12:27:33.292090 25113 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:33.327467 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:33.327383 25113 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.328742 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:33.329253 22144 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:33.329622 25113 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.330124 25113 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.279743 25038 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:33.305264 25117 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.330828 25038 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.330996 25117 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.282270 25084 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.333884 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 547) took 1572 ms. Trace:
I20260709 12:27:33.334280 22215 rpcz_store.cc:276] 0709 12:27:31.761441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:32.298855 (+537414us) service_pool.cc:224] Handling call
0709 12:27:33.333706 (+1034851us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400382cd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:33.333826 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318582656}
I20260709 12:27:33.335575 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.335779 22215 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:27:33.336602 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2412) took 1644 ms. Trace:
I20260709 12:27:33.337142 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:33.338282 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.196794 22186 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:33.092729 24437 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.211099 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2406) took 1521 ms. Trace:
I20260709 12:27:33.347645 25038 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.138835 24946 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.198457 24680 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:33.251142 22220 raft_consensus.cc:2393] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:33.251525 22221 raft_consensus.cc:2368] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8.
I20260709 12:27:33.125342 25033 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.225255 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 783) took 1473 ms. Trace:
I20260709 12:27:33.255405 24592 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.257102 25105 raft_consensus.cc:3055] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:33.263897 24785 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:33.265447 25087 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.266911 22216 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:33.267428 24960 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.207724 25032 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.310310 25107 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:33.272197 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.275017 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.283560 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:33.255296 24997 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:33.280627 22037 connection.cc:256] RPC call timeout handler was delayed by -1.2092010239998672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 12:27:33.291780 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.292357 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:33.291268 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 400129us
I20260709 12:27:33.272022 24802 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:33.222113 25059 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.251631 25056 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:33.303176 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.291544 25022 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:33.306316 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:33.312250 25076 log.cc:927] Time spent T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 2.060s	user 0.010s	sys 0.018s
I20260709 12:27:33.291531 24949 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.313328 25064 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.314357 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 699) took 1070 ms. Trace:
I20260709 12:27:33.296521 25093 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.343314 25100 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.343684 22222 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:33.344610 24886 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:33.345680 25020 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.345925 25063 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:33.252184 24990 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.317032 22214 rpcz_store.cc:276] 0709 12:27:31.635241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.119193 (+1483952us) service_pool.cc:224] Handling call
0709 12:27:33.119501 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:33.131143 (+ 11642us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:33.131175 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:33.131647 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:27:33.250484 (+118837us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:33.250526 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.250594 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:33.316419 (+ 65825us) raft_consensus.cc:1685] finished
0709 12:27:33.316440 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.316581 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11223,"raft.queue_time_us":23239,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":26438,"thread_start_us":118393,"threads_started":1,"wal-append.queue_time_us":172185}
I20260709 12:27:33.349555 25122 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.350260 25117 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.352074 25084 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:33.225644 25104 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.337100 22215 rpcz_store.cc:276] 0709 12:27:31.692001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.335106 (+1643105us) service_pool.cc:224] Handling call
0709 12:27:33.335454 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.336261 (+   807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.336543 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:33.360697 22148 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:33.091398 22218 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:27:33.363510 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 52151.6us
I20260709 12:27:33.366768 22219 rpcz_store.cc:276] 0709 12:27:31.684193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.204756 (+1520563us) service_pool.cc:224] Handling call
0709 12:27:33.205133 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.205322 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:33.205348 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:33.205392 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:33.205424 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.205479 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.205594 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:33.178886 25013 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.235204 25035 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.330518 25113 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.369097 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1784) took 1932 ms. Trace:
I20260709 12:27:33.197705 22775 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:33.346287 24878 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.375972 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2398) took 1777 ms. Trace:
I20260709 12:27:33.383912 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:33.390829 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 87734.7us
I20260709 12:27:33.384521 22145 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:33.385562 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.409737 22803 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:27:33.391860 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.448716 22147 raft_consensus.cc:2410] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:27:33.372860 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 176157us
W20260709 12:27:33.385521 22188 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 2.373s (SENT)
I20260709 12:27:33.456617 22188 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:33.375972 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2410) took 1684 ms. Trace:
I20260709 12:27:33.374822 22804 rpcz_store.cc:276] 0709 12:27:31.751445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.753917 (+  2472us) service_pool.cc:224] Handling call
0709 12:27:31.754309 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.754731 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.754769 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:31.755353 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 12:27:33.198929 (+1443576us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:33.206928 (+  7999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.212223 (+  5295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:33.215099 (+  2876us) raft_consensus.cc:1685] finished
0709 12:27:33.219547 (+  4448us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.223893 (+  4346us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12982,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1725,"thread_start_us":1415059,"threads_started":1,"wal-append.queue_time_us":1318740}
I20260709 12:27:33.457361 22216 rpcz_store.cc:276] 0709 12:27:31.691497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.266097 (+1574600us) service_pool.cc:224] Handling call
0709 12:27:33.266488 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.375712 (+109224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.375904 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:33.458549 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:33.448837 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:33.403332 25107 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.375111 25105 raft_consensus.cc:740] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:33.478364 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 329845us
I20260709 12:27:33.408154 24990 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.478192 22805 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:33.385042 22037 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:33.384251 22142 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
W20260709 12:27:33.478107 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 92616us
I20260709 12:27:33.399626 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:33.480927 22214 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:33.460057 22219 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:27:33.447629 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 249981us
W20260709 12:27:33.433053 22810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 781) took 2506 ms (client timeout 1839 ms). Trace:
I20260709 12:27:33.450065 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:33.387607 25059 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.394256 22806 rpcz_store.cc:276] 0709 12:27:32.244465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:32.246160 (+  1695us) service_pool.cc:224] Handling call
0709 12:27:32.246571 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:32.272286 (+ 25715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:32.272317 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:32.911535 (+639218us) log.cc:844] Serialized 26 byte log entry
0709 12:27:33.232616 (+321081us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:33.232659 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.232737 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:33.314128 (+ 81391us) raft_consensus.cc:1685] finished
0709 12:27:33.314150 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.314293 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17074,"raft.queue_time_us":17357,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":16709,"thread_start_us":232395,"threads_started":1,"wal-append.queue_time_us":310687}
W20260709 12:27:33.467850 22221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2393) took 1878 ms (client timeout 1693 ms). Trace:
I20260709 12:27:33.470003 22144 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:33.475015 25063 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:33.475435 24886 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:33.476362 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2400) took 1876 ms. Trace:
I20260709 12:27:33.443503 24802 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:33.477352 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1990) took 2394 ms. Trace:
I20260709 12:27:33.404220 25129 consensus_queue.cc:1059] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:33.478636 22216 raft_consensus.cc:2410] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:33.476763 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 785) took 1189 ms. Trace:
I20260709 12:27:33.447847 22220 rpcz_store.cc:276] 0709 12:27:31.599050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.110748 (+1511698us) service_pool.cc:224] Handling call
0709 12:27:33.375906 (+265158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:33.483534 22810 rpcz_store.cc:269] 0709 12:27:30.902860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.103195 (+200335us) service_pool.cc:224] Handling call
0709 12:27:33.409199 (+2306004us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b54006b30d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:33.409318 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161910528}
W20260709 12:27:33.485353 22221 rpcz_store.cc:269] 0709 12:27:31.589473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.907982 (+318509us) service_pool.cc:224] Handling call
0709 12:27:33.467664 (+1559682us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003822d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:33.467775 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383920384}
W20260709 12:27:33.487353 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 102412us
W20260709 12:27:33.488782 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:33.491154 22038 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:33.487238 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1772) took 2360 ms. Trace:
I20260709 12:27:33.499186 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:33.453236 22140 rpcz_store.cc:276] 0709 12:27:31.436482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.436719 (+   237us) service_pool.cc:224] Handling call
0709 12:27:31.437084 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:31.443860 (+  6776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.443893 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:32.756449 (+1312556us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b2c00010828. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18afffa11 00007ff18b00f372 00007ff18c741a01 00007ff18c70643a 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2
0709 12:27:32.803638 (+ 47189us) log.cc:844] Serialized 52 byte log entry
0709 12:27:33.063774 (+260136us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:33.356838 (+293064us) log.cc:844] Serialized 14 byte log entry
0709 12:27:33.359063 (+  2225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.359148 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:33.359192 (+    44us) raft_consensus.cc:1685] finished
0709 12:27:33.368835 (+  9643us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.369027 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17811,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":21600,"spinlock_wait_cycles":32595712,"thread_start_us":521944,"threads_started":2,"wal-append.queue_time_us":319230}
I20260709 12:27:33.488397 22036 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:33.382520 25032 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.476603 25035 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.637085 22188 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:33.510783 22222 rpcz_store.cc:276] 0709 12:27:31.599567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.116687 (+1517120us) service_pool.cc:224] Handling call
0709 12:27:33.343342 (+226655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.394865 (+ 51523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.476126 (+ 81261us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400382cd0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:33.476280 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520533760}
I20260709 12:27:33.393906 24437 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.529372 22145 raft_consensus.cc:2410] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:33.511926 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.589854 22214 raft_consensus.cc:2410] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:33.511330 22805 raft_consensus.cc:2410] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:33.643620 22144 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:33.637459 22218 rpcz_store.cc:276] 0709 12:27:31.056884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.058833 (+  1949us) service_pool.cc:224] Handling call
0709 12:27:31.075057 (+ 16224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:32.622495 (+1547438us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400389620. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c67ba1d 00007ff18c6621a4 00007ff18c6e4447 00007ff18c6fcfe7 00007ff18c6fe7de 00007ff18c708b49 00007ff18c709416 00007ff18c705d8f 00007ff18c70583e 00007ff1916ca419
0709 12:27:33.450744 (+828249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.450962 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474727680}
I20260709 12:27:33.374717 24946 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.381670 25033 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.393589 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 776) took 3008 ms. Trace:
I20260709 12:27:33.375559 25087 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:33.475449 24995 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:27:33.375423 24592 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:33.512619 22803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 700) took 1212 ms. Trace:
I20260709 12:27:33.479202 24878 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 12:27:33.647260 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:33.647360 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.517122 22219 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:33.493731 25063 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.507866 25020 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:33.508086 25117 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:33.652134 22144 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:33.649123 25110 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:33.660137 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 406871us
I20260709 12:27:33.662213 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.649133 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:33.666035 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:33.669077 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 180283us
I20260709 12:27:33.654165 22145 raft_consensus.cc:1240] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:33.393859 24949 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.642122 22141 rpcz_store.cc:276] 0709 12:27:31.110419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.110635 (+   216us) service_pool.cc:224] Handling call
0709 12:27:31.152646 (+ 42011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:31.468233 (+315587us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:31.686255 (+218022us) log.cc:844] Serialized 14 byte log entry
0709 12:27:33.012177 (+1325922us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:33.012279 (+   102us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:33.012329 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.470103 (+457774us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540013e054. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:33.470152 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.470299 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99123,"prepare.queue_time_us":336877,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":124,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":725293824,"thread_start_us":1503380,"threads_started":2,"wal-append.queue_time_us":1386730}
W20260709 12:27:33.651214 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 162852us
I20260709 12:27:33.378769 24680 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:33.673781 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 182681us
I20260709 12:27:33.757822 22038 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:33.679600 25108 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:33.479061 24866 consensus_queue.cc:1059] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.170s
I20260709 12:27:33.776377 24866 raft_consensus.cc:3055] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:33.642882 22808 rpcz_store.cc:276] 0709 12:27:32.278119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:32.278273 (+   154us) service_pool.cc:224] Handling call
0709 12:27:33.467180 (+1188907us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400573ad4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:33.467320 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382587648}
I20260709 12:27:33.776814 24866 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:33.777647 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:33.778259 22808 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:33.777788 24866 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.779166 24866 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:33.780915 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.676012 22215 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:33.666849 22773 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:33.783226 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 130973us
I20260709 12:27:33.394505 25093 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.741218 25020 raft_consensus.cc:697] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:33.675120 22803 rpcz_store.cc:276] 0709 12:27:32.299845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:32.300229 (+   384us) service_pool.cc:224] Handling call
0709 12:27:33.409474 (+1109245us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:33.452310 (+ 42836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.503484 (+ 51174us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54006b30d0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:33.512534 (+  9050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2423106816}
I20260709 12:27:33.842483 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:33.843478 22216 raft_consensus.cc:2410] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:33.838152 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:33.494490 25127 consensus_queue.cc:1059] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.174s
W20260709 12:27:33.718065 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.737327 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 701) took 1384 ms. Trace:
I20260709 12:27:33.854786 22809 rpcz_store.cc:276] 0709 12:27:32.352816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:32.999968 (+647152us) service_pool.cc:224] Handling call
0709 12:27:33.060754 (+ 60786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.060964 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:33.302133 (+241169us) log.cc:844] Serialized 14 byte log entry
0709 12:27:33.737001 (+434868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:33.737050 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:33.737102 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.737164 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.737269 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26088,"prepare.queue_time_us":80547,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":97,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9754,"thread_start_us":646805,"threads_started":2}
I20260709 12:27:33.739494 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:33.391108 25022 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:33.752619 22188 leader_election.cc:336] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:33.857439 22188 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:33.753145 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.668557 25087 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:33.716610 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 69314us
I20260709 12:27:33.759011 22038 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:33.858726 22114 leader_election.cc:336] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:33.859009 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 100066us
I20260709 12:27:33.670548 25119 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.675784 24928 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:33.731982 25063 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:33.770325 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:33.772425 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:33.679394 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:33.716164 22218 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:33.790800 25113 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:33.786716 24923 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.805303 25104 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.806113 22215 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:33.768733 24761 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:27:33.812023 22808 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
W20260709 12:27:33.813529 25040 consensus_meta.cc:287] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.512s	user 0.004s	sys 0.004s
I20260709 12:27:33.816759 24680 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.761477 25036 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.824226 25042 raft_consensus.cc:3055] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:33.826664 25031 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.832048 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2413) took 2139 ms. Trace:
I20260709 12:27:33.835005 21967 catalog_manager.cc:5697] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:33.759671 25100 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.766376 24946 raft_consensus.cc:3060] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:33.537298 25013 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:33.859472 22114 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:34.036042 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:34.036185 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 283587us
W20260709 12:27:34.046466 22188 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.045439 25087 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:33.996058 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:33.847507 24876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.041s	sys 0.038s
W20260709 12:27:34.048156 24876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.041s	sys 0.055s
I20260709 12:27:33.862942 25107 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:33.937186 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.887337 22220 raft_consensus.cc:1275] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:33.788378 25108 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.863406 25032 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:34.050758 25108 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:33.886502 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.051704 22806 raft_consensus.cc:2468] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:34.052587 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:34.053632 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:34.047606 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.050025 22139 raft_consensus.cc:2410] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:34.047389 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:33.889358 22773 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:34.055495 22808 raft_consensus.cc:2410] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:34.056394 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.056540 25138 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:33.862644 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.057001 25138 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.057430 25138 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:34.058796 22146 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:34.059454 25108 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.060585 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 548) took 2298 ms. Trace:
I20260709 12:27:33.857178 22216 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:34.056962 22808 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:34.054201 22806 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:34.054981 22188 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:33.862532 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:34.063712 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 174466us
I20260709 12:27:34.070245 22220 rpcz_store.cc:276] 0709 12:27:31.762080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.886723 (+2124643us) service_pool.cc:224] Handling call
0709 12:27:33.887010 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.060318 (+173308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.060526 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.065872 25138 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.071163 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:33.947723 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:33.887295 22805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 707) took 1532 ms (client timeout 1642 ms). Trace:
W20260709 12:27:33.918612 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 779) took 3193 ms (client timeout 1967 ms). Trace:
I20260709 12:27:34.068585 25100 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:33.951820 24928 raft_consensus.cc:697] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:34.047305 22222 rpcz_store.cc:276] 0709 12:27:31.692254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.831120 (+2138866us) service_pool.cc:224] Handling call
0709 12:27:33.831453 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.831702 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:33.831729 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:33.831768 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:33.831808 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.831861 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.831984 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.060680 21967 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 6 to 7, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:34.107530 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2409) took 2416 ms. Trace:
I20260709 12:27:34.072664 22143 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:34.109304 21967 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:34.108896 22217 rpcz_store.cc:276] 0709 12:27:31.691232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.235716 (+1544484us) service_pool.cc:224] Handling call
0709 12:27:33.277928 (+ 42212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:33.278322 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:33.278349 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:33.278841 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:27:33.639429 (+360588us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:34.037953 (+398524us) log.cc:844] Serialized 14 byte log entry
0709 12:27:34.107168 (+ 69215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.107249 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:34.107289 (+    40us) raft_consensus.cc:1685] finished
0709 12:27:34.107300 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.107457 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68848,"raft.queue_time_us":95,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":15005,"thread_start_us":680103,"threads_started":2,"wal-append.queue_time_us":464220}
W20260709 12:27:34.107810 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 249110us
I20260709 12:27:34.045221 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:34.073164 22806 raft_consensus.cc:2468] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:34.071928 22773 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:34.047317 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:34.071950 22805 rpcz_store.cc:269] 0709 12:27:32.354522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:32.671684 (+317162us) service_pool.cc:224] Handling call
0709 12:27:33.887108 (+1215424us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540076af54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:33.887233 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143401344}
I20260709 12:27:34.112032 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.112514 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.086439 22220 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:34.099893 22218 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:34.069442 25036 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.112675 22806 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:34.113540 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2001) took 1286 ms. Trace:
I20260709 12:27:34.089552 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 545) took 2339 ms. Trace:
I20260709 12:27:33.893136 25119 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.113924 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:34.072170 22807 rpcz_store.cc:269] 0709 12:27:30.725171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.725298 (+   127us) service_pool.cc:224] Handling call
0709 12:27:33.885898 (+3160600us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b54008a2fd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:33.918486 (+ 32588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6293777280}
I20260709 12:27:34.115727 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:34.118427 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.123034 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.847793 25059 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:34.111248 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.137300 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.144173 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:33.956604 25117 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.147521 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.085139 25057 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.050194 25042 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:34.156140 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:34.225754 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 178149us
I20260709 12:27:34.230237 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.268209 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.116914 24946 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:34.271117 22775 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:34.126417 25040 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:34.233646 22214 raft_consensus.cc:1240] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:34.235603 22146 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:34.266922 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:34.290396 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.291153 22146 raft_consensus.cc:2393] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:34.126664 25031 consensus_queue.cc:1059] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:27:34.134049 21967 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 4 to 5, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 5 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:34.292713 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.292249 21967 catalog_manager.cc:5697] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.292155 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.293098 24866 consensus_queue.cc:1059] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:34.294166 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:34.294462 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.295526 22146 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:34.294508 21967 catalog_manager.cc:5697] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 3, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 3 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:34.296527 21967 catalog_manager.cc:5697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 6 to 7, term changed from 4 to 7, VOTER 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) evicted. New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:34.297642 25093 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:34.266472 25084 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.298300 21967 catalog_manager.cc:5697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 4, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:34.299985 25117 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:34.301038 25036 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:34.291014 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.143036 25113 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:34.293390 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2408) took 2602 ms. Trace:
I20260709 12:27:34.298987 25084 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:34.302122 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 190909us
I20260709 12:27:34.300258 21967 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 5 to 6, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 6 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:34.302636 22805 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:34.310284 22146 raft_consensus.cc:2468] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
W20260709 12:27:34.310204 22114 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.303534 22142 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
W20260709 12:27:34.231166 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 73433.5us
I20260709 12:27:34.287379 22808 raft_consensus.cc:2393] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:34.288457 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.305225 22807 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
W20260709 12:27:34.305893 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.312619 25064 consensus_queue.cc:1048] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:34.313071 25021 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:34.314203 22188 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.314688 22188 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:33.652809 22801 rpcz_store.cc:276] 0709 12:27:30.385733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.385931 (+   198us) service_pool.cc:224] Handling call
0709 12:27:30.792136 (+406205us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b5800194a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:30.792341 (+   205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.792713 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.792752 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:30.793221 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:27:31.005735 (+212514us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:31.030681 (+ 24946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.038220 (+  7539us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:33.300044 (+2261824us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:33.393362 (+ 93318us) raft_consensus.cc:1685] finished
0709 12:27:33.393383 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.393512 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3201,"raft.queue_time_us":6722,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":19886,"spinlock_wait_cycles":19357824,"thread_start_us":168363,"threads_started":1,"wal-append.queue_time_us":458072}
I20260709 12:27:34.316464 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:34.316962 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.317092 22801 raft_consensus.cc:2376] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5. Re-sending same reply.
I20260709 12:27:34.317567 22807 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:34.318439 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.319597 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.092986 25127 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:34.288199 22809 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:34.275698 25140 log.cc:927] Time spent T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:27:34.323297 25033 raft_consensus.cc:3055] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:34.323717 25033 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:34.324565 25033 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.326399 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.327416 22802 raft_consensus.cc:2410] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:34.327886 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 549) took 2518 ms. Trace:
I20260709 12:27:34.328389 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.328204 25105 consensus_queue.cc:260] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.328775 22773 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:34.329852 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 173777us
I20260709 12:27:34.328284 22221 rpcz_store.cc:276] 0709 12:27:31.809759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.039111 (+2229352us) service_pool.cc:224] Handling call
0709 12:27:34.114913 (+ 75802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.327079 (+212166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.327111 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:34.327150 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:34.327177 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.327669 (+   492us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400029c54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:34.327711 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.327829 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487421312}
I20260709 12:27:34.332094 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.327526 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 1999) took 1501 ms. Trace:
I20260709 12:27:34.332710 22214 rpcz_store.cc:276] 0709 12:27:32.826356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.039346 (+1212990us) service_pool.cc:224] Handling call
0709 12:27:34.233457 (+194111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.289770 (+ 56313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.327314 (+ 37544us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54001f5750. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:34.327450 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445401984}
I20260709 12:27:34.333329 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.333803 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.334035 22805 raft_consensus.cc:2410] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:34.308599 22213 rpcz_store.cc:276] 0709 12:27:31.690944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.223811 (+1532867us) service_pool.cc:224] Handling call
0709 12:27:33.224222 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:33.229187 (+  4965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:33.229222 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:33.234160 (+  4938us) log.cc:844] Serialized 26 byte log entry
0709 12:27:33.515715 (+281555us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:33.515765 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.515840 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:34.293180 (+777340us) raft_consensus.cc:1685] finished
0709 12:27:34.293201 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.293328 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4711,"raft.queue_time_us":8320,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":19168,"thread_start_us":211925,"threads_started":1,"wal-append.queue_time_us":867223}
W20260709 12:27:34.320662 22188 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.334906 22188 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:34.335580 21967 catalog_manager.cc:5697] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.320567 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.336763 22807 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:34.336151 22809 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:34.231557 24675 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:34.340715 22776 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:34.279352 25143 log.cc:927] Time spent T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:27:34.299486 25059 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:34.342808 22776 leader_election.cc:336] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.236315 22220 rpcz_store.cc:276] 0709 12:27:32.826893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.072019 (+1245126us) service_pool.cc:224] Handling call
0709 12:27:34.072313 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.113306 (+ 40993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.113480 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.343873 22216 rpcz_store.cc:276] 0709 12:27:31.750459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.856359 (+2105900us) service_pool.cc:224] Handling call
0709 12:27:33.856916 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.089249 (+232333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.089491 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.318222 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.339728 25036 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:34.316884 25022 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:34.187409 24761 consensus_queue.cc:1059] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
I20260709 12:27:34.274610 25138 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:34.271605 25108 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:34.272908 25100 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:34.336968 21967 catalog_manager.cc:5697] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 2, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 2 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.038144 25020 consensus_queue.cc:237] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:34.321269 24866 raft_consensus.cc:3055] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:34.330236 25087 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.329581 25105 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:34.346299 22214 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:34.230324 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.387781 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2417) took 1047 ms. Trace:
I20260709 12:27:34.388149 22214 rpcz_store.cc:276] 0709 12:27:33.340785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.345579 (+1004794us) service_pool.cc:224] Handling call
0709 12:27:34.345929 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.387522 (+ 41593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.387725 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.388909 22222 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:34.355064 22139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51452 (request call id 1777) took 3215 ms (client timeout 3217 ms). Trace:
W20260709 12:27:34.391304 22139 rpcz_store.cc:269] 0709 12:27:31.139831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.139990 (+   159us) service_pool.cc:224] Handling call
0709 12:27:34.354849 (+3214859us) spinlock_profiling.cc:243] Waited 2.89 s on lock 0x7b540013e554. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:34.355001 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6647176960}
I20260709 12:27:34.361388 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.393268 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 793) took 1176 ms. Trace:
I20260709 12:27:34.393613 22806 rpcz_store.cc:276] 0709 12:27:33.217052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.361126 (+1144074us) service_pool.cc:224] Handling call
0709 12:27:34.393209 (+ 32083us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:34.347832 22776 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:34.361851 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.394984 22776 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:34.395825 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 48033.6us
W20260709 12:27:34.396461 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:34.367004 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 50655.6us
I20260709 12:27:34.368507 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:34.398020 22216 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:34.398089 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.398653 22188 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:34.369905 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.370149 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.400853 22809 raft_consensus.cc:2410] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:27:34.372926 21967 catalog_manager.cc:5697] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:34.375829 24866 raft_consensus.cc:740] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:34.404937 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.381377 22221 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:27:34.408452 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2415) took 1068 ms. Trace:
I20260709 12:27:34.368221 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.411954 22806 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:34.396970 22776 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.412676 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 704) took 2059 ms. Trace:
I20260709 12:27:34.412904 22776 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:34.413511 22806 rpcz_store.cc:276] 0709 12:27:32.353713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.394282 (+2040569us) service_pool.cc:224] Handling call
0709 12:27:34.394630 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.412450 (+ 17820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.412628 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:34.413977 22776 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.414419 22776 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:34.369318 22114 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.408993 22221 rpcz_store.cc:276] 0709 12:27:33.340271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.350994 (+1010723us) service_pool.cc:224] Handling call
0709 12:27:34.381121 (+ 30127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:34.408159 (+ 27038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.408379 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:34.416599 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.416774 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.407258 21967 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 4 to 6, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 6 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.423485 21967 catalog_manager.cc:5697] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 3, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 3 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:34.415078 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45804.2us
I20260709 12:27:34.355546 25042 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.357264 22147 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:34.358916 22145 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:34.428181 25022 consensus_queue.cc:1059] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:34.363445 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2414) took 1023 ms. Trace:
I20260709 12:27:34.310405 25113 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:34.365935 25033 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:34.353519 22218 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:34.367729 24802 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:34.367554 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:34.386031 22775 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:34.418290 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2368) took 1133 ms. Trace:
I20260709 12:27:34.431519 22220 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:34.429270 22037 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:34.432536 22188 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.469931 22188 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:34.469302 22144 rpcz_store.cc:276] 0709 12:27:33.284841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.738932 (+454091us) service_pool.cc:224] Handling call
0709 12:27:33.739183 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.739368 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:34.046892 (+307524us) log.cc:844] Serialized 14 byte log entry
0709 12:27:34.417658 (+370766us) log.cc:844] Serialized 14 byte log entry
0709 12:27:34.417832 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:34.417884 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:34.418036 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.418108 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.418225 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48113,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":165,"raft.run_wall_time_us":12916,"spinlock_wait_cycles":31502848,"thread_start_us":649244,"threads_started":2}
I20260709 12:27:34.330863 25057 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:34.426751 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2420) took 1085 ms. Trace:
I20260709 12:27:34.441996 22216 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
W20260709 12:27:34.433429 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 45659us
I20260709 12:27:34.476593 22186 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:34.371290 25110 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.478327 25110 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.481072 25031 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:34.360664 24437 raft_consensus.cc:3055] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:34.444597 22215 rpcz_store.cc:276] 0709 12:27:33.339977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.447979 (+108002us) service_pool.cc:224] Handling call
0709 12:27:34.363244 (+915265us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b5400028d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:34.363365 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79192960}
W20260709 12:27:34.357668 24592 consensus_meta.cc:287] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.000s
I20260709 12:27:34.359210 25040 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.383546 25138 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.345057 25035 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:34.500309 25035 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.500833 25035 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:34.507344 22140 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:34.434305 21967 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 3 to 4, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 4 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.447018 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 706) took 2092 ms. Trace:
I20260709 12:27:34.509294 22806 rpcz_store.cc:276] 0709 12:27:32.354209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.414612 (+2060403us) service_pool.cc:224] Handling call
0709 12:27:34.446466 (+ 31854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.446676 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.446701 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:34.446759 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:34.446787 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.446837 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.446953 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.364689 25059 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:34.369962 24675 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:34.357550 24949 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:34.345193 25046 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:34.450750 25022 consensus_queue.cc:1243] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer 7ff8d9fd78c1454cacc77bbc1bfb992e log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:27:34.443812 25036 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:34.452095 25021 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:34.454955 25042 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:34.284191 24928 consensus_queue.cc:237] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:34.389518 25108 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:34.459278 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2002) took 1632 ms. Trace:
I20260709 12:27:34.537928 22218 rpcz_store.cc:276] 0709 12:27:32.827130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.302116 (+1474986us) service_pool.cc:224] Handling call
0709 12:27:34.353138 (+ 51022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.458929 (+105791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.459200 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.470456 22037 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:34.539354 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 68998.9us
I20260709 12:27:34.540199 22037 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:34.541388 22037 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:34.471482 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2418) took 1130 ms. Trace:
I20260709 12:27:34.542146 22220 rpcz_store.cc:276] 0709 12:27:33.341036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.430857 (+1089821us) service_pool.cc:224] Handling call
0709 12:27:34.431195 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.471159 (+ 39964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.471409 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.543613 22220 raft_consensus.cc:1240] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:34.544266 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2425) took 1054 ms. Trace:
I20260709 12:27:34.544587 22220 rpcz_store.cc:276] 0709 12:27:33.490306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.543027 (+1052721us) service_pool.cc:224] Handling call
0709 12:27:34.543397 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.544003 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.544208 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.546221 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 555) took 1053 ms. Trace:
W20260709 12:27:34.472834 22188 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.546844 22188 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:34.437409 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:34.547703 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 110338us
W20260709 12:27:34.548354 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:34.549256 22114 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.469596 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:34.433389 25117 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:34.483525 22186 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:34.477466 22221 rpcz_store.cc:276] 0709 12:27:33.341548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.425895 (+1084347us) service_pool.cc:224] Handling call
0709 12:27:34.426218 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.426418 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.426443 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:34.426482 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:34.426516 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.426569 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.426688 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.481704 25031 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:34.449373 25084 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:34.359632 25063 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:34.471284 24886 consensus_queue.cc:1175] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "67742f291ab04f8b8335d3919cf2d1f7" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:34.456223 25113 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:34.403581 24866 consensus_queue.cc:260] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:34.474468 25122 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:34.491727 25129 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:34.561106 25084 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:34.494699 22802 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:34.508740 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.511785 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 708) took 2156 ms. Trace:
I20260709 12:27:34.579954 22808 rpcz_store.cc:276] 0709 12:27:32.354881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.489970 (+2135089us) service_pool.cc:224] Handling call
0709 12:27:34.511182 (+ 21212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.511404 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.511448 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:34.511494 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:34.511533 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.511584 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.511711 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.557528 24874 raft_consensus.cc:2804] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:34.486568 24437 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:34.504926 24592 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:34.526872 21967 catalog_manager.cc:5697] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 3, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:27:34.588513 22774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.576776 25129 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.574802 24675 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:34.556173 22806 raft_consensus.cc:1240] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: []
W20260709 12:27:34.556756 22114 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.524510 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:34.599181 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 785) took 1419 ms. Trace:
I20260709 12:27:34.599601 22806 rpcz_store.cc:276] 0709 12:27:33.179709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.522484 (+1342775us) service_pool.cc:224] Handling call
0709 12:27:34.538244 (+ 15760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.598868 (+ 60624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.599111 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.557739 25108 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:34.560215 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 76811.8us
I20260709 12:27:34.605074 22186 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:34.505316 25040 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:34.527791 25046 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:34.609001 25046 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:34.609782 25063 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:34.507130 25138 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.610491 25063 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:34.588536 24866 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:34.611289 22807 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:34.612150 25138 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:34.616212 24876 raft_consensus.cc:3055] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:34.616761 24876 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:34.618693 25122 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:34.619290 25122 raft_consensus.cc:697] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:34.620131 25122 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.575490 22221 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:34.577641 22810 raft_consensus.cc:2393] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:34.480978 25110 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:34.558220 24949 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:34.594111 25129 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:34.586695 22809 raft_consensus.cc:1240] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:34.630774 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 786) took 1450 ms. Trace:
I20260709 12:27:34.631142 22809 rpcz_store.cc:276] 0709 12:27:33.179989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.569100 (+1389111us) service_pool.cc:224] Handling call
0709 12:27:34.582549 (+ 13449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.630430 (+ 47881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.630703 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.552215 22037 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:34.587227 25084 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:34.591044 25147 log.cc:927] Time spent T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:27:34.591177 24437 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.627240 24949 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:34.591706 25149 log.cc:927] Time spent T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:27:34.546566 22220 rpcz_store.cc:276] 0709 12:27:33.497634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.545355 (+1047721us) service_pool.cc:224] Handling call
0709 12:27:34.545704 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.545898 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.545923 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:34.545967 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:34.546005 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.546056 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.546161 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:34.559203 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 86410.4us
W20260709 12:27:34.601647 22114 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:34.693579 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 91963.1us
W20260709 12:27:34.694152 22114 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:34.694746 22114 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:34.584656 24874 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.606392 22186 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:34.577430 25119 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:34.567203 25022 raft_consensus.cc:2804] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:34.632187 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 80068us
W20260709 12:27:34.699317 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 93028.5us
I20260709 12:27:34.617664 24876 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:34.610697 25040 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:34.638757 22187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.016s
W20260709 12:27:34.718175 22187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.016s
W20260709 12:27:34.639453 22036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.001s	sys 0.015s
W20260709 12:27:34.718957 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 606013us
W20260709 12:27:34.638514 22038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.016s
W20260709 12:27:34.658553 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 337682us
W20260709 12:27:34.757899 22038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.000s	sys 0.016s
W20260709 12:27:34.758764 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 713631us
I20260709 12:27:34.714541 22220 raft_consensus.cc:1275] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:34.699972 22037 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:34.647482 24949 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:34.760614 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:34.762148 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 62255.3us
I20260709 12:27:34.768124 22037 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:34.767283 22220 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:34.771849 22038 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:34.638072 25150 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:34.707541 24874 raft_consensus.cc:3060] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:34.772357 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:34.702008 24437 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:34.782279 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 368306us
I20260709 12:27:34.717295 25022 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.780417 22220 raft_consensus.cc:2376] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5. Re-sending same reply.
W20260709 12:27:34.783351 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.785086 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:34.786944 20917 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:34.623227 25031 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.775692 24876 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:34.778749 25150 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.787642 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:34.788360 22801 raft_consensus.cc:2410] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:34.774212 25021 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:34.777065 25084 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:34.808398 25032 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:34.814109 25110 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:34.816799 22810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 788) took 1620 ms (client timeout 2002 ms). Trace:
W20260709 12:27:34.817287 22810 rpcz_store.cc:269] 0709 12:27:33.197037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.648842 (+451805us) service_pool.cc:224] Handling call
0709 12:27:34.816566 (+1167724us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400747cd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:34.816730 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898490112}
I20260709 12:27:34.786042 25022 raft_consensus.cc:3060] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:34.814406 25021 raft_consensus.cc:697] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:34.776813 25117 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:27:34.832424 25013 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:34.831907 25021 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.838395 24680 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:34.840458 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.842268 24878 raft_consensus.cc:3060] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:34.843936 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2003) took 2016 ms. Trace:
I20260709 12:27:34.844427 22222 rpcz_store.cc:276] 0709 12:27:32.827378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.319228 (+1491850us) service_pool.cc:224] Handling call
0709 12:27:34.319557 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.390498 (+ 70941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.843623 (+453125us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b54003a84d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:34.843858 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159027584}
I20260709 12:27:34.845778 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:34.845963 25108 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:34.826196 25153 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:27:34.867609 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:34.822539 25084 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.867498 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 546) took 3106 ms. Trace:
I20260709 12:27:34.870677 25084 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:34.835455 25151 log.cc:927] Time spent T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:27:34.872058 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2416) took 1531 ms. Trace:
I20260709 12:27:34.853183 24946 raft_consensus.cc:3055] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:34.872834 24946 raft_consensus.cc:740] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:34.873737 24946 consensus_queue.cc:260] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.855660 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 705) took 2501 ms. Trace:
I20260709 12:27:34.874861 22807 rpcz_store.cc:276] 0709 12:27:32.353973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.411377 (+2057404us) service_pool.cc:224] Handling call
0709 12:27:34.447754 (+ 36377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.611652 (+163898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.855397 (+243745us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54008471d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:34.855592 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375313792}
I20260709 12:27:34.877019 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 795) took 1659 ms. Trace:
I20260709 12:27:34.877349 22807 rpcz_store.cc:276] 0709 12:27:33.217648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.875935 (+1658287us) service_pool.cc:224] Handling call
0709 12:27:34.876318 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.876524 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.876671 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:34.876720 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:34.876763 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.876823 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.876953 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.877880 22222 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:34.870126 22219 rpcz_store.cc:276] 0709 12:27:31.761117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.890335 (+2129218us) service_pool.cc:224] Handling call
0709 12:27:33.890751 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:34.038463 (+147712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.038498 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:34.092535 (+ 54037us) log.cc:844] Serialized 26 byte log entry
0709 12:27:34.570079 (+477544us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:34.570140 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.570335 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:34.867218 (+296883us) raft_consensus.cc:1685] finished
0709 12:27:34.867244 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.867422 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61284,"raft.queue_time_us":197388,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":50578,"thread_start_us":333277,"threads_started":1,"wal-append.queue_time_us":633522}
I20260709 12:27:34.879765 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.843552 25113 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.872428 22213 rpcz_store.cc:276] 0709 12:27:33.340544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.350205 (+1009661us) service_pool.cc:224] Handling call
0709 12:27:34.350660 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:34.366831 (+ 16171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.366864 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:34.367497 (+   633us) log.cc:844] Serialized 52 byte log entry
0709 12:27:34.779890 (+412393us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:34.794931 (+ 15041us) log.cc:844] Serialized 14 byte log entry
0709 12:27:34.835642 (+ 40711us) log.cc:844] Serialized 14 byte log entry
0709 12:27:34.836458 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.837020 (+   562us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:34.871817 (+ 34797us) raft_consensus.cc:1685] finished
0709 12:27:34.871838 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.871996 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65662,"prepare.queue_time_us":55664,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":16838,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":6620,"thread_start_us":400804,"threads_started":1,"wal-append.queue_time_us":461317}
I20260709 12:27:34.924969 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.926206 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:34.857697 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2361) took 1574 ms. Trace:
I20260709 12:27:34.927695 22140 rpcz_store.cc:276] 0709 12:27:33.283184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.651081 (+367897us) service_pool.cc:224] Handling call
0709 12:27:34.356584 (+705503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.507852 (+151268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.856256 (+348404us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540013e554. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:34.857475 (+  1219us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540013e550. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:34.857626 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967521408}
I20260709 12:27:34.858733 22214 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:34.861555 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.929863 22215 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:34.930552 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.930943 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.932288 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.861898 25022 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.863830 25057 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:34.864938 25035 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:34.798568 25150 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:34.804201 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:34.940421 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:34.918805 22776 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:34.943177 22776 leader_election.cc:336] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:34.920497 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 534550us
I20260709 12:27:34.948875 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.950234 22186 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:34.950469 22213 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:34.951929 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.952559 22213 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
W20260709 12:27:34.950690 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 192148us
W20260709 12:27:34.931058 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.958679 22146 raft_consensus.cc:1240] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:27:34.959602 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.959784 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.960609 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.953676 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:34.963260 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.963749 22213 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:34.964231 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:34.965071 22146 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:34.980198 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:34.982518 22144 raft_consensus.cc:2393] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:34.983666 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 288400us
W20260709 12:27:34.985457 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 202344us
I20260709 12:27:34.993104 22809 raft_consensus.cc:1240] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:34.994938 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 223170us
I20260709 12:27:34.996927 22038 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:34.923414 24592 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:35.007587 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:35.026625 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:35.027356 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.011512 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:35.029060 22038 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:35.031283 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:35.040141 22807 raft_consensus.cc:2393] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:35.040238 22775 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:34.870724 25032 consensus_queue.cc:1059] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 12:27:34.985968 24946 raft_consensus.cc:3060] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:34.985416 24675 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:34.878539 24949 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.058768 22775 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:34.940475 25059 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.041576 25064 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:34.992714 25108 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:27:35.060985 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:35.006016 25117 consensus_queue.cc:1059] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:27:35.022781 22213 raft_consensus.cc:2468] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:35.056653 22804 raft_consensus.cc:2393] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:35.074255 22806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 787) took 1893 ms. Trace:
W20260709 12:27:35.060588 24802 consensus_meta.cc:287] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.001s
I20260709 12:27:35.074988 22775 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:35.053643 25163 raft_consensus.cc:2804] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:35.082746 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:35.076928 22220 raft_consensus.cc:2393] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 7: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:35.039695 25129 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.044934 24874 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.085916 22803 raft_consensus.cc:2393] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:35.091435 24874 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:35.091205 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 62209.2us
I20260709 12:27:35.092623 24874 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:35.093145 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:35.094192 22222 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:27:35.094900 24874 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:35.095583 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 151284us
I20260709 12:27:35.096709 22213 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:35.097571 22112 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:35.098477 25100 raft_consensus.cc:2764] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:35.100695 22112 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:35.102007 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.103094 22112 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:35.105803 22213 raft_consensus.cc:1240] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:35.105327 25163 raft_consensus.cc:697] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:35.078858 25046 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.109692 24949 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:35.057411 25164 consensus_queue.cc:1059] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:27:35.112365 25162 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:35.067435 25160 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:35.114929 25160 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.073061 25175 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:35.108357 22112 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.123214 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:35.123766 22038 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:35.123431 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.124660 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:35.124464 22776 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:35.104728 25020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.012s	sys 0.052s
I20260709 12:27:35.086723 25138 raft_consensus.cc:2804] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:35.085511 24802 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:35.146566 25093 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:35.115707 24437 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:35.151921 24437 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:35.152344 24437 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:35.115264 25042 consensus_meta.cc:287] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.002s
I20260709 12:27:35.107448 25064 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.104323 25174 raft_consensus.cc:3055] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:35.171835 22114 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.116971 25057 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:35.127827 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:35.155488 25046 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:35.145172 25020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.013s	sys 0.052s
W20260709 12:27:35.162608 25148 log.cc:927] Time spent T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.714s	user 0.001s	sys 0.003s
I20260709 12:27:35.145849 24923 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.163249 25129 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:35.163357 24592 raft_consensus.cc:3055] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:35.128301 22112 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:35.173482 22217 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
W20260709 12:27:35.172641 22114 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.119056 25022 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:35.109735 25163 consensus_queue.cc:237] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.220434 24923 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:35.220902 24923 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:35.221108 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:35.221315 24923 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:35.173785 24928 consensus_queue.cc:1059] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:27:35.223964 22222 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:35.079511 22806 rpcz_store.cc:276] 0709 12:27:33.180559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.637010 (+1456451us) service_pool.cc:224] Handling call
0709 12:27:34.708423 (+ 71413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.708659 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:34.880864 (+172205us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.073935 (+193071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:35.073986 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:35.074032 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.074098 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.074201 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3764,"thread_start_us":302549,"threads_started":2}
I20260709 12:27:35.215721 24592 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:35.226886 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 553) took 1770 ms. Trace:
I20260709 12:27:35.227577 24592 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.228718 24592 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.230322 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 789) took 2029 ms. Trace:
I20260709 12:27:35.230782 22809 rpcz_store.cc:276] 0709 12:27:33.200801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.692629 (+1491828us) service_pool.cc:224] Handling call
0709 12:27:34.759334 (+ 66705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.993545 (+234211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.230031 (+236486us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400764654. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:35.230250 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537111296}
W20260709 12:27:35.180086 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 52361.4us
I20260709 12:27:35.183527 25113 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:35.184098 25177 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:35.235266 25013 consensus_queue.cc:1059] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:35.236346 25022 raft_consensus.cc:3055] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:35.236739 25022 raft_consensus.cc:740] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:35.177623 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 54217.7us
I20260709 12:27:35.185997 25150 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.194416 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 702) took 2841 ms. Trace:
I20260709 12:27:35.169370 25174 raft_consensus.cc:740] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:35.177788 25057 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:35.196353 25059 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:35.174227 25161 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:35.208758 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 557) took 1484 ms. Trace:
I20260709 12:27:35.209203 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 554) took 1752 ms. Trace:
I20260709 12:27:35.201853 24878 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:35.209550 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 131179us
I20260709 12:27:35.212587 24675 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:27:35.198295 22803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 786) took 2062 ms (client timeout 2158 ms). Trace:
I20260709 12:27:35.214066 25033 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.175884 25064 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:35.216365 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43759.7us
W20260709 12:27:35.287829 22114 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:35.289420 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.241876 25087 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:35.290089 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.216743 22775 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:35.255591 25138 raft_consensus.cc:697] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:35.115301 25160 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:35.291325 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 74635us
I20260709 12:27:35.255645 25057 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.293303 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:35.293993 22217 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:35.116259 25035 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:35.232053 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.294915 25185 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:35.295374 25185 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.295709 25185 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:35.295791 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.296962 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.241087 25162 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:35.298631 22775 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:35.217267 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 89054us
I20260709 12:27:35.233507 22038 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
W20260709 12:27:35.232299 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.238705 25022 consensus_queue.cc:260] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.240236 22808 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:35.227329 22216 rpcz_store.cc:276] 0709 12:27:33.456824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.475329 (+1018505us) service_pool.cc:224] Handling call
0709 12:27:34.475728 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:34.489972 (+ 14244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.490012 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:34.494242 (+  4230us) log.cc:844] Serialized 26 byte log entry
0709 12:27:35.031063 (+536821us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:35.031111 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.031186 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:35.226660 (+195474us) raft_consensus.cc:1685] finished
0709 12:27:35.226680 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.226826 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6587,"raft.queue_time_us":6965,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4404,"thread_start_us":492354,"threads_started":1,"wal-append.queue_time_us":697186}
I20260709 12:27:35.239750 22222 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:35.253530 22805 rpcz_store.cc:276] 0709 12:27:32.353184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.357329 (+2004145us) service_pool.cc:224] Handling call
0709 12:27:34.357674 (+   345us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:34.696521 (+338847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.696554 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:27:34.741729 (+ 45175us) log.cc:844] Serialized 78 byte log entry
0709 12:27:35.086348 (+344619us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:35.086398 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.086473 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:35.194177 (+107704us) raft_consensus.cc:1685] finished
0709 12:27:35.194199 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.194358 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18258,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"thread_start_us":618039,"threads_started":2,"wal-append.queue_time_us":397813}
I20260709 12:27:35.297474 22809 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.304433 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:35.259881 22219 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:35.257864 22220 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:27:35.238332 22776 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.277244 22221 rpcz_store.cc:276] 0709 12:27:33.724780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.623950 (+899170us) service_pool.cc:224] Handling call
0709 12:27:34.636582 (+ 12632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.636808 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:34.719955 (+ 83147us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.026892 (+306937us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.208230 (+181338us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b180043ae00. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff189593c0a 00007ff192cd3219 00007ff18961ba40 00007ff1896164e4 00007ff189616455 00007ff18c6fe060 00007ff18c710716 00007ff18c721287 00007ff18c721208
0709 12:27:35.208411 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:35.208459 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:35.208512 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.208580 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.208694 (+   114us) inbound_call.cc:177] Queueing success response
0709 12:27:35.229277 (+ 20583us) spinlock_profiling.cc:243] Waited 8.79 ms on lock 0x7b180043ae00. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
Metrics: {"mutex_wait_us":168493,"prepare.queue_time_us":87420,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":2788,"raft.queue_time_us":185866,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":7471,"spinlock_wait_cycles":41451648,"thread_start_us":264728,"threads_started":1,"wal-append.queue_time_us":364571}
I20260709 12:27:35.276842 22215 raft_consensus.cc:1275] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:35.279909 22773 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:35.280895 22803 rpcz_store.cc:269] 0709 12:27:33.136194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.842407 (+706213us) service_pool.cc:224] Handling call
0709 12:27:35.198098 (+1355691us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400808254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:35.198233 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2333838208}
I20260709 12:27:35.214747 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:35.305531 22037 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:35.306238 22214 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.287495 25174 consensus_queue.cc:260] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.299824 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:35.300987 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 67566.8us
I20260709 12:27:35.233054 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:35.310717 22144 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.311133 22806 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:35.312325 22038 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:35.300146 22112 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.277323 22218 rpcz_store.cc:276] 0709 12:27:33.457102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.538837 (+1081735us) service_pool.cc:224] Handling call
0709 12:27:34.567892 (+ 29055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.568113 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:34.579611 (+ 11498us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.208868 (+629257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:35.208929 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:35.208980 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.209048 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.209149 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133067,"prepare.queue_time_us":15179,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":133465,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":495826,"threads_started":1,"wal-append.queue_time_us":603592}
W20260709 12:27:35.314424 22113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.307186 22037 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:35.314893 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:35.315519 22215 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:35.308409 22776 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.239965 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 792) took 1753 ms. Trace:
W20260709 12:27:35.308848 22114 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.309412 22805 raft_consensus.cc:2393] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:35.286028 24437 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.306746 22773 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:35.317072 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 78769.8us
I20260709 12:27:35.289978 25150 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:35.322038 22776 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:35.322292 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.320122 22214 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:35.327463 22809 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:35.329457 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:35.332707 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:35.333966 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.322535 22776 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.336427 22809 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:27:35.280638 24675 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:35.302816 25059 raft_consensus.cc:2764] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:27:35.343725 22114 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.337821 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 796) took 2086 ms. Trace:
I20260709 12:27:35.340579 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:35.304987 25032 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:35.341910 22217 raft_consensus.cc:1240] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:35.344518 22810 raft_consensus.cc:1240] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:35.345036 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.346923 22809 rpcz_store.cc:276] 0709 12:27:33.251503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.335222 (+2083719us) service_pool.cc:224] Handling call
0709 12:27:35.335860 (+   638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:35.336921 (+  1061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.337639 (+   718us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:35.348176 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:35.344128 22804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 790) took 1860 ms (client timeout 2023 ms). Trace:
W20260709 12:27:35.353231 22804 rpcz_store.cc:269] 0709 12:27:33.483746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.071932 (+588186us) service_pool.cc:224] Handling call
0709 12:27:35.343871 (+1271939us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54006220d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:35.344060 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385406720}
I20260709 12:27:35.354090 22805 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:35.354578 22804 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:35.355275 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 709) took 1528 ms. Trace:
I20260709 12:27:35.355638 22804 rpcz_store.cc:276] 0709 12:27:33.828342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.354111 (+1525769us) service_pool.cc:224] Handling call
0709 12:27:35.354387 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:35.355026 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.355215 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:35.357138 25032 raft_consensus.cc:697] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:35.312106 24878 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:35.354779 24876 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:35.354769 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 791) took 1870 ms. Trace:
I20260709 12:27:35.358098 25032 consensus_queue.cc:237] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:35.358568 22805 rpcz_store.cc:276] 0709 12:27:33.484008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.353524 (+1869516us) service_pool.cc:224] Handling call
0709 12:27:35.353845 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:35.354506 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.354714 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:35.359236 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.359572 25046 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:35.330811 24928 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:27:35.361972 25021 raft_consensus.cc:3055] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:35.337314 24802 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:27:35.320772 22802 rpcz_store.cc:276] 0709 12:27:33.486716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.328099 (+841383us) service_pool.cc:224] Handling call
0709 12:27:35.239734 (+911635us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400690354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:35.239891 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369033600}
I20260709 12:27:35.364480 24437 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:35.291499 25138 consensus_queue.cc:237] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.311523 25035 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:35.367188 25035 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:35.367583 25035 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.370788 22803 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:35.362124 25022 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.352200 22806 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.373066 22140 raft_consensus.cc:1240] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:35.373353 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:35.375587 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 68505.5us
I20260709 12:27:35.394881 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:35.395570 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.395794 22220 raft_consensus.cc:2368] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8.
I20260709 12:27:35.343410 25164 raft_consensus.cc:2804] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:35.319666 25161 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.402866 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 792) took 2186 ms. Trace:
I20260709 12:27:35.419953 22808 rpcz_store.cc:276] 0709 12:27:33.216697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.859876 (+1643179us) service_pool.cc:224] Handling call
0709 12:27:35.239881 (+380005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:35.303029 (+ 63148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.402616 (+ 99587us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400690350. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:35.402796 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873005952}
I20260709 12:27:35.351106 25153 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:35.351418 25174 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.376773 22144 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:35.415899 22037 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:35.433986 22036 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:35.423200 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:35.435310 22218 raft_consensus.cc:2376] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6. Re-sending same reply.
I20260709 12:27:35.425941 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:35.426812 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:35.436256 22214 raft_consensus.cc:2376] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6. Re-sending same reply.
I20260709 12:27:35.354238 25177 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:27:35.436405 22222 raft_consensus.cc:2368] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7.
I20260709 12:27:35.427723 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:35.376585 25021 raft_consensus.cc:740] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:35.446803 25013 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:35.448017 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:35.448711 22221 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.450160 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 790) took 2244 ms. Trace:
W20260709 12:27:35.450524 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 128519us
W20260709 12:27:35.451308 22776 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.450555 22810 rpcz_store.cc:276] 0709 12:27:33.206115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.818267 (+1612152us) service_pool.cc:224] Handling call
0709 12:27:35.344320 (+526053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:35.351701 (+  7381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.449942 (+ 98241us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54006220d0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:35.450096 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193711488}
W20260709 12:27:35.452387 22776 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.437877 22220 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
W20260709 12:27:35.453249 22776 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.453879 22776 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.454898 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:35.455868 22218 raft_consensus.cc:1240] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:35.369449 24923 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.461148 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:35.461511 22776 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.438414 22804 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:35.469383 22215 raft_consensus.cc:1240] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:27:35.467238 22776 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:35.479485 22215 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:27:35.479646 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.480043 22776 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:35.483803 22776 leader_election.cc:336] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:35.484653 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.484917 22144 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:35.471446 22803 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:35.460404 25117 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:35.460799 25084 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:35.431143 24946 consensus_queue.cc:1059] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:27:35.456055 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 804) took 1021 ms. Trace:
I20260709 12:27:35.496289 22038 leader_election.cc:400] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8.
I20260709 12:27:35.502563 22038 leader_election.cc:403] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:35.496843 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 196799us
W20260709 12:27:35.498128 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:35.491489 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.460573 25164 raft_consensus.cc:697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:35.467016 25113 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:35.511206 22114 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.512627 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 721) took 1398 ms. Trace:
I20260709 12:27:35.483415 25161 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:35.480322 25153 raft_consensus.cc:697] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:35.521734 22810 raft_consensus.cc:1240] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:35.515895 22112 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:35.480561 25013 raft_consensus.cc:697] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:35.519439 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.518668 22038 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:35.460650 25093 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:27:35.526671 22221 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
W20260709 12:27:35.502581 22776 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.513202 22805 rpcz_store.cc:276] 0709 12:27:34.114162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.359378 (+1245216us) service_pool.cc:224] Handling call
0709 12:27:35.359659 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:35.359861 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:35.360766 (+   905us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.512298 (+151532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:35.512344 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:35.512394 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.512460 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.512572 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":412,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":5586,"thread_start_us":151188,"threads_started":1}
W20260709 12:27:35.546213 22188 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:35.548806 22114 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.527839 24437 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:35.550118 24437 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.530520 22144 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:35.546500 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43948.6us
I20260709 12:27:35.550536 24437 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:35.549163 22188 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.575033 22805 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:35.545923 24876 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:27:35.528801 25105 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:35.478156 25160 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.507781 25188 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:35.509513 25021 consensus_queue.cc:260] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.467175 25175 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:27:35.570693 22144 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:27:35.589546 22144 pending_rounds.cc:85] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 5
I20260709 12:27:35.444412 24675 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.514063 25059 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:35.510262 25184 consensus_queue.cc:1059] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:27:35.594498 24923 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:35.506944 22801 rpcz_store.cc:276] 0709 12:27:34.426812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.474302 (+ 47490us) service_pool.cc:224] Handling call
0709 12:27:35.419087 (+944785us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b540055ee54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:35.448356 (+ 29269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107189120}
I20260709 12:27:35.574271 22038 leader_election.cc:400] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7.
W20260709 12:27:35.567647 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 81145.5us
I20260709 12:27:35.577261 22214 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:35.578322 22188 leader_election.cc:336] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.511003 25162 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:27:35.603013 22188 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.602119 22038 leader_election.cc:403] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:35.577381 22776 leader_election.cc:336] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.580705 25119 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.569979 24878 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:35.583340 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 95349.6us
I20260709 12:27:35.526569 24928 consensus_queue.cc:1059] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:27:35.589876 22144 pending_rounds.cc:107] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:27:35.615026 22144 raft_consensus.cc:2889] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:35.528098 25046 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:27:35.591377 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.589076 22775 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:35.591926 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.593879 24675 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:35.602348 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:35.609675 24437 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.610826 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:35.611877 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:35.610715 22807 raft_consensus.cc:2393] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:35.613178 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:35.635779 22140 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 8. Ops: []
I20260709 12:27:35.635980 22146 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:35.636535 24437 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:35.592099 24886 consensus_queue.cc:1059] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:27:35.654011 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:35.655798 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:35.659747 22148 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:35.663008 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 51221.6us
I20260709 12:27:35.663870 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:35.616261 25184 raft_consensus.cc:3060] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:27:35.669181 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 64476.9us
W20260709 12:27:35.670850 22776 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:35.656654 25189 log.cc:927] Time spent T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:27:35.585142 25105 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:35.688225 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 99255.2us
I20260709 12:27:35.656873 24878 raft_consensus.cc:697] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:35.603741 25192 consensus_queue.cc:1059] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:27:35.699429 22038 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:35.611491 25059 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.703297 25064 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:35.709517 22186 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:35.591075 25164 consensus_queue.cc:237] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.684305 25108 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:35.701874 22776 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:35.723177 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:35.717952 22038 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:35.727190 22222 raft_consensus.cc:1240] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:35.730912 25020 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:35.640553 25013 consensus_queue.cc:237] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.705178 25150 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:35.741917 25191 log.cc:927] Time spent T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:27:35.705914 25163 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:35.744700 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 143191us
I20260709 12:27:35.714906 25175 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.653299 25153 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.720669 25108 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.691931 25185 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.774210 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:35.783370 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.786209 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:35.787469 20917 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 22098)
W20260709 12:27:35.759284 24592 consensus_meta.cc:287] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.000s
I20260709 12:27:35.788367 22806 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:35.759127 25200 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:35.759469 25162 raft_consensus.cc:3055] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:35.793609 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:35.808180 22806 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:35.743994 24946 consensus_queue.cc:1059] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:27:35.801891 25160 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:35.809603 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 191998us
I20260709 12:27:35.786793 25108 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.811650 22809 raft_consensus.cc:1240] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 8. Ops: []
I20260709 12:27:35.784714 25163 raft_consensus.cc:697] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:35.807926 25162 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:35.834574 22806 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:35.836068 25177 raft_consensus.cc:3055] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:35.823408 25201 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:35.822572 25200 raft_consensus.cc:697] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:35.820320 25209 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:35.845863 25177 raft_consensus.cc:740] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:35.853137 25210 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:35.853578 25177 consensus_queue.cc:260] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.854028 25162 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.855090 25177 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:35.855331 25162 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.859107 25163 consensus_queue.cc:237] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.863322 22801 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:35.864787 24876 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8.
W20260709 12:27:35.866158 25203 log.cc:927] Time spent T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:35.866976 25105 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:35.868378 25185 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:35.869793 24946 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.869971 25184 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7.
I20260709 12:27:35.870365 24946 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:35.872169 25059 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:35.876528 22148 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
W20260709 12:27:35.878281 25057 consensus_meta.cc:287] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.586s	user 0.003s	sys 0.004s
I20260709 12:27:35.879745 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:35.880475 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 75028.1us
I20260709 12:27:35.887990 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:35.888896 22148 raft_consensus.cc:2393] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 4: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:35.873054 24946 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:35.813208 24878 consensus_queue.cc:237] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:35.886323 25184 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.896328 24876 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:35.863705 22802 raft_consensus.cc:1240] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:27:35.907143 22147 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:35.911815 22148 raft_consensus.cc:1240] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:35.914848 22144 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:35.916056 22144 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:35.921324 22147 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:35.916872 22144 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:35.900477 24928 consensus_queue.cc:1059] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:27:35.891975 25057 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.012954 22147 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:27:35.957618 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.961740 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:36.016795 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.016940 22148 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:36.020001 22803 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:27:36.038228 22142 raft_consensus.cc:1240] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:35.913956 25184 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:36.034372 25187 log.cc:927] Time spent T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:27:36.042440 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 357700us
I20260709 12:27:36.053586 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 806) took 1075 ms. Trace:
I20260709 12:27:36.053779 22808 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:36.054127 22807 rpcz_store.cc:276] 0709 12:27:34.978451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.045695 (+ 67244us) service_pool.cc:224] Handling call
0709 12:27:36.053330 (+1007635us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54006e0354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:36.053510 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236760320}
W20260709 12:27:36.057994 22776 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:36.063925 22776 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 114 similar messages]
I20260709 12:27:36.042022 25093 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:27:36.040639 24928 consensus_queue.cc:1059] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 12:27:36.061293 25022 consensus_meta.cc:287] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.006s
W20260709 12:27:36.114748 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 56427.1us
I20260709 12:27:36.116123 22112 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:36.123199 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 82850.3us
I20260709 12:27:36.124256 22036 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:36.010462 25200 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.129475 22148 raft_consensus.cc:3055] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:36.061936 25152 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:27:36.129935 22148 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:36.114907 25205 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:36.130566 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.049975 24876 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:27:36.138413 22148 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.146564 22148 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:36.125160 25022 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:36.152634 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 331497us
I20260709 12:27:36.156167 25229 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:36.165534 25226 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:36.166990 25211 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:27:36.168594 25223 log.cc:927] Time spent T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:27:36.154219 25022 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.157823 25199 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.173408 22148 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:27:36.175817 22148 pending_rounds.cc:85] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 3
I20260709 12:27:36.176654 22148 pending_rounds.cc:107] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:27:36.177014 22148 raft_consensus.cc:2889] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:36.175645 25022 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:36.179737 25229 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:36.181712 22801 raft_consensus.cc:1240] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:27:36.187548 25218 log.cc:927] Time spent T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:27:36.190474 25227 consensus_queue.cc:1059] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:36.199416 25216 log.cc:927] Time spent T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:27:36.178637 25199 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.203655 25199 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:36.204909 25228 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:36.205334 25213 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.206836 25213 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.207880 22801 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:36.209035 25213 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:36.209883 25174 consensus_meta.cc:287] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.003s
I20260709 12:27:36.209111 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:36.214149 24874 raft_consensus.cc:3055] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:36.214671 24874 raft_consensus.cc:740] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:36.215601 24874 consensus_queue.cc:260] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.216851 24874 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:36.218405 25201 raft_consensus.cc:3055] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:36.218844 25201 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:36.219971 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 641643us
I20260709 12:27:36.147143 25205 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:36.220746 22188 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:36.232105 22188 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.224817 22148 raft_consensus.cc:1240] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:36.226953 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:36.228520 22143 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:27:36.240046 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 530577us
I20260709 12:27:36.235033 22141 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:36.241926 22186 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:36.237483 25035 consensus_meta.cc:287] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.005s
I20260709 12:27:36.229590 24675 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:36.250224 22186 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:36.230021 25057 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:36.255789 22036 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:36.260283 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 385422us
W20260709 12:27:36.294201 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 44056.3us
I20260709 12:27:36.296898 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:36.286975 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.297410 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:36.297801 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:36.298207 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:36.264302 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43584us
I20260709 12:27:36.298413 22215 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
W20260709 12:27:36.304198 22188 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:36.298931 22213 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 3.
I20260709 12:27:36.304641 22188 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.323913 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:36.325807 22186 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:36.258378 25110 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:36.329406 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 172593us
I20260709 12:27:36.260910 25036 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:36.286547 25154 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:36.286777 25174 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:36.248977 25235 raft_consensus.cc:3055] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:36.299535 25042 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:36.261134 25150 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:27:36.354852 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.299757 25119 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:27:36.264268 25153 consensus_queue.cc:1059] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:27:36.331815 25184 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:36.265229 25035 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.334656 25036 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:36.347157 25174 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.364713 25119 consensus_queue.cc:1243] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:36.362608 25042 raft_consensus.cc:697] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:36.371433 22113 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.349397 25110 raft_consensus.cc:697] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:36.370123 25162 consensus_meta.cc:287] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.003s
I20260709 12:27:36.350975 25235 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:36.375854 25036 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.369702 25154 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:36.364130 25087 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.346958 25022 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.381359 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:36.374176 25174 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:36.258018 25201 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.390954 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:36.370978 25239 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:36.396201 22113 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:36.399489 22113 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.401139 24923 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:36.404711 25193 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:36.367434 25057 consensus_queue.cc:1048] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:27:36.333762 25229 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.369282 25225 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:27:36.390386 25231 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:36.393371 25162 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.405260 25193 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:36.379097 25033 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:27:36.397836 25239 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:36.417651 24675 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.415660 25234 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.427711 25193 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:36.436015 25087 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.436273 22804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 793) took 2392 ms. Trace:
I20260709 12:27:36.438372 25239 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.441982 25042 consensus_queue.cc:237] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.468382 25087 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.450580 24675 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.485033 24675 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:36.490504 22218 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:36.462937 25205 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:36.419437 25235 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.504127 25087 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:36.505075 25236 log.cc:927] Time spent T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:27:36.505683 25154 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:36.467056 22804 rpcz_store.cc:276] 0709 12:27:34.037243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.356410 (+1319167us) service_pool.cc:224] Handling call
0709 12:27:35.356721 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:35.491043 (+134322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.416423 (+925380us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b540076af54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:36.429712 (+ 13289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102107008}
I20260709 12:27:36.441485 25110 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:36.463773 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 159599us
W20260709 12:27:36.538576 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:36.539211 22188 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:36.510560 25108 consensus_meta.cc:287] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
W20260709 12:27:36.547693 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 148277us
I20260709 12:27:36.548714 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:36.549721 25209 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.550439 25087 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:36.518875 25150 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:36.567188 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 241486us
I20260709 12:27:36.519011 24878 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.515829 25235 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:36.568483 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:36.515424 25035 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.567785 22113 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:36.547578 24923 raft_consensus.cc:697] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:36.571434 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.571585 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:36.572564 22222 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:36.582171 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:36.587491 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:36.575578 25209 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.554322 25108 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:36.631170 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 47772us
I20260709 12:27:36.585405 25225 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:36.586725 25057 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:36.638267 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 88357.4us
W20260709 12:27:36.639113 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:36.639542 22188 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.618865 25031 raft_consensus.cc:3055] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:36.571347 25150 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.650559 22148 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:36.641065 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:36.571501 24878 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.649160 22113 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.655869 22188 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.656669 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:36.659397 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:36.662642 22148 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:36.664628 25154 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.664909 25057 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:36.665326 25057 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:36.664407 24878 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.665835 25057 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:36.666235 24923 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.667285 25229 consensus_queue.cc:1048] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:36.667498 25036 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.665661 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.630896 25231 raft_consensus.cc:697] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:36.668514 22215 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:36.670960 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:36.673233 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:36.674937 22221 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.673769 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:36.676813 22216 raft_consensus.cc:1275] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:36.675069 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:36.679963 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:36.682940 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:36.683624 22139 raft_consensus.cc:3060] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.688796 22213 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:36.646917 25031 raft_consensus.cc:740] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:36.695394 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:36.695771 22220 raft_consensus.cc:1275] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:36.647529 25245 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:36.696712 22806 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:36.640231 25205 consensus_queue.cc:1059] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:27:36.669903 25225 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:36.706791 22773 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:36.712271 22221 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:36.727842 25244 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:36.731225 25247 log.cc:927] Time spent T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:27:36.731012 25244 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:36.731513 25195 log.cc:927] Time spent T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 1.147s	user 0.005s	sys 0.012s
I20260709 12:27:36.737902 25244 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:36.681846 25229 consensus_queue.cc:1059] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:27:36.706116 25105 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:36.696929 25150 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.744135 25105 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.744503 25231 consensus_queue.cc:237] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.695837 25174 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.749121 25021 raft_consensus.cc:3060] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:36.749558 25174 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.743233 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:36.752399 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 45697.3us
W20260709 12:27:36.754951 25248 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:27:36.758102 22773 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.715689 24675 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:36.716374 25225 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:36.760807 22773 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:36.771430 25105 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:36.771503 22139 raft_consensus.cc:2468] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:36.777514 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 799) took 2627 ms. Trace:
I20260709 12:27:36.778016 22809 rpcz_store.cc:276] 0709 12:27:34.150237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.361319 (+1211082us) service_pool.cc:224] Handling call
0709 12:27:35.361596 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:35.812992 (+451396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.777249 (+964257us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540055fad4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:36.777431 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034612608}
I20260709 12:27:36.751791 25057 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.781051 25057 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.783602 25032 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:36.777940 25161 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.777561 25239 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.785358 25161 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.786829 25239 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.787789 25161 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.757972 25138 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:36.810005 22773 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:36.765836 24675 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.811355 25251 raft_consensus.cc:3055] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:36.811770 25251 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:36.812376 24675 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:36.766836 25031 consensus_queue.cc:260] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:36.813145 25031 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:36.813925 25229 raft_consensus.cc:3055] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:36.814317 25229 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:36.815166 25229 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.816576 25229 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.728102 25243 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.818791 25243 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.820070 25117 raft_consensus.cc:3055] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:36.820479 25117 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:36.821281 25243 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:36.822077 22217 raft_consensus.cc:1240] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:36.781944 25193 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.824354 25193 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.826116 25161 raft_consensus.cc:2804] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:36.826713 25161 raft_consensus.cc:697] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:36.743461 25035 consensus_queue.cc:1059] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:27:36.791663 20917 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:36.795130 22804 raft_consensus.cc:1240] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:27:36.795576 25022 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.795847 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:36.784729 25108 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:36.773837 25036 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:36.766718 25113 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:36.800310 25197 raft_consensus.cc:2804] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:36.801671 22220 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:36.801877 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:36.802449 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:36.920297 22215 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:27:36.802949 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.762764 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:36.808238 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:36.923533 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:36.924727 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:36.925318 22219 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:36.809051 25225 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:36.812650 25251 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:36.791182 22037 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:36.950680 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 159589us
W20260709 12:27:36.828194 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 102624us
I20260709 12:27:36.837024 22113 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:36.846522 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:36.891413 22038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.910152 24675 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.926128 22221 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.969223 22221 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:36.978235 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:36.979002 22220 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:36.918421 25138 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:37.029816 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:37.052508 22215 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:37.055348 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:37.056730 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:37.124017 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.172158 22038 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:37.274375 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:37.274114 25161 consensus_queue.cc:237] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:37.275174 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:37.275399 22140 raft_consensus.cc:2410] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:37.275655 22188 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:37.189817 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:37.187383 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.278179 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:37.279711 22220 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:37.281912 22219 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:36.958811 25243 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.962441 25022 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.962219 25208 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:37.298556 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 461654us
I20260709 12:27:36.821309 25117 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:37.314800 22220 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:27:37.367744 22113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.961938 25033 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:37.269372 24923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.014s	sys 0.044s
W20260709 12:27:37.375192 22147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.020s
W20260709 12:27:37.383131 22214 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.016s
W20260709 12:27:37.390679 22147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.006s	sys 0.020s
W20260709 12:27:37.390867 22214 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.011s	sys 0.016s
W20260709 12:27:37.391206 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 116670us
W20260709 12:27:37.390846 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:37.390988 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 218994us
I20260709 12:27:37.298811 25251 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:37.390360 25110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.011s	sys 0.033s
I20260709 12:27:36.970542 25108 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.407s
W20260709 12:27:37.429867 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 462973us
I20260709 12:27:37.321623 25036 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:37.432152 22775 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:37.406132 24923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.014s	sys 0.045s
I20260709 12:27:36.977511 24675 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:37.446731 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.407138 25117 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:37.350626 25231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.010s	sys 0.013s
I20260709 12:27:37.412585 25152 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:37.478912 25152 raft_consensus.cc:697] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:37.480007 25152 consensus_queue.cc:237] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:37.480858 25031 consensus_meta.cc:287] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.001s
I20260709 12:27:37.421666 25032 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 12:27:37.428638 25110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.012s	sys 0.034s
I20260709 12:27:37.466138 25013 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:37.468170 25021 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.411115 25033 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:37.374406 25243 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:37.483680 25247 log.cc:927] Time spent T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:37.436479 25022 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 12:27:37.492909 25231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.011s	sys 0.013s
W20260709 12:27:37.521569 25229 consensus_meta.cc:287] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.000s
I20260709 12:27:37.504719 25021 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:37.599217 25035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.075s	sys 0.089s
W20260709 12:27:37.600530 25262 log.cc:927] Time spent T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:27:37.632673 25243 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:37.633270 25267 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.633842 25267 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:37.636320 25267 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:37.617148 25271 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:37.637251 25271 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:37.619743 25261 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:37.642383 25271 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:37.696117 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.696300 22147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2410) took 1550 ms. Trace:
I20260709 12:27:37.697199 22147 rpcz_store.cc:276] 0709 12:27:36.145800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.152194 (+  6394us) service_pool.cc:224] Handling call
0709 12:27:36.152649 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:36.153083 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:36.162740 (+  9657us) log.cc:844] Serialized 14 byte log entry
0709 12:27:36.805722 (+642982us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b180041c740. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b 00007ff18c2a5d23 00007ff18c2a623a 00007ff18c710a2a
0709 12:27:37.428972 (+623250us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:37.429588 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 12:27:37.429737 (+   149us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:37.429772 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.429847 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:37.695369 (+265522us) raft_consensus.cc:1685] finished
0709 12:27:37.695591 (+   222us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.696019 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23457,"prepare.queue_time_us":9912,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":98624,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":201,"spinlock_wait_cycles":7960320,"thread_start_us":599488,"threads_started":1,"wal-append.queue_time_us":1345166}
I20260709 12:27:37.715219 22216 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
W20260709 12:27:37.718977 22773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.003s	sys 0.011s
W20260709 12:27:37.719592 22773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.003s	sys 0.011s
W20260709 12:27:37.604488 25035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.076s	sys 0.089s
I20260709 12:27:37.744081 25108 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.747048 25035 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.745404 25108 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:37.748020 25035 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:37.750701 25108 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:37.751745 25035 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:37.752244 24675 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:37.752478 25035 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:37.754732 25035 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:37.756634 25021 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:37.758755 25035 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:37.760707 25033 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:37.616886 25197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.031s	sys 0.067s
W20260709 12:27:37.790947 25197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.032s	sys 0.068s
I20260709 12:27:37.791419 25197 raft_consensus.cc:697] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:37.844339 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:37.846174 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.846957 25231 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:37.848122 25231 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:37.851509 22774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.000s	sys 0.036s
I20260709 12:27:37.859737 25271 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:37.861210 25271 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:37.863699 22774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.000s	sys 0.036s
W20260709 12:27:37.882678 20917 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 22098)
W20260709 12:27:37.890031 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.907474 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2453) took 1461 ms. Trace:
I20260709 12:27:37.908115 22218 rpcz_store.cc:276] 0709 12:27:36.445945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.447229 (+  1284us) service_pool.cc:224] Handling call
0709 12:27:36.461229 (+ 14000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.491097 (+ 29868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.906679 (+1415582us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b5400028d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:37.907115 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66374400}
I20260709 12:27:37.913604 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58424 (request call id 2460) took 1112 ms. Trace:
I20260709 12:27:37.915915 22216 rpcz_store.cc:276] 0709 12:27:36.801508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.801617 (+   109us) service_pool.cc:224] Handling call
0709 12:27:37.913218 (+1111601us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b5400295254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:37.913425 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827880320}
I20260709 12:27:37.907686 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2457) took 1107 ms. Trace:
W20260709 12:27:37.892253 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 460030us
I20260709 12:27:37.923112 22222 rpcz_store.cc:276] 0709 12:27:36.800587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.800716 (+   129us) service_pool.cc:224] Handling call
0709 12:27:36.801053 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.818822 (+ 17769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:36.818855 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:36.818900 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:36.818932 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.907032 (+1088100us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54003566d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:37.907114 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.907440 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40358144}
I20260709 12:27:37.923656 24996 raft_consensus.cc:3055] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:37.944108 24996 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:37.945228 25161 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:37.936002 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.946024 25161 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:37.939850 22188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.000s	sys 0.011s
I20260709 12:27:37.936867 25271 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:37.939980 22220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.007s
W20260709 12:27:37.937793 22215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.001s	sys 0.016s
W20260709 12:27:37.942683 22213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.028s	sys 0.031s
W20260709 12:27:37.943735 25282 log.cc:927] Time spent T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:27:37.948935 22220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.012s	sys 0.008s
W20260709 12:27:37.947708 22188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.000s	sys 0.011s
W20260709 12:27:37.950623 22215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.002s	sys 0.016s
I20260709 12:27:37.945683 24996 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:37.951740 22213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.029s	sys 0.031s
I20260709 12:27:37.891932 25197 consensus_queue.cc:237] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:37.954829 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2463) took 1147 ms. Trace:
I20260709 12:27:37.955231 24996 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:37.956477 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 681286us
I20260709 12:27:37.934569 25231 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:37.961850 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2028) took 1235 ms. Trace:
W20260709 12:27:37.963646 25260 log.cc:927] Time spent T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 1.125s	user 0.011s	sys 0.010s
I20260709 12:27:37.966231 22775 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:37.967267 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 732) took 2211 ms. Trace:
I20260709 12:27:37.983701 25031 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:37.983964 22776 leader_election.cc:336] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:37.984319 22188 leader_election.cc:336] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:37.984596 25031 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:37.986213 22188 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:37.986776 25271 consensus_queue.cc:1048] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:37.987509 25031 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:37.989396 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1812) took 2409 ms. Trace:
I20260709 12:27:37.979920 22810 rpcz_store.cc:276] 0709 12:27:35.755789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.810399 (+ 54610us) service_pool.cc:224] Handling call
0709 12:27:35.826377 (+ 15978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:35.826831 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:35.826863 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:35.836767 (+  9904us) log.cc:844] Serialized 26 byte log entry
0709 12:27:37.507768 (+1671001us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b1800319a80. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b 00007ff18c2a5d23 00007ff18c2a60d1 00007ff18c6c1a0f
0709 12:27:37.938290 (+430522us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:37.938394 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.938558 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:37.966676 (+ 28118us) raft_consensus.cc:1685] finished
0709 12:27:37.966693 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.966970 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":628,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3830,"spinlock_wait_cycles":8739968,"thread_start_us":416355,"threads_started":1,"wal-append.queue_time_us":2054358}
I20260709 12:27:37.984534 22776 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:37.995342 22113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.999747 22188 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:37.993232 22142 rpcz_store.cc:276] 0709 12:27:35.579534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.579768 (+   234us) service_pool.cc:224] Handling call
0709 12:27:35.580085 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.039905 (+459820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.988840 (+1948935us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b540013e054. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:37.989192 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053085440}
I20260709 12:27:37.968434 22213 rpcz_store.cc:276] 0709 12:27:36.726917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.833149 (+106232us) service_pool.cc:224] Handling call
0709 12:27:36.833547 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.833798 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:37.175806 (+342008us) log.cc:844] Serialized 14 byte log entry
0709 12:27:37.961319 (+785513us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:37.961413 (+    94us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:37.961516 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.961613 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.961777 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75440,"prepare.queue_time_us":359901,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":1130,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":780455,"threads_started":1,"wal-append.queue_time_us":778968}
I20260709 12:27:38.005667 25273 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:38.006862 25272 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:38.013074 25286 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:38.011504 25273 raft_consensus.cc:697] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:38.020226 22188 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:38.011303 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 525875us
I20260709 12:27:38.020785 22188 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:38.014644 25033 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:38.025552 25033 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.026037 25286 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:38.036123 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 52348.1us
I20260709 12:27:38.043608 25272 consensus_queue.cc:1048] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:38.047914 25161 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:38.049096 25225 consensus_meta.cc:287] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 1.030s	user 0.006s	sys 0.018s
I20260709 12:27:38.049674 25225 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.051069 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.052783 25225 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:38.053081 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.054406 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:38.055138 22139 raft_consensus.cc:1240] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:38.055799 25153 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:38.056550 25153 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:38.057751 22038 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:38.059177 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:38.058548 25153 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.060237 22145 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:38.063310 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:38.076133 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2029) took 1310 ms. Trace:
I20260709 12:27:38.076694 22217 rpcz_store.cc:276] 0709 12:27:36.768757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.769057 (+   300us) service_pool.cc:224] Handling call
0709 12:27:36.769385 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.822458 (+ 53073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.075615 (+1253157us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54000889d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:38.075937 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120748928}
W20260709 12:27:38.079128 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.076537 22143 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:38.095044 24949 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:38.095844 24949 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:38.097651 22037 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:38.097599 24949 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.109773 22145 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:38.101645 25286 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:38.123149 25251 consensus_meta.cc:287] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.011s
W20260709 12:27:38.124459 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 104337us
I20260709 12:27:38.125335 22142 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:27:38.125810 25117 consensus_meta.cc:287] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.008s
I20260709 12:27:38.126762 25201 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:38.127274 25213 raft_consensus.cc:3055] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:38.127738 25213 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:38.126771 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2034) took 1291 ms. Trace:
I20260709 12:27:38.130851 22220 rpcz_store.cc:276] 0709 12:27:36.835515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.315959 (+480444us) service_pool.cc:224] Handling call
0709 12:27:37.316264 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.950476 (+634212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.950533 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:37.963431 (+ 12898us) log.cc:844] Serialized 26 byte log entry
0709 12:27:37.996409 (+ 32978us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:37.996445 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.999576 (+  3131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:38.111216 (+111640us) raft_consensus.cc:1685] finished
0709 12:27:38.111242 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:38.126703 (+ 15461us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122259,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":29656,"thread_start_us":665528,"threads_started":2,"wal-append.queue_time_us":76859}
I20260709 12:27:38.132642 25213 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.125540 22147 raft_consensus.cc:1240] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:38.134693 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2438) took 2596 ms. Trace:
I20260709 12:27:38.131357 25272 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:38.135691 25272 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.139315 25272 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:38.134887 25213 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:38.141731 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:38.142452 25117 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:38.134204 22140 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:38.126075 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 99249us
W20260709 12:27:38.125422 22188 leader_election.cc:336] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:38.145264 22188 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:38.125917 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.149819 25285 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:38.150123 25286 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.020560 25273 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.126911 25276 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:38.127691 22037 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:38.143673 25021 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:38.161132 24996 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:38.162107 22188 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:38.159541 25021 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.166038 25021 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:38.166200 24996 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:38.152098 25276 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.166993 24996 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.135146 22214 rpcz_store.cc:276] 0709 12:27:35.435134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.436901 (+  1767us) service_pool.cc:224] Handling call
0709 12:27:35.576706 (+139805us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b58000f5a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:35.576902 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.221290 (+644388us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:36.807067 (+585777us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b1800229b40. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189616455 00007ff1900fe3c7 00007ff18c7109a7 00007ff18c7200bf 00007ff18c720038
0709 12:27:37.406060 (+598993us) log.cc:844] Serialized 14 byte log entry
0709 12:27:38.000629 (+594569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:38.005197 (+  4568us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:38.013825 (+  8628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.014562 (+   737us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:38.031365 (+ 16803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":629519,"prepare.queue_time_us":504833,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":612583,"raft.run_cpu_time_us":567,"raft.run_wall_time_us":7708,"spinlock_wait_cycles":27477632,"thread_start_us":1068488,"threads_started":2,"wal-append.queue_time_us":517526}
I20260709 12:27:38.170445 22188 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:38.187618 24949 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:38.188971 22186 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:38.189338 22214 raft_consensus.cc:1275] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:38.196466 25286 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:38.198730 25293 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:27:37.958814 22215 rpcz_store.cc:276] 0709 12:27:36.807565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.165339 (+357774us) service_pool.cc:224] Handling call
0709 12:27:37.165800 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.166177 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:37.381529 (+215352us) log.cc:844] Serialized 14 byte log entry
0709 12:27:37.952516 (+570987us) log.cc:844] Serialized 14 byte log entry
0709 12:27:37.952787 (+   271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:37.954262 (+  1475us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:37.954360 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.954493 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.954740 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134111,"prepare.queue_time_us":242053,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":79967,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":15472,"spinlock_wait_cycles":26829696,"thread_start_us":569387,"threads_started":1}
I20260709 12:27:38.198328 24996 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.202821 25251 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:38.217278 25250 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.215126 25251 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.218128 25250 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.219128 24996 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:38.219677 24996 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.220073 24996 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:38.224020 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:38.225373 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:38.226192 22217 raft_consensus.cc:2468] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:38.229173 22222 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:27:38.231005 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 68996.7us
W20260709 12:27:38.232122 22188 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:38.233839 22188 leader_election.cc:336] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:38.234467 25046 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:38.235317 25046 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.236071 25251 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:38.243319 22148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51462 (request call id 2419) took 1663 ms (client timeout 2168 ms). Trace:
W20260709 12:27:38.243837 22148 rpcz_store.cc:269] 0709 12:27:36.579713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.587229 (+  7516us) service_pool.cc:224] Handling call
0709 12:27:38.242983 (+1655754us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b54000c99d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:38.243137 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143546624}
I20260709 12:27:38.216681 25119 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:38.217062 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.204851 25276 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.245985 25286 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.201717 25225 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:38.203042 25231 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:38.234416 22188 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:38.261051 22038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.257016 22144 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:38.226375 25033 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:38.216681 25227 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:38.250092 25250 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.259709 25197 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.279072 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:38.258469 25273 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:38.280236 22220 raft_consensus.cc:2468] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:38.253947 25272 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:38.284704 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:38.288031 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.302126 25214 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.305548 24876 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.306113 25138 raft_consensus.cc:3055] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:38.304610 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:38.314823 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:38.307896 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 74172.4us
I20260709 12:27:38.326911 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.320912 22144 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:27:38.322813 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2032) took 1416 ms. Trace:
I20260709 12:27:38.324088 22215 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:38.306387 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:38.308688 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 181225us
I20260709 12:27:38.339119 22144 pending_rounds.cc:85] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 7
I20260709 12:27:38.293083 25033 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:38.322132 22802 raft_consensus.cc:1275] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:38.328258 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.369037 22145 raft_consensus.cc:2410] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:27:38.371047 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:38.371578 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.320916 22804 raft_consensus.cc:1240] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:38.362782 22144 pending_rounds.cc:107] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:27:38.369907 22808 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:38.373196 22144 raft_consensus.cc:2889] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:38.364598 25250 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.375602 24840 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.376161 25250 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.335690 25138 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:38.322789 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.305761 25274 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:38.327633 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:38.384348 22806 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:38.294692 25286 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.295302 25225 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:38.384829 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.382288 22810 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:38.328433 25164 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.386421 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:38.297735 25227 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.299242 25273 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:38.390326 22188 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:38.397354 22801 raft_consensus.cc:2410] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:27:38.392526 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:38.376241 24840 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:38.398576 24437 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:27:38.399084 25296 log.cc:927] Time spent T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:27:38.400221 25274 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.359622 22219 rpcz_store.cc:276] 0709 12:27:36.834908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.312359 (+477451us) service_pool.cc:224] Handling call
0709 12:27:37.312859 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.313264 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.313293 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:37.382178 (+ 68885us) log.cc:844] Serialized 26 byte log entry
0709 12:27:37.938978 (+556800us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:37.939061 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.939184 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:38.239740 (+300556us) spinlock_profiling.cc:243] Waited 9.26 ms on lock 0x7b180043aec0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:27:38.247048 (+  7308us) raft_consensus.cc:1685] finished
0709 12:27:38.247067 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:38.251070 (+  4003us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79331,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":15128,"spinlock_wait_cycles":21288192,"thread_start_us":440236,"threads_started":1,"wal-append.queue_time_us":510517}
I20260709 12:27:38.405548 25250 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.359388 25214 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.373548 25276 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.438498 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:38.406810 22148 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:38.407524 22143 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:38.408541 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.408224 25138 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.409641 22146 raft_consensus.cc:2410] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:27:38.417944 22141 raft_consensus.cc:1275] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:38.418579 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.318852 25231 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.381855 25251 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.322751 25272 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.306303 24876 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.421177 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.421386 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.423651 25021 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.372700 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.428220 25164 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.432755 22214 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:38.424693 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2398) took 2523 ms. Trace:
W20260709 12:27:38.438405 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.304944 25197 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.442775 22188 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:38.448680 22217 raft_consensus.cc:2393] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 8: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:38.474411 22144 rpcz_store.cc:276] 0709 12:27:35.901730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.901873 (+   143us) service_pool.cc:224] Handling call
0709 12:27:35.914705 (+ 12832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:38.255669 (+2340964us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b580041b7d0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c6620aa 00007ff18c6e4447 00007ff18c6fcfe7 00007ff18c6fe7de 00007ff18c708b49 00007ff18c709416 00007ff18c705d8f 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4
0709 12:27:38.396215 (+140546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.424627 (+ 28412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275588864}
I20260709 12:27:38.473188 22773 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:38.454759 22218 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:38.455082 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.456167 24840 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.458089 25300 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.467326 25273 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:38.469002 25272 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:38.471343 25231 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.460990 25278 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.452806 25276 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.462584 25251 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.472262 24949 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.472661 24876 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:38.471554 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.473338 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.450191 22147 raft_consensus.cc:2393] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:38.483271 22809 raft_consensus.cc:2410] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:38.473565 25268 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:27:38.509162 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 47114.7us
I20260709 12:27:38.510142 25228 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:38.531070 25228 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.533460 25228 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.510919 22145 raft_consensus.cc:2393] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:38.511832 25274 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:38.513031 25250 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:38.535852 25250 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.537575 22215 raft_consensus.cc:1275] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:38.538115 25250 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.513652 25031 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:38.514909 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.515101 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:38.538882 22186 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:38.515237 25285 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.494160 25164 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:38.503571 25138 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:38.501785 25273 consensus_queue.cc:1048] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:27:38.549643 22217 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:38.547438 22186 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:38.563706 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 48740.6us
I20260709 12:27:38.550122 24949 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.567149 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.567986 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.568624 24802 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:38.568833 25210 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.566622 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.569629 25210 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.571940 22038 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:38.572218 25210 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.573105 24675 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:38.573633 24675 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.573838 22036 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:38.568704 25117 raft_consensus.cc:2804] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:38.574806 25117 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.575183 25117 raft_consensus.cc:3060] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:38.580785 25276 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:38.572575 24876 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:27:38.540948 25278 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.587157 25152 raft_consensus.cc:2804] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:38.587664 25152 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.588029 25152 raft_consensus.cc:3060] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:38.538940 25031 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.594791 25031 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:38.595391 25031 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.596027 25031 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:38.597678 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 223637us
W20260709 12:27:38.598759 22188 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:38.505115 25300 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.599213 22188 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:38.600749 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:38.568102 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.601441 25197 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:38.602291 25021 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:38.594529 25228 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:38.604485 25214 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.605580 25225 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.566756 25285 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.608036 22144 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:27:38.611222 22188 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:38.615551 22803 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:38.652577 22806 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
I20260709 12:27:38.619035 24675 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:38.616616 24802 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.651985 25031 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.553092 25268 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:38.568431 25275 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:38.518252 25161 consensus_queue.cc:1048] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 12:27:38.676947 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 63224.9us
I20260709 12:27:38.574266 25154 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:38.688419 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.685889 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:38.680657 22775 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:38.671367 25276 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:38.703509 22808 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:38.705466 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.707108 25152 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.708091 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.708937 22803 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:38.702353 25275 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.709842 25152 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.710161 25275 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:38.605741 25117 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.711822 25110 consensus_queue.cc:1059] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:27:38.712430 25117 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.714727 25232 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.678160 25220 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.720597 25220 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:38.722805 22806 raft_consensus.cc:2410] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:38.727809 25031 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:38.732486 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.719285 22810 raft_consensus.cc:2393] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 5: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:38.731076 25119 consensus_queue.cc:1048] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:38.678344 24996 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:38.739502 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.688887 24802 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:38.726120 25275 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.752072 22037 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:38.753651 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:38.761870 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.722456 25033 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:38.765167 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.745805 25161 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:38.769793 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 175784us
I20260709 12:27:38.772303 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:38.768906 22810 raft_consensus.cc:2468] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:38.773979 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.774901 22145 raft_consensus.cc:2410] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:27:38.775907 22216 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:27:38.777292 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.762017 25117 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:38.782145 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:38.783522 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 182863us
I20260709 12:27:38.796116 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.798447 22037 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:38.734709 25268 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:38.800845 25261 consensus_queue.cc:1048] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:27:38.802285 24996 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.823535 22807 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:38.805812 25300 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.806816 24949 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:38.872512 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 77603us
I20260709 12:27:38.872565 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.810698 25277 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:27:38.747561 25232 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:38.788497 25213 consensus_meta.cc:287] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.648s	user 0.014s	sys 0.000s
I20260709 12:27:38.785147 25117 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:38.821991 22188 leader_election.cc:336] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:38.871045 25285 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.875265 22036 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:38.802314 25297 log.cc:927] Time spent T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.473s	user 0.003s	sys 0.005s
I20260709 12:27:38.796429 25286 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.820106 25275 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.884086 22188 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:38.865737 25228 raft_consensus.cc:2804] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:38.886323 20917 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:38.892347 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.820415 25227 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:38.893508 22805 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:38.926934 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:38.927785 22807 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:38.892352 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:38.893164 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 46498.6us
I20260709 12:27:38.881323 25117 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:38.935025 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 48251.6us
I20260709 12:27:38.952870 22773 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:38.953864 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.954216 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.954674 25164 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:38.954706 22143 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
I20260709 12:27:38.956542 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.957355 22145 raft_consensus.cc:2410] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:27:38.958822 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.960358 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.960983 22145 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:38.962922 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.963608 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.964222 22145 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:38.964865 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.963080 22143 pending_rounds.cc:85] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 4
I20260709 12:27:38.965961 22143 pending_rounds.cc:107] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 12:27:38.969296 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.975070 22139 raft_consensus.cc:2393] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:38.885421 25197 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.966216 22143 raft_consensus.cc:2889] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:38.927114 25228 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.890517 25046 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:38.888895 24996 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:38.884239 24675 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:38.980448 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 47870.2us
I20260709 12:27:38.975207 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:38.981302 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:38.984660 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 54094.1us
W20260709 12:27:38.973429 22776 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:38.931540 25286 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:38.927886 25285 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:38.986368 25297 log.cc:927] Time spent T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:39.012192 22776 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:38.998850 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:39.012698 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 215619us
I20260709 12:27:38.993054 22186 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:38.983472 25275 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:39.019972 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 68614.7us
I20260709 12:27:38.991541 25228 raft_consensus.cc:3060] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:39.023396 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:39.019323 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 253868us
I20260709 12:27:38.930284 25152 consensus_queue.cc:1059] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:27:39.029220 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:38.989550 25164 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:39.038539 22139 raft_consensus.cc:2410] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:39.044618 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.052804 25246 consensus_queue.cc:1059] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:27:39.053603 25232 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.010471 24996 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.055414 22220 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:39.056054 25013 consensus_queue.cc:1059] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
I20260709 12:27:39.056622 25318 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:39.057052 24675 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.057564 22222 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:39.056017 25274 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:39.070935 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 43710.1us
I20260709 12:27:39.073045 25200 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:39.074214 25251 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.032814 25275 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:39.091744 25275 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:39.092877 25275 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.066433 25013 raft_consensus.cc:3055] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:39.067658 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.080847 22139 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:39.098734 25013 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:39.099895 25013 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.101202 22145 raft_consensus.cc:2393] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:39.102535 22145 raft_consensus.cc:1240] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:39.095992 22037 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:39.055331 25268 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:39.095506 22188 leader_election.cc:336] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.023998 25286 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.055974 24996 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:39.108245 25013 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:39.109920 25138 consensus_meta.cc:287] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
I20260709 12:27:39.110936 22216 raft_consensus.cc:1275] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:39.111138 25318 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.043218 25197 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.113199 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.113494 24946 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:39.126492 24946 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:39.132792 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:39.133793 22222 raft_consensus.cc:2410] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:39.133793 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.134635 22145 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:39.135562 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:39.133157 22114 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.141567 22188 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:39.146767 22809 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:27:39.364743 22036 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:39.364660 25022 consensus_queue.cc:1059] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:27:39.363721 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:39.199067 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2421) took 1151 ms. Trace:
W20260709 12:27:39.153654 22114 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.371819 22222 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:39.361066 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 387660us
I20260709 12:27:39.364172 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:39.372234 22142 rpcz_store.cc:276] 0709 12:27:38.047615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.077252 (+ 29637us) service_pool.cc:224] Handling call
0709 12:27:38.077641 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:38.125979 (+ 48338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.198772 (+1072793us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b5400055d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:39.198995 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108629248}
I20260709 12:27:39.147214 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:39.247071 22187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:39.368072 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.371047 22145 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:39.381805 24949 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:39.394094 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 352806us
I20260709 12:27:39.370345 22809 pending_rounds.cc:85] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting all ops after (but not including) 5
I20260709 12:27:39.395272 22809 pending_rounds.cc:107] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:27:39.395792 22809 raft_consensus.cc:2889] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:39.373972 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.385281 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 231647us
I20260709 12:27:39.392999 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:39.150543 25318 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:39.143777 25214 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.391191 22148 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:39.406755 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:39.396924 22114 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.143157 24946 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:39.164271 24996 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:39.322297 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 106613us
I20260709 12:27:39.385473 25152 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:39.416244 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:39.388262 25246 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.409554 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:39.358237 25117 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.429601 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:39.431146 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.434278 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.444494 22147 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:27:39.426369 25138 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:39.444890 22147 pending_rounds.cc:85] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 6
I20260709 12:27:39.447057 22142 raft_consensus.cc:3055] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:27:39.442399 22146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 628) took 2764 ms (client timeout 2692 ms). Trace:
W20260709 12:27:39.438882 22188 leader_election.cc:336] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.449347 22188 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:39.450479 22147 pending_rounds.cc:107] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:27:39.410269 25285 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:27:39.447456 22142 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:39.447844 22146 rpcz_store.cc:269] 0709 12:27:36.673381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.673529 (+   148us) service_pool.cc:224] Handling call
0709 12:27:39.428979 (+2755450us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54002251d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:39.437356 (+  8377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3983966080}
I20260709 12:27:39.435139 25197 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:39.453516 22217 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:39.450845 22147 raft_consensus.cc:2889] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:39.422436 25268 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:27:39.423942 25022 consensus_queue.cc:1059] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 12:27:39.463726 22188 leader_election.cc:336] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.470953 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:39.481292 22188 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:39.432096 25246 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.448935 25138 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:39.438068 24949 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.523181 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:39.473080 24996 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:39.454721 24840 raft_consensus.cc:3055] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:27:39.524637 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 53777.7us
W20260709 12:27:39.556270 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 157265us
I20260709 12:27:39.556934 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:39.550747 22141 raft_consensus.cc:1275] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:27:39.551038 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 87344.8us
I20260709 12:27:39.553644 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.549906 22185 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:39.440650 25214 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.554847 25286 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:39.528383 22142 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.575299 22216 raft_consensus.cc:2410] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:27:39.576330 22775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.040s	sys 0.074s
W20260709 12:27:39.577222 22775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.040s	sys 0.074s
W20260709 12:27:39.549657 24802 consensus_meta.cc:287] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.783s	user 0.010s	sys 0.000s
I20260709 12:27:39.552847 24949 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.588053 25087 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:39.588362 25285 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:39.589466 24802 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.589670 24946 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.591698 24802 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:39.529847 25138 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:39.594988 25321 log.cc:927] Time spent T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.538s	user 0.015s	sys 0.000s
I20260709 12:27:39.598932 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:39.603921 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 830) took 1058 ms. Trace:
I20260709 12:27:39.604178 24996 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:39.603938 25325 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.547s	user 0.008s	sys 0.005s
I20260709 12:27:39.592206 25246 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.552176 25021 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.607057 25021 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.552039 25277 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.609493 25277 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:39.611555 22188 leader_election.cc:336] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.612157 22188 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:39.552282 25200 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.613925 25200 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.615483 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.561491 25232 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:39.616252 25232 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.618289 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:39.618944 22146 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:39.621712 25119 raft_consensus.cc:3055] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:39.622167 25119 raft_consensus.cc:740] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:39.623965 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.561780 24840 raft_consensus.cc:740] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:39.616310 22148 raft_consensus.cc:2393] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:39.707193 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:39.726293 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 176489us
I20260709 12:27:39.721093 22142 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:39.625322 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:39.720840 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 145717us
I20260709 12:27:39.688869 22222 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:39.604377 22809 rpcz_store.cc:276] 0709 12:27:38.548292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.552001 (+  3709us) service_pool.cc:224] Handling call
0709 12:27:38.571514 (+ 19513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:39.406848 (+835334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.603621 (+196773us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b54008a2fd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:39.603817 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310359936}
I20260709 12:27:39.570025 25022 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:39.528681 25324 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.746924 22185 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:39.747709 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:39.747526 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:39.749425 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:39.750788 22185 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:39.724960 25334 log.cc:927] Time spent T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:27:39.752635 22114 consensus_peers.cc:597] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.753034 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 337994us
I20260709 12:27:39.753633 25286 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:39.754153 25117 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.751345 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:39.751447 24996 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:39.755038 22807 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:39.753767 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:39.753656 21967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38180 (request call id 209) took 10375 ms. Trace:
W20260709 12:27:39.631313 25332 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 12:27:39.725402 25320 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.650s	user 0.008s	sys 0.010s
I20260709 12:27:39.767840 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:39.754973 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:39.606087 25220 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:39.758257 22810 raft_consensus.cc:2393] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:39.703209 25164 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.724805 25275 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:39.614493 25031 raft_consensus.cc:3055] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:39.625960 25213 raft_consensus.cc:3055] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:27:39.749191 25335 log.cc:927] Time spent T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:27:39.712622 24946 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:39.765269 22188 leader_election.cc:336] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.709594 25278 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.705250 25227 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.795826 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:39.768553 22216 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
W20260709 12:27:39.774097 22114 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:39.763789 25013 consensus_meta.cc:287] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 12:27:39.786765 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:39.797556 22114 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.797755 22803 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
W20260709 12:27:39.790503 22144 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.020s	sys 0.016s
I20260709 12:27:39.799587 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:39.800194 22809 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:39.743645 25246 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:39.796744 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:39.802325 22806 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:39.749434 25316 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:27:39.795125 22146 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
W20260709 12:27:39.800514 22144 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.021s	sys 0.016s
I20260709 12:27:39.779464 25031 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:39.625716 24840 consensus_queue.cc:260] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.786712 25213 raft_consensus.cc:740] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:39.628567 25119 consensus_queue.cc:260] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.792104 22802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 827) took 1382 ms. Trace:
I20260709 12:27:39.790377 25164 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.818397 25286 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.800943 25273 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:27:39.788993 25275 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.791348 25022 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:27:39.771642 25324 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.832732 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:39.835930 22221 raft_consensus.cc:2393] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:39.833149 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.820120 25021 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.843356 25031 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:39.843931 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 87908.8us
I20260709 12:27:39.844726 25031 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:39.847704 25277 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:39.848480 22807 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:39.833293 22112 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:39.852957 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 46420us
I20260709 12:27:39.760644 21967 rpcz_store.cc:276] 0709 12:27:29.551077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.551465 (+   388us) service_pool.cc:224] Handling call
0709 12:27:39.753418 (+10201953us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:35.074150 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:35.111379 (+ 37229us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:35.111426 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:27:35.111444 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:35.234823 (+123379us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:35.234908 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:35.234933 (+    25us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:27:35.236078 (+  1145us) tablet.cc:701] Row locks acquired
0709 12:27:35.236097 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:27:35.236257 (+   160us) write_op.cc:270] Start()
0709 12:27:35.236375 (+   118us) write_op.cc:276] Timestamp: P: 1783600055236203 usec, L: 0
0709 12:27:35.236398 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:27:35.237186 (+   788us) log.cc:844] Serialized 6282 byte log entry
0709 12:27:36.023579 (+786393us) op_driver.cc:464] REPLICATION: finished
0709 12:27:36.263714 (+240135us) write_op.cc:301] APPLY: starting
0709 12:27:36.286775 (+ 23061us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:36.378364 (+ 91589us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:36.384307 (+  5943us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:36.386197 (+  1890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:36.386498 (+   301us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:27:36.386545 (+    47us) write_op.cc:312] APPLY: finished
0709 12:27:36.439495 (+ 52950us) log.cc:844] Serialized 113 byte log entry
0709 12:27:36.449482 (+  9987us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:36.467424 (+ 17942us) write_op.cc:454] Released schema lock
0709 12:27:36.475345 (+  7921us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:36.516255 (+ 40910us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:36.516288 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":593321,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":210554,"apply.run_cpu_time_us":5485,"apply.run_wall_time_us":241362,"num_ops":16,"prepare.queue_time_us":441164,"prepare.run_cpu_time_us":14914,"prepare.run_wall_time_us":314928,"raft.queue_time_us":159857,"raft.run_cpu_time_us":33206,"raft.run_wall_time_us":269818,"replication_time_us":683628,"thread_start_us":598575,"threads_started":4,"wal-append.queue_time_us":273546,"wal-append.run_cpu_time_us":19519,"wal-append.run_wall_time_us":2005608}]]}
I20260709 12:27:39.855512 22801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 831) took 1175 ms. Trace:
I20260709 12:27:39.857224 22809 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
I20260709 12:27:39.858942 22146 raft_consensus.cc:1240] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:39.860399 22142 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:39.853935 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:39.863137 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 306268us
I20260709 12:27:39.801906 25227 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:39.865662 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.866740 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 68491.2us
I20260709 12:27:39.856017 22801 rpcz_store.cc:276] 0709 12:27:38.680498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.686192 (+  5694us) service_pool.cc:224] Handling call
0709 12:27:38.701046 (+ 14854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.757268 (+ 56222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.757308 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:38.786098 (+ 28790us) log.cc:844] Serialized 26 byte log entry
0709 12:27:38.880119 (+ 94021us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:38.880165 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.880240 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.704129 (+823889us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:39.855175 (+151046us) raft_consensus.cc:1685] finished
0709 12:27:39.855202 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.855432 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14389,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":1402,"spinlock_wait_cycles":12954368,"thread_start_us":77059,"threads_started":1,"wal-append.queue_time_us":235132}
I20260709 12:27:39.822717 24840 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:39.848408 25119 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:39.869367 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.875260 22142 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:39.875727 22146 raft_consensus.cc:1240] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:39.876272 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:39.869781 22114 leader_election.cc:336] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.816972 25331 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:27:39.877709 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.887274 22142 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:39.890533 22142 pending_rounds.cc:85] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 6
I20260709 12:27:39.890956 22142 pending_rounds.cc:107] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:27:39.891274 22142 raft_consensus.cc:2889] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:39.893204 20917 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:39.876308 25232 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:39.895183 25232 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:39.895576 25232 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:39.895910 25232 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:39.897802 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:39.872648 25154 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.899187 22138 tablet_service.cc:1558] Processing DeleteTablet for tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 with delete_type TABLET_DATA_TOMBSTONED (TS 67742f291ab04f8b8335d3919cf2d1f7 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51448
W20260709 12:27:39.899914 25340 log.cc:927] Time spent T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
I20260709 12:27:39.898993 25154 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:39.902299 25154 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:39.902760 25277 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.903330 25277 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.904759 25275 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:39.905432 25277 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.908470 25022 consensus_queue.cc:1048] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:39.910029 25232 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.913120 25200 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.913376 25232 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.915922 25227 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:39.889465 25138 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.919436 22146 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:39.919637 25138 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:39.888017 22114 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:39.864876 25300 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:39.921054 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:39.922205 22146 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:27:39.928248 22806 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
W20260709 12:27:39.932454 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:39.933053 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45083.7us
W20260709 12:27:39.935714 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 65167.8us
W20260709 12:27:39.950251 25342 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:27:39.936302 25228 consensus_meta.cc:287] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.892s	user 0.006s	sys 0.005s
W20260709 12:27:39.951516 25345 log.cc:927] Time spent T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:27:39.951285 25228 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.953536 25228 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.954201 25214 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.814141 22802 rpcz_store.cc:276] 0709 12:27:38.406379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.423486 (+ 17107us) service_pool.cc:224] Handling call
0709 12:27:38.424100 (+   614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.548170 (+124070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.554202 (+  6032us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:38.606778 (+ 52576us) log.cc:844] Serialized 26 byte log entry
0709 12:27:38.926331 (+319553us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:38.928027 (+  1696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.550246 (+622219us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b540076a2d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:39.550307 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.594245 (+ 43938us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:39.767434 (+173189us) raft_consensus.cc:1685] finished
0709 12:27:39.767454 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.788793 (+ 21339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17972,"raft.queue_time_us":32891,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4874,"spinlock_wait_cycles":139822336,"thread_start_us":275452,"threads_started":1,"wal-append.queue_time_us":408975}
I20260709 12:27:39.957847 25347 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:39.866348 25286 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:39.958700 25347 consensus_queue.cc:1243] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:27:39.960558 25286 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:39.932399 25300 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:39.985348 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:39.950947 25333 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.995683 22038 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:39.978812 25246 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:40.002312 22038 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:39.988440 25300 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:40.006666 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.013521 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.016608 22140 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:39.992060 25138 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.891705 25213 consensus_queue.cc:260] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.006412 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.009760 22037 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:39.994011 25251 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.017606 22809 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:40.014861 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:40.019204 22185 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:40.022583 22037 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:40.023274 22038 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:40.025637 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.026777 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:39.979585 25277 consensus_queue.cc:1059] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:27:39.990097 24946 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:27:40.030519 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:40.034045 22185 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:39.997332 25021 consensus_queue.cc:1048] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:27:40.031977 22036 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:40.037530 22114 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.017606 25347 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:40.017266 24876 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:40.043246 22114 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.049057 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.052968 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.056143 22140 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:40.057297 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:40.058063 22140 raft_consensus.cc:2393] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:40.019315 25154 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:40.059327 25286 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.053334 22214 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:40.059918 25286 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:40.061367 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.062915 25286 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:40.059803 25154 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.067097 25154 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:40.030181 25220 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:40.054332 22185 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:40.026031 24996 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:40.031266 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 239514us
I20260709 12:27:40.053447 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:40.084697 22221 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:40.070816 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.084903 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.034243 25013 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:40.088891 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.022324 25246 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.097056 22775 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:40.071717 22037 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:40.081887 22146 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
I20260709 12:27:40.099346 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.019673 25278 consensus_queue.cc:1059] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:27:40.039727 25232 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.070740 24949 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:40.043949 24675 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:40.045276 25323 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:40.003239 25333 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.033908 25251 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.031594 25200 consensus_queue.cc:1059] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:27:40.044551 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.048527 25153 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:40.102902 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:40.085420 22809 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:40.026458 25138 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.073083 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.130316 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:40.090797 25337 log.cc:927] Time spent T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.540s	user 0.001s	sys 0.002s
I20260709 12:27:40.107277 22214 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:40.111232 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.091502 25277 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:40.141597 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:40.073891 25152 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:40.104750 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 72828.7us
I20260709 12:27:40.095835 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:40.146081 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.146323 22807 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 10: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:40.112607 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.052860 25117 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:27:40.095821 25286 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:40.130741 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.152617 22141 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:40.131753 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.106168 25220 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:40.128232 24675 raft_consensus.cc:697] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:40.134200 22144 raft_consensus.cc:1240] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:40.130620 22217 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:40.139031 22775 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:40.139348 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 108951us
I20260709 12:27:40.119174 25323 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:40.173619 25323 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:40.150786 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.160238 22802 raft_consensus.cc:2368] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 9. Current term is 10.
I20260709 12:27:40.151818 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.133006 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.158802 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:40.161916 22112 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:40.182529 22805 raft_consensus.cc:2393] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:40.167032 25278 raft_consensus.cc:3055] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:40.140159 25277 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.140661 25164 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:40.145105 25268 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:40.171141 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:40.121052 24949 raft_consensus.cc:697] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 10 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:40.168774 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 85501.5us
I20260709 12:27:40.167786 25152 raft_consensus.cc:697] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:40.226783 22185 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:40.122395 24996 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.152401 25286 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.182843 22112 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:40.121817 25232 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.183913 22147 pending_rounds.cc:85] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 5
I20260709 12:27:40.247711 22147 pending_rounds.cc:107] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:27:40.248092 22147 raft_consensus.cc:2889] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:40.249543 22805 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:40.186069 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.191005 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.216064 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.252179 22216 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:40.219772 22213 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:40.219040 25277 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:40.221920 25268 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:40.222275 25352 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:40.223269 25343 log.cc:927] Time spent T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 12:27:40.224571 25363 log.cc:927] Time spent T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:27:40.228653 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:40.228181 22185 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:40.264644 22809 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:27:40.530018 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 301897us
I20260709 12:27:40.530162 25087 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:40.533099 25087 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.533568 25087 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:40.534076 25359 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
I20260709 12:27:40.452762 25152 consensus_queue.cc:237] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.525451 22221 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:40.538394 22213 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:40.539234 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.507964 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.222044 25164 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:40.449467 25372 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:40.532229 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2493) took 1064 ms. Trace:
I20260709 12:27:40.366413 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2482) took 1327 ms. Trace:
I20260709 12:27:40.465994 25246 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:40.452451 22214 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:40.501242 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:40.488299 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 349354us
I20260709 12:27:40.532473 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.549418 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.590448 22218 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:40.550076 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:40.566053 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:40.536944 25338 log.cc:927] Time spent T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:27:40.596882 22186 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:40.247259 25286 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:40.492028 25318 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:40.488286 25322 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:40.621264 22217 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:40.590145 22219 rpcz_store.cc:276] 0709 12:27:39.467637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.467774 (+   137us) service_pool.cc:224] Handling call
0709 12:27:39.468147 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:39.468542 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.468573 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:39.469107 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:27:39.742736 (+273629us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:39.742774 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.742846 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:40.531997 (+789151us) raft_consensus.cc:1685] finished
0709 12:27:40.532023 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.532165 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1225,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":273165,"threads_started":1,"wal-append.queue_time_us":521970}
I20260709 12:27:40.590983 22215 rpcz_store.cc:276] 0709 12:27:39.039128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.039302 (+   174us) service_pool.cc:224] Handling call
0709 12:27:39.050980 (+ 11678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:39.064469 (+ 13489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.064499 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:39.067181 (+  2682us) log.cc:844] Serialized 26 byte log entry
0709 12:27:39.317346 (+250165us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:39.317393 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.317472 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.991827 (+674355us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:40.312308 (+320481us) raft_consensus.cc:1685] finished
0709 12:27:40.312334 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.366315 (+ 53981us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5895,"raft.queue_time_us":6518,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":30036,"spinlock_wait_cycles":6541696,"thread_start_us":249742,"threads_started":1,"wal-append.queue_time_us":387766}
I20260709 12:27:40.521632 25333 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:40.401692 25201 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:40.617642 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:40.276289 25021 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.487803 25285 raft_consensus.cc:3055] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:40.567286 25138 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:40.208748 25278 raft_consensus.cc:740] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:40.623276 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 440378us
I20260709 12:27:40.362399 25153 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.667867 25013 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.704967 25013 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.667654 25318 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.706964 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.707625 25373 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:40.708073 25373 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:40.708184 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.708546 25373 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:40.709014 22219 raft_consensus.cc:2410] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:40.709789 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:40.378895 24675 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:40.711297 25119 consensus_meta.cc:287] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.002s
I20260709 12:27:40.710526 22219 raft_consensus.cc:2410] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:27:40.665839 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 69087.9us
I20260709 12:27:40.667172 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.692420 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:40.672272 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 171126us
I20260709 12:27:40.729332 22217 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:40.694244 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:40.730186 22216 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:40.731083 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.395267 25367 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.271757 25268 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:40.672955 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.732908 22186 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:40.664426 25322 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:40.738113 22188 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:40.745880 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 290064us
W20260709 12:27:40.704420 25354 log.cc:927] Time spent T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.547s	user 0.000s	sys 0.001s
I20260709 12:27:40.751155 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.683466 24876 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:40.701128 24840 consensus_meta.cc:287] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.826s	user 0.010s	sys 0.000s
I20260709 12:27:40.756327 22144 raft_consensus.cc:2393] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:40.683881 25285 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:40.747598 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.711169 22802 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:40.766687 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:40.668613 25246 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:40.691671 25273 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.761180 22222 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:40.762012 22219 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:40.707126 25013 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:40.747614 22188 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:40.708021 25278 consensus_queue.cc:260] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.764250 24876 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:40.764386 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.707103 25153 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.749909 25322 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:40.683601 25201 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.542488 24949 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.699440 25021 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.768404 25367 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.848690 24876 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:40.921696 25300 consensus_meta.cc:287] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.905s	user 0.006s	sys 0.003s
I20260709 12:27:40.922122 25367 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:40.849838 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 85513.4us
W20260709 12:27:40.941045 22776 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.941478 22776 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:40.942631 22776 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.943058 22776 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:40.944331 22776 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.944698 22776 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:40.908682 25358 log.cc:927] Time spent T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.506s	user 0.000s	sys 0.001s
W20260709 12:27:40.908995 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 171025us
I20260709 12:27:40.874573 25273 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:40.947539 22188 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.947960 22188 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:40.948303 25273 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:40.909693 25278 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:40.948984 22188 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:40.949929 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.950294 22188 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:40.910168 25318 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:40.959697 25318 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:40.960052 22188 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.960755 25318 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:40.845919 25087 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.962100 22037 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:40.962952 25087 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:40.914852 25383 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:40.963958 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.915242 25021 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:40.877367 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2450) took 1513 ms. Trace:
I20260709 12:27:40.879156 25246 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:40.811829 24840 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.901412 22219 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:40.966902 25268 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.968186 22219 raft_consensus.cc:1240] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:40.968894 24996 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:40.903966 25277 consensus_meta.cc:287] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
I20260709 12:27:40.845535 25119 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:40.969789 25119 raft_consensus.cc:697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:40.969650 25277 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.970782 25119 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.971964 25277 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:40.973426 24840 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:40.832381 25370 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:40.813416 25362 log.cc:927] Time spent T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.392s	user 0.000s	sys 0.000s
I20260709 12:27:40.924125 25153 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:40.849071 25386 consensus_queue.cc:1059] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:27:40.849169 22216 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:40.925374 22148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2454) took 1097 ms. Trace:
I20260709 12:27:40.931465 25373 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.932132 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.966531 22143 rpcz_store.cc:276] 0709 12:27:39.363841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.752253 (+388412us) service_pool.cc:224] Handling call
0709 12:27:39.752604 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:39.762300 (+  9696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.762328 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:39.766468 (+  4140us) log.cc:844] Serialized 26 byte log entry
0709 12:27:39.989137 (+222669us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:39.989177 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.989256 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:40.877077 (+887821us) raft_consensus.cc:1685] finished
0709 12:27:40.877102 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.877289 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2344,"raft.queue_time_us":9564,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":21918,"thread_start_us":180067,"threads_started":1,"wal-append.queue_time_us":232872}
I20260709 12:27:40.933923 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.985378 22806 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
W20260709 12:27:40.935158 25323 consensus_meta.cc:287] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.761s	user 0.005s	sys 0.006s
I20260709 12:27:40.922170 25300 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:40.912638 25286 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:40.916761 25031 consensus_meta.cc:287] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 1.072s	user 0.007s	sys 0.004s
W20260709 12:27:40.893678 20917 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:40.950924 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 826) took 1229 ms. Trace:
I20260709 12:27:40.951519 25352 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:40.952333 22776 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.847086 25232 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:40.954852 25164 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:40.955376 25273 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:40.977231 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.000312 22776 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:41.001212 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 48910.7us
W20260709 12:27:41.001816 22776 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:41.002199 22776 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:40.979331 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 246464us
W20260709 12:27:41.003530 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.979748 22114 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:40.980993 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 249208us
I20260709 12:27:40.933105 25154 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:40.813510 25357 log.cc:927] Time spent T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:27:40.982918 22148 rpcz_store.cc:276] 0709 12:27:39.828837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.838156 (+  9319us) service_pool.cc:224] Handling call
0709 12:27:39.838582 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:40.026549 (+187967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:40.026582 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:40.030886 (+  4304us) log.cc:844] Serialized 26 byte log entry
0709 12:27:40.400134 (+369248us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:40.400184 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.400262 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:40.925144 (+524882us) raft_consensus.cc:1685] finished
0709 12:27:40.925166 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.925295 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28727,"raft.queue_time_us":75653,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":444847,"threads_started":2,"wal-append.queue_time_us":631548}
I20260709 12:27:41.011438 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:40.989724 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.005697 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:41.004026 22776 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:41.008598 22185 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:41.009203 22114 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.979738 25277 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:41.010661 22037 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:40.978955 25087 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:41.013172 22804 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:40.979139 25318 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:40.995343 22808 rpcz_store.cc:276] 0709 12:27:39.721566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.721684 (+   118us) service_pool.cc:224] Handling call
0709 12:27:39.755691 (+ 34007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:39.772754 (+ 17063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.772787 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:39.789665 (+ 16878us) log.cc:844] Serialized 26 byte log entry
0709 12:27:40.023464 (+233799us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:40.023503 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.023567 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:40.950688 (+927121us) raft_consensus.cc:1685] finished
0709 12:27:40.950711 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.950852 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17892,"raft.queue_time_us":17432,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3895,"thread_start_us":207770,"threads_started":1,"wal-append.queue_time_us":317026}
I20260709 12:27:41.012646 22114 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:41.022179 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.022336 25268 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.002736 25323 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:41.023020 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.024392 25347 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:41.025458 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.026309 22810 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:41.012859 22776 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:40.999782 24996 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:41.023592 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.830948 25285 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:41.293608 22038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.011s	sys 0.014s
W20260709 12:27:41.323423 22038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.012s	sys 0.018s
I20260709 12:27:41.297477 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.326397 22218 raft_consensus.cc:2410] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:41.005107 25378 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:41.270923 24840 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.272800 25361 tablet_replica.cc:333] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:27:41.031939 25087 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.026841 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:41.031803 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:41.343170 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 319603us
I20260709 12:27:41.092881 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:41.059934 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:41.092088 25220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.016s	sys 0.025s
I20260709 12:27:41.006033 25197 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.022035 25373 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.324242 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:41.342813 22776 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:41.349022 25220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.021s	sys 0.068s
I20260709 12:27:41.360745 22776 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:41.163724 25365 log.cc:927] Time spent T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.941s	user 0.000s	sys 0.009s
I20260709 12:27:41.023473 25374 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:41.324951 25213 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:41.372431 25399 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.373061 25399 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.375413 25399 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:41.376456 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 52298.8us
I20260709 12:27:41.168448 25286 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.252626 25154 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:41.047746 25273 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:41.067138 22112 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.68:41677 timed out after 2.044s (SENT) [suppressed 107 similar messages]
W20260709 12:27:41.168210 25364 log.cc:927] Time spent T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.816s	user 0.000s	sys 0.008s
W20260709 12:27:41.328361 25360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.008s	sys 0.011s
I20260709 12:27:41.390161 22215 raft_consensus.cc:1240] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:41.237295 25371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.037s	sys 0.085s
I20260709 12:27:41.047312 25370 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:41.047529 25380 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:41.360242 22114 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:41.367686 25382 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:41.378433 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.417728 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.418895 22215 raft_consensus.cc:2410] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:41.419090 22806 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
I20260709 12:27:41.283420 25300 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.363332 25220 raft_consensus.cc:697] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:41.383844 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 316762us
W20260709 12:27:41.421046 25400 log.cc:927] Time spent T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:27:41.365486 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:41.411079 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 50884us
I20260709 12:27:41.421850 22776 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:41.422233 24876 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.415076 25154 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.423105 25031 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.423583 25031 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.424714 25154 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:41.410153 25371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.045s	sys 0.099s
I20260709 12:27:41.328073 24996 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.425906 25031 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.422793 24876 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.032246 25322 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.423520 25153 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:41.422099 22114 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:41.410881 25117 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:27:41.427587 24996 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.427815 25273 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:41.427474 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 62030us
W20260709 12:27:41.467835 22776 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:41.422830 25399 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.379191 25397 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:41.432726 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 613) took 1695 ms. Trace:
I20260709 12:27:41.439435 25324 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.439764 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51452 (request call id 1841) took 1572 ms. Trace:
I20260709 12:27:41.478114 22142 rpcz_store.cc:276] 0709 12:27:39.867498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.890043 (+ 22545us) service_pool.cc:224] Handling call
0709 12:27:39.890362 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:39.938071 (+ 47709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.938112 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:39.938608 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:27:40.110293 (+171685us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:40.110652 (+   359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.110927 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:40.485932 (+375005us) spinlock_profiling.cc:243] Waited 77.2 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:41.167822 (+681890us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b24000dddf8. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18949f9c4 00007ff18949dacb 00007ff189658dc9 00007ff189658a55 00007ff18965809d 00007ff18c28a10e 00007ff18c2a188c 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221
0709 12:27:41.439564 (+271742us) raft_consensus.cc:1685] finished
0709 12:27:41.439584 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.439708 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320719360,"thread_start_us":100486,"threads_started":1,"wal-append.queue_time_us":236681}
I20260709 12:27:41.480191 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.480954 22142 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:41.441170 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.147169 25318 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:41.409307 25360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.008s	sys 0.011s
W20260709 12:27:41.472497 25405 log.cc:927] Time spent T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:27:41.460947 22114 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:41.422098 25368 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.503748 25368 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.506328 25368 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.462762 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.474342 25348 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.507366 25348 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.507097 22143 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:41.509802 25348 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.509454 25220 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.463577 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.468294 22776 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:41.430166 25246 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:41.471575 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.455564 25378 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:41.474774 22220 rpcz_store.cc:276] 0709 12:27:39.737692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.738288 (+   596us) service_pool.cc:224] Handling call
0709 12:27:39.759699 (+ 21411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:39.783249 (+ 23550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.783284 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:39.797187 (+ 13903us) log.cc:844] Serialized 26 byte log entry
0709 12:27:40.039908 (+242721us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:40.388916 (+349008us) log.cc:844] Serialized 14 byte log entry
0709 12:27:40.389299 (+   383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.389382 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.430812 (+1041430us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b18001da400. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:27:41.432447 (+  1635us) raft_consensus.cc:1685] finished
0709 12:27:41.432542 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.432668 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100500,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":6125,"raft.queue_time_us":5764,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":16775,"spinlock_wait_cycles":9337600,"thread_start_us":533277,"threads_started":2,"wal-append.queue_time_us":338513}
I20260709 12:27:41.427551 25380 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:41.458293 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.576143 22215 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:41.512929 25318 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.584025 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:41.513998 25322 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:41.494635 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.587741 25351 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:41.518496 25087 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:41.477725 25399 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.589174 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.464803 25153 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.587797 25378 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.462927 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:41.590884 22145 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:41.589509 25368 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:41.591858 25378 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.591092 22036 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:41.583302 25273 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:41.590094 22147 raft_consensus.cc:2410] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:27:41.591773 25368 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.593269 25348 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:41.503072 22114 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:41.593271 25273 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:41.594278 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 91292.8us
I20260709 12:27:41.595021 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2463) took 1615 ms. Trace:
I20260709 12:27:41.596208 25273 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:41.595391 22141 rpcz_store.cc:276] 0709 12:27:39.980075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.159991 (+179916us) service_pool.cc:224] Handling call
0709 12:27:40.171877 (+ 11886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:40.178429 (+  6552us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:40.306970 (+128541us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.300982 (+994012us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b18004aff80. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b 00007ff18c2a5d23 00007ff18c2a623a 00007ff18c710a2a
0709 12:27:41.349656 (+ 48674us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:41.395804 (+ 46148us) log.cc:844] Serialized 26 byte log entry
0709 12:27:41.396059 (+   255us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:41.396103 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.396176 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.594750 (+198574us) raft_consensus.cc:1685] finished
0709 12:27:41.594844 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.594963 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35405,"prepare.queue_time_us":136298,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":7063,"raft.queue_time_us":128306,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":56443,"spinlock_wait_cycles":30278016,"thread_start_us":48344,"threads_started":1,"wal-append.queue_time_us":1010887}
I20260709 12:27:41.593608 25368 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:41.578708 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 110898us
I20260709 12:27:41.602746 25402 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:41.603080 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:41.603402 25402 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.603807 22036 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:41.604689 25117 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:41.605150 25117 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.605522 25117 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:41.605839 25402 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.607371 22112 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:41.608386 25399 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.608891 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:41.609186 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.609819 22215 raft_consensus.cc:2468] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:41.610791 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.611562 22215 raft_consensus.cc:2410] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:41.612448 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.612967 22215 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:41.613757 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.614533 25402 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.616638 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.616659 25386 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:41.617810 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.618479 22803 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:41.619380 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.619580 25300 consensus_queue.cc:1059] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:41.619719 25368 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.620054 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.626017 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.591543 25153 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.627331 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.628059 22220 raft_consensus.cc:2393] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:41.593937 25380 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:41.614048 25117 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.620661 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.622372 25360 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:41.636327 25117 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.638384 25323 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:41.639564 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:41.640417 22801 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:41.641688 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 2052) took 1277 ms. Trace:
I20260709 12:27:41.642201 25197 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:41.643216 25368 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.642212 22222 rpcz_store.cc:276] 0709 12:27:40.363943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.364296 (+   353us) service_pool.cc:224] Handling call
0709 12:27:41.641523 (+1277227us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b54000e83d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:41.641628 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209882496}
I20260709 12:27:41.512976 24876 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.661044 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.686791 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:41.636795 25369 log.cc:927] Time spent T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 1.414s	user 0.007s	sys 0.013s
I20260709 12:27:41.688707 22808 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:41.689023 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.692090 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.692272 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.692888 22215 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:41.687325 25347 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.708628 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.710115 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:41.712607 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.713486 22214 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:41.717962 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:41.718746 22220 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:41.720578 22214 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:41.722193 22214 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:41.724539 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:41.725385 22215 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.726467 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:41.727103 22804 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.713591 25383 raft_consensus.cc:3055] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:41.630731 22145 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:41.732160 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.733330 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:41.733883 22140 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:41.736809 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.742067 22801 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:41.743070 22803 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:41.739511 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:41.749217 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.755242 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.756225 22801 raft_consensus.cc:2368] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 9. Current term is 10.
I20260709 12:27:41.757809 22145 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:41.761860 22036 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:41.768177 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.777704 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.779136 22112 leader_election.cc:400] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 9. Current term is 10.
I20260709 12:27:41.779493 22112 leader_election.cc:403] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:41.714876 25347 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.781833 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 659) took 2069 ms. Trace:
I20260709 12:27:41.737314 25383 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:41.748162 25380 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:41.782847 22139 rpcz_store.cc:276] 0709 12:27:39.712960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.801212 (+ 88252us) service_pool.cc:224] Handling call
0709 12:27:39.801532 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:40.035825 (+234293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:40.035856 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:40.044455 (+  8599us) log.cc:844] Serialized 26 byte log entry
0709 12:27:40.127712 (+ 83257us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:40.127754 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.127828 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.636063 (+1508235us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:41.775644 (+139581us) raft_consensus.cc:1685] finished
0709 12:27:41.775666 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.781747 (+  6081us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7084,"raft.queue_time_us":7691,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5135,"spinlock_wait_cycles":305757952,"thread_start_us":293787,"threads_started":2,"wal-append.queue_time_us":165731}
I20260709 12:27:41.798836 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:41.799438 22139 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.800300 22808 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:41.802026 22036 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:41.776719 25368 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:41.788302 25300 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 9. Current term is 10.
I20260709 12:27:41.820535 22140 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:41.807564 24876 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:41.823393 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 237438us
I20260709 12:27:41.815497 25368 raft_consensus.cc:697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:41.855649 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2495) took 1314 ms. Trace:
I20260709 12:27:41.856106 22217 rpcz_store.cc:276] 0709 12:27:40.541697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.742618 (+200921us) service_pool.cc:224] Handling call
0709 12:27:40.742915 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:40.994172 (+251257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:40.994205 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:40.994249 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:40.994280 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.855358 (+861078us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54003a89d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:41.855401 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.855579 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577341312}
I20260709 12:27:41.864311 25383 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.871312 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2060) took 1207 ms. Trace:
I20260709 12:27:41.872157 22216 rpcz_store.cc:276] 0709 12:27:40.663616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.982345 (+318729us) service_pool.cc:224] Handling call
0709 12:27:40.982665 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.368027 (+385362us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:41.406319 (+ 38292us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.468282 (+ 61963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:41.468336 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:41.468386 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.870736 (+402350us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54001f5254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:41.870915 (+   179us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.871186 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38202,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":4363,"raft.queue_time_us":2661,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":20318,"spinlock_wait_cycles":885706112,"thread_start_us":61563,"threads_started":1,"wal-append.queue_time_us":211814}
I20260709 12:27:41.874477 25251 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:41.876921 22113 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Timed out: RequestConsensusVote RPC to 127.20.109.67:37787 timed out after 1.706s (SENT)
I20260709 12:27:41.877372 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:41.827934 24876 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.894683 24876 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:41.900949 25227 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:41.904768 25201 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:41.907418 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.913638 22142 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:41.915270 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.915940 22142 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:41.916786 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.917407 22142 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:41.918219 22113 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:41.919974 25227 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:41.921339 22113 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:41.922168 25227 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:41.918191 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:41.923026 22142 raft_consensus.cc:2393] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:41.926971 25228 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:41.927410 25228 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:41.927723 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.928280 25228 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.888888 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2502) took 1345 ms. Trace:
I20260709 12:27:41.929231 22219 rpcz_store.cc:276] 0709 12:27:40.543744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.968920 (+425176us) service_pool.cc:224] Handling call
0709 12:27:40.969236 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:41.069477 (+100241us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:41.069796 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.368373 (+298577us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:41.382145 (+ 13772us) log.cc:844] Serialized 26 byte log entry
0709 12:27:41.382490 (+   345us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:41.382552 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.888452 (+505900us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x7b54000893d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:41.888505 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.888555 (+    50us) raft_consensus.cc:1685] finished
0709 12:27:41.888654 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.888812 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31343,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":25021,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":33254,"spinlock_wait_cycles":229494528,"thread_start_us":293983,"threads_started":1,"wal-append.queue_time_us":406894}
I20260709 12:27:41.891610 24946 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.939088 24946 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.922567 22144 raft_consensus.cc:3055] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:41.943919 22803 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:41.944744 22804 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:41.893682 25368 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:41.923684 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.924685 22036 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:41.925467 25402 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:41.926469 22113 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:41.886673 22215 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:41.928848 22142 raft_consensus.cc:2393] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:41.942739 22144 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:41.952337 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.952550 22220 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:41.919077 22807 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:41.955338 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:41.888126 25220 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.971105 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:41.972252 22220 raft_consensus.cc:2410] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:41.958386 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:41.955377 25251 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:41.955291 25213 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:41.960767 22806 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:41.960621 25153 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:41.951540 22112 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:41.885638 22139 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:41.962105 22037 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:41.980404 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:41.983114 22215 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:27:41.984856 25361 raft_consensus.cc:2243] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:41.922567 25227 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.986258 25227 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.986949 22145 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:41.989563 22113 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:41.990747 22112 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:41.991176 22113 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:41.992956 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:41.994045 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:41.995260 20917 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:41.999076 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:41.978312 22144 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:41.993750 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:42.012359 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:42.021643 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:42.022449 22215 raft_consensus.cc:2368] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 6. Current term is 7.
I20260709 12:27:42.017266 22144 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:41.976289 24946 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:42.027546 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:42.028374 22220 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:42.029345 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:42.030051 22139 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:42.010684 25380 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:42.020957 22186 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:42.000847 25228 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:42.007261 25300 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.008234 25399 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.008527 25402 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:42.006299 25386 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:42.010903 25360 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:42.036898 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:42.012370 25213 raft_consensus.cc:697] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:42.010876 25153 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:42.049366 22143 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:42.041482 25399 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.050005 25402 raft_consensus.cc:697] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:42.051719 25420 log.cc:927] Time spent T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:27:42.059413 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:42.060420 24876 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.061244 22186 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:42.006584 25220 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.016940 24675 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:27:42.008111 25201 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 12:27:42.137108 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 75971.1us
I20260709 12:27:42.070703 22185 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:42.042999 25300 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.141105 25300 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.037823 25370 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.142776 25220 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:42.142897 25370 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.143375 25370 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.143970 25285 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:42.145398 25402 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.147835 24876 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:42.148535 25323 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:42.148969 25323 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:42.117611 25414 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:42.149359 25323 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:42.149657 25414 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.151929 25414 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:42.153295 22147 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:42.155637 25361 raft_consensus.cc:2272] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.117818 25399 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:42.162679 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 92076.1us
I20260709 12:27:42.140616 22144 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:27:42.165678 22144 pending_rounds.cc:85] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 4
I20260709 12:27:42.165977 22144 pending_rounds.cc:107] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:27:42.166229 22144 raft_consensus.cc:2889] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.138208 22186 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:42.121639 25153 raft_consensus.cc:697] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:42.155588 25347 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:42.169384 25300 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.178097 22139 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:42.164752 24675 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:42.212936 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 221830us
I20260709 12:27:42.216603 22113 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:42.189002 24675 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:42.188071 25361 ts_tablet_manager.cc:1916] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:27:42.226105 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:42.221901 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 259883us
I20260709 12:27:42.220510 22038 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.203703 25300 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:42.179833 25213 consensus_queue.cc:237] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.237140 22113 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:42.238720 22037 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:42.243791 22038 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.250025 22038 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.208045 25227 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.237658 25402 raft_consensus.cc:2764] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:27:42.238462 24675 raft_consensus.cc:697] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:42.279317 22806 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:42.265944 24840 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:42.269141 25347 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:42.269376 25228 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:42.220552 25153 consensus_queue.cc:237] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.298568 22141 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:27:42.271915 25300 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:42.274120 25368 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:42.306270 22038 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.268674 25348 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:27:42.313629 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:42.310071 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 73009.4us
I20260709 12:27:42.327170 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:42.328531 22113 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:42.340838 22038 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.307425 25370 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.343787 25370 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:42.351804 25227 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:42.307288 25117 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:27:42.326294 25423 log.cc:927] Time spent T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:27:42.320734 24840 consensus_queue.cc:1059] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:27:42.356680 24840 raft_consensus.cc:3055] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:42.357100 24840 raft_consensus.cc:740] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:42.357949 24840 consensus_queue.cc:260] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.362424 24675 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.363121 25428 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:42.350302 25214 raft_consensus.cc:2804] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:42.336910 24949 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:42.337718 25300 raft_consensus.cc:697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:42.392961 22773 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:42.396397 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 258250us
I20260709 12:27:42.381940 25214 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.402115 22775 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:42.402115 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 235207us
W20260709 12:27:42.406808 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 66050.7us
I20260709 12:27:42.409463 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.396155 24802 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:42.436314 22775 leader_election.cc:400] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 6. Current term is 7.
I20260709 12:27:42.432299 22773 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:42.436762 22775 leader_election.cc:403] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:27:42.388151 25322 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.394846 25428 raft_consensus.cc:697] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:42.397837 25214 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.398380 24840 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:42.435436 25348 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:42.466533 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:42.415308 24876 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.436121 25197 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:42.478729 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 69365.6us
I20260709 12:27:42.481750 22038 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.396725 25323 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.478961 24949 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:42.514513 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:42.481629 25197 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:42.539014 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 311970us
I20260709 12:27:42.546303 25414 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:42.510879 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.481451 25435 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:27:42.484695 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:42.553514 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 68899us
I20260709 12:27:42.554708 22038 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.519562 25383 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:42.484453 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 255647us
I20260709 12:27:42.485337 25348 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:42.543671 25197 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:42.479198 25351 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 6. Current term is 7.
W20260709 12:27:42.568248 22114 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:42.468047 25322 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.473489 25331 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:42.440043 25316 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:27:42.578634 22114 leader_election.cc:336] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:42.577529 22776 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:42.583040 22114 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:42.611433 22776 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:42.615499 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:42.546957 25414 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.557650 25277 raft_consensus.cc:3060] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:42.691053 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:42.583159 25213 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:42.560362 25227 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.557569 25431 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:42.694869 22114 raft_consensus.cc:2686] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:27:42.711550 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 271213us
W20260709 12:27:42.716326 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 137741us
W20260709 12:27:42.713927 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 277750us
I20260709 12:27:42.717661 22775 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:42.548705 25434 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.185s
I20260709 12:27:42.581588 25331 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:42.596364 25152 consensus_queue.cc:1059] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 12:27:42.713385 25351 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:42.511191 24876 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.617116 25397 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.111s
W20260709 12:27:42.739663 22038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.551164 25300 consensus_queue.cc:237] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.724290 24946 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:42.731496 25331 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:42.739312 25348 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.720083 25227 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:42.716267 25428 consensus_queue.cc:237] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.754587 25213 raft_consensus.cc:3055] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:42.727284 25431 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:42.780525 25424 log.cc:927] Time spent T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:27:42.746765 25439 consensus_queue.cc:1059] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:27:42.793391 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 215888us
W20260709 12:27:42.787269 25432 log.cc:927] Time spent T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 12:27:42.782097 25213 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:42.791277 25427 log.cc:927] Time spent T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.316s	user 0.001s	sys 0.001s
W20260709 12:27:42.800659 22776 consensus_peers.cc:597] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.750692 25351 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.784942 25382 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:42.795898 25399 consensus_meta.cc:287] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.621s	user 0.004s	sys 0.008s
W20260709 12:27:42.795172 25433 log.cc:927] Time spent T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:27:42.788393 25228 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:42.781152 25348 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.809878 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:42.792783 24946 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.809597 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:42.816026 22221 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:42.814767 22809 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:42.815439 22215 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:42.798511 25347 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.821753 22038 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:42.821460 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:42.814744 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:42.823298 22213 raft_consensus.cc:2410] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:27:42.826565 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 108976us
W20260709 12:27:42.831810 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 110733us
I20260709 12:27:42.810892 25439 consensus_queue.cc:1243] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer 67742f291ab04f8b8335d3919cf2d1f7 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:27:42.841403 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:42.861724 22776 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:42.840643 22221 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:42.832718 25397 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:42.877072 22038 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:42.813086 25399 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:42.873622 25433 log.cc:927] Time spent T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:27:42.854744 25382 raft_consensus.cc:2764] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:42.820384 25228 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:42.881815 25442 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:27:42.827425 24946 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.880411 25397 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.832883 25347 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:42.866868 25031 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:27:42.956314 25397 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:42.957031 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 87823.1us
W20260709 12:27:42.925861 22188 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:42.890266 25153 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:42.971319 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:42.928417 25414 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:43.016114 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.997236 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:43.011186 22036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.034s	sys 0.042s
I20260709 12:27:42.975087 22188 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.013684 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:42.957231 25449 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.013247 24876 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:43.048071 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 122256us
W20260709 12:27:42.999977 25406 log.cc:927] Time spent T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 1.486s	user 0.008s	sys 0.000s
W20260709 12:27:42.995723 20917 thread.cc:527] Waited for 9000ms trying to join with heartbeat (tid 22098)
W20260709 12:27:43.029592 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 195848us
I20260709 12:27:43.036226 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:43.035476 22141 raft_consensus.cc:2393] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 9: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:42.967320 25441 log.cc:927] Time spent T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.239s	user 0.000s	sys 0.007s
I20260709 12:27:43.030323 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.051069 22037 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:43.007378 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.056459 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:43.036597 22036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.035s	sys 0.047s
I20260709 12:27:43.060384 22807 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:43.060652 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 1.08027e+06us
I20260709 12:27:43.061852 22221 raft_consensus.cc:2410] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:43.004731 25213 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:43.063509 25213 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:43.062637 25220 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:43.009402 25399 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.068696 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.009640 25227 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:43.073865 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:42.963376 25450 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:43.040859 25446 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:43.081979 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:43.072073 22144 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:43.009318 25351 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:43.073107 22807 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:43.074764 22146 raft_consensus.cc:2393] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 9: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:43.055990 25434 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:43.087822 22037 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:43.001919 25431 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:43.053138 25153 raft_consensus.cc:697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:43.076074 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 178637us
I20260709 12:27:43.111197 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:43.057755 25449 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.097573 25451 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.097069 25348 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.124507 22146 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:43.106772 25152 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:43.126820 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.106504 24946 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.129881 25361 ts_tablet_manager.cc:1929] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:27:43.132332 25361 log.cc:1199] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 67742f291ab04f8b8335d3919cf2d1f7: Deleting WAL directory at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/wals/43ce66af87f04e5db12d1d3b0ed6ffd5
I20260709 12:27:43.104909 25228 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.133975 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:43.092598 25446 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.192405 22803 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:27:43.110565 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:43.134858 22037 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:43.196270 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 98147.6us
I20260709 12:27:43.177299 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:43.156922 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.213369 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:43.214311 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 80214.4us
I20260709 12:27:43.220185 22213 raft_consensus.cc:2393] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 5: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:43.157635 22220 raft_consensus.cc:1240] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:27:43.156267 25383 consensus_meta.cc:287] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 12:27:43.227829 22808 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:43.145360 25197 consensus_meta.cc:287] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.004s
I20260709 12:27:43.229938 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:43.231325 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 179774us
I20260709 12:27:43.231032 22807 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:27:43.152470 24840 consensus_meta.cc:287] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
W20260709 12:27:43.225816 22776 leader_election.cc:336] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.234257 22776 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:43.183478 25152 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:43.239621 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 180061us
I20260709 12:27:43.139690 25347 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:43.241766 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.245486 22186 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:43.248132 22188 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.248703 22188 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.226517 24946 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:43.237613 25414 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:43.269186 25214 consensus_meta.cc:287] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.000s
I20260709 12:27:43.253150 25464 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:27:43.253912 25316 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:43.273748 22148 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:27:43.274333 25152 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.161015 25397 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:43.231213 25440 consensus_queue.cc:1059] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:27:43.338637 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 91140.7us
W20260709 12:27:43.341747 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:43.284374 25467 log.cc:927] Time spent T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:27:43.286437 25322 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:43.125608 25451 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:43.290537 25422 log.cc:927] Time spent T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 1.025s	user 0.006s	sys 0.008s
I20260709 12:27:43.292338 25435 raft_consensus.cc:3055] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:43.293062 25445 raft_consensus.cc:3055] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:43.294636 25434 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:43.349859 25435 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
W20260709 12:27:43.311048 25331 consensus_meta.cc:287] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.005s
W20260709 12:27:43.311584 25380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.280s	user 0.013s	sys 0.031s
I20260709 12:27:43.350682 25451 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:43.319139 22148 pending_rounds.cc:85] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 7
I20260709 12:27:43.351328 22148 pending_rounds.cc:107] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:27:43.351644 22148 raft_consensus.cc:2889] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:43.195356 25153 consensus_queue.cc:237] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:43.236989 25197 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.355540 25446 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.356580 25197 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:43.297775 25447 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:27:43.357450 25397 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:43.331082 25453 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:43.333967 25361 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51448 (request call id 86) took 3426 ms. Trace:
I20260709 12:27:43.358752 25361 rpcz_store.cc:276] 0709 12:27:39.894526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.898882 (+  4356us) service_pool.cc:224] Handling call
0709 12:27:40.089063 (+190181us) ts_tablet_manager.cc:1151] Deleting tablet 43ce66af87f04e5db12d1d3b0ed6ffd5
0709 12:27:40.112943 (+ 23880us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:27:41.272610 (+1159667us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400224cd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70eff9 00007ff19171c482 00007ff19174d2d0 00007ff19173383d 00007ff1917337e9 00007ff191733779 00007ff191733741 00007ff19173296d 0000000000388634 0000000000388479
0709 12:27:42.359180 (+1086570us) tablet_metadata.cc:665] Metadata flushed
0709 12:27:43.129733 (+770553us) tablet_metadata.cc:665] Metadata flushed
0709 12:27:43.299254 (+169521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":652396,"spinlock_wait_cycles":444020096,"tablet-delete.queue_time_us":144790,"thread_start_us":97111,"threads_started":1}
I20260709 12:27:43.361913 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.362277 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.319911 25458 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:27:43.347663 22803 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:43.342778 22188 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.363839 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:43.362476 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:43.351227 25449 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:43.368454 22221 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:43.379654 22804 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:43.370868 22188 leader_election.cc:336] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:43.351064 25380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.013s	sys 0.031s
I20260709 12:27:43.372550 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.383652 22221 raft_consensus.cc:2468] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:43.384025 22188 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:43.384119 22776 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.319059 25214 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.348225 25461 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:43.366971 25445 raft_consensus.cc:740] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:43.392767 22776 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.400957 21955 catalog_manager.cc:5028] TS 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): tablet 43ce66af87f04e5db12d1d3b0ed6ffd5 (table test-workload [id=f1d199587aa4493fb71a378ad45a97a4]) successfully deleted
I20260709 12:27:43.373811 25453 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:27:43.336475 25316 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.416527 25214 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.416673 25316 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:43.406958 25277 consensus_meta.cc:287] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.692s	user 0.002s	sys 0.010s
I20260709 12:27:43.394071 25447 raft_consensus.cc:3055] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:43.418095 25277 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.418476 25447 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:43.367899 25473 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.419142 25473 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.419380 25447 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.420629 25447 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:43.421563 25473 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.412302 25323 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.372370 25440 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.398870 22141 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:43.394066 22775 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:43.417203 25461 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:43.400086 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:43.431241 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 58760us
I20260709 12:27:43.431628 22188 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:43.432444 22776 leader_election.cc:336] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.432895 22776 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:43.432998 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.433499 22188 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:43.435170 22188 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.435596 22188 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.350641 25331 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.386062 25380 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:43.437456 22188 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.469081 22188 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.427183 22801 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:27:43.470273 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.470727 25440 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:43.437945 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 43968.6us
I20260709 12:27:43.472347 25397 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.472884 25397 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.474869 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.476085 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:43.439071 25277 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.477221 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:43.478418 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:43.481113 24675 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:43.442726 25453 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:43.413003 25458 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:43.481930 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.443487 25197 raft_consensus.cc:2804] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:43.443683 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.477358 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:43.445781 22776 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.485860 22221 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 8: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:43.447172 25445 consensus_queue.cc:260] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.439867 25460 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.455752 22805 raft_consensus.cc:1240] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:43.457537 25331 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:43.469587 25380 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.486745 22803 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:43.483714 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:43.470305 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.510093 22188 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:43.511495 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.511605 24840 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:27:43.512984 22188 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:43.486056 22776 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.499070 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.477428 25277 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.501852 25440 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:43.504794 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:43.483582 25197 raft_consensus.cc:697] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:43.518993 25197 consensus_queue.cc:237] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.514791 25453 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.517437 25277 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:43.514557 22776 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:43.522006 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:43.522763 22802 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
I20260709 12:27:43.524506 25382 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:43.527843 22037 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:43.529454 22036 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:43.513967 22188 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.533497 22188 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.534766 25473 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:43.437664 25434 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:43.437557 25323 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:43.526934 25368 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:27:43.538769 22773 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:43.538957 22188 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.540254 22773 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:43.541436 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.541929 22188 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.539803 22036 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:43.543432 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:43.549729 22188 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:43.550328 22188 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:43.553054 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.554442 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.559341 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.565130 22221 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:43.569861 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.570676 22140 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
I20260709 12:27:43.548141 25470 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:43.566074 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:43.574534 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.575626 22148 raft_consensus.cc:2410] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:27:43.578050 22145 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:43.580026 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:43.580626 22221 raft_consensus.cc:2376] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6. Re-sending same reply.
I20260709 12:27:43.544713 25323 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:43.583376 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:43.544862 25434 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:43.596182 22141 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:43.582935 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:43.597821 22139 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:43.586200 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:43.568740 24840 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:27:43.588194 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.589661 22036 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:43.559144 25368 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:43.603684 22773 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:43.561559 25453 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.605677 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:43.607162 22221 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:43.574944 24949 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:43.567652 25152 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.548267 25449 consensus_queue.cc:1059] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:27:43.630867 22213 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:43.637742 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:43.630533 25478 log.cc:927] Time spent T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:43.634104 22215 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:27:43.609722 25214 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:43.642468 22215 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:27:43.647075 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:43.647763 22215 raft_consensus.cc:3060] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:43.656186 22221 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:43.660579 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.661777 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:43.665553 22214 raft_consensus.cc:2393] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 8: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
W20260709 12:27:43.669191 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 65581.2us
I20260709 12:27:43.606293 25368 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.670928 22139 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:43.765477 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.770573 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.670162 22773 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:43.689170 22215 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:43.771761 22221 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
W20260709 12:27:43.776906 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 106819us
I20260709 12:27:43.649883 25331 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:43.784806 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:43.770331 25368 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:43.779789 25351 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.678715 25316 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:43.864917 25494 log.cc:927] Time spent T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:27:43.791939 25331 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:43.859429 25351 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:43.902716 22773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.897068 25460 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:43.998317 22139 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:44.001675 22809 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.027s
W20260709 12:27:44.002166 22809 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.011s	sys 0.027s
I20260709 12:27:43.907537 25351 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:44.036350 25493 log.cc:927] Time spent T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:27:44.039430 25331 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:44.047305 25491 log.cc:927] Time spent T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 12:27:44.057293 20917 thread.cc:527] Waited for 10000ms trying to join with heartbeat (tid 22098)
W20260709 12:27:44.063781 25497 log.cc:927] Time spent T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 12:27:44.065958 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 794147us
W20260709 12:27:44.066799 25471 log.cc:927] Time spent T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.837s	user 0.002s	sys 0.000s
W20260709 12:27:44.071655 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:44.073062 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:44.080722 25382 consensus_meta.cc:287] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 0.556s	user 0.014s	sys 0.001s
I20260709 12:27:44.081312 25382 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:44.091612 25351 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:44.092163 25445 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:44.094132 25446 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:44.094866 25446 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.100911 24949 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:44.073217 25498 log.cc:927] Time spent T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:27:44.105089 25451 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:44.105392 25446 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:44.116185 25397 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:44.124997 25459 log.cc:927] Time spent T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.986s	user 0.004s	sys 0.000s
I20260709 12:27:44.126999 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:44.159929 25485 log.cc:927] Time spent T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.511s	user 0.002s	sys 0.000s
I20260709 12:27:44.160295 22214 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:44.128247 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:44.138010 25447 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:44.138928 25434 consensus_queue.cc:1059] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:44.163508 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2527) took 1352 ms. Trace:
I20260709 12:27:44.163903 25434 raft_consensus.cc:3055] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:44.164367 25434 raft_consensus.cc:740] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:44.165354 25434 consensus_queue.cc:260] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.163928 22218 rpcz_store.cc:276] 0709 12:27:42.811490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:42.811599 (+   109us) service_pool.cc:224] Handling call
0709 12:27:42.811933 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:42.812291 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:42.812360 (+    69us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:42.814916 (+  2556us) log.cc:844] Serialized 52 byte log entry
0709 12:27:43.052464 (+237548us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:43.078984 (+ 26520us) log.cc:844] Serialized 14 byte log entry
0709 12:27:43.296966 (+217982us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b180013e820. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff189593c0a 00007ff192cd3219 00007ff18961ba40 00007ff1896164e4 00007ff189616455 00007ff1900fe3c7 00007ff18c7109a7 00007ff18c7200bf 00007ff18c720038
0709 12:27:43.297209 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 12:27:43.297440 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:43.297517 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:44.124209 (+826692us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:44.163169 (+ 38960us) raft_consensus.cc:1685] finished
0709 12:27:44.163195 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:44.163427 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208837,"prepare.queue_time_us":237772,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":2632,"raft.queue_time_us":51487,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":24726,"spinlock_wait_cycles":22913152,"thread_start_us":178652,"threads_started":1,"wal-append.queue_time_us":287217}
I20260709 12:27:44.170987 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:44.170768 25368 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.171646 22807 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:44.173123 25368 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:44.175081 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:44.184885 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 51872.3us
I20260709 12:27:44.188043 22214 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
W20260709 12:27:44.189096 22114 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.189662 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.190483 25514 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:44.191483 22114 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.144389 25435 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.273119 25435 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:44.274523 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:44.277230 22776 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.277679 22776 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.151623 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:44.153009 22216 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:44.141585 25461 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:44.205624 25514 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:44.279832 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 88377.4us
I20260709 12:27:44.217401 22037 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:44.282318 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 65008.1us
I20260709 12:27:44.283164 24946 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:44.219313 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:44.283924 22810 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:44.217547 25117 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.285324 25117 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.289987 25117 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.227595 25434 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:44.236589 22215 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:44.245639 25444 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:44.226853 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 70577.8us
I20260709 12:27:44.248047 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:44.293120 22222 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:44.246759 22221 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:44.251719 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.261258 22147 raft_consensus.cc:1217] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Deduplicated request from leader. Original: 3.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 12:27:44.294557 22147 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:27:44.267566 22141 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:44.295823 25214 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:44.280543 25514 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.297892 25514 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:44.215777 25152 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:44.298329 25228 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:44.300446 21970 catalog_manager.cc:5697] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 5, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.301213 22036 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:44.283106 25449 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:44.292852 25444 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.302793 25117 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:44.295946 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:44.303514 24946 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.303925 24946 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:44.304406 22114 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.304675 25444 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.305328 22806 raft_consensus.cc:1217] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 12:27:44.305806 22806 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:27:44.295141 22038 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:44.269204 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.312036 25397 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:44.312641 25397 raft_consensus.cc:697] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:44.313488 25397 consensus_queue.cc:237] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.314894 22219 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:44.317386 22217 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:27:44.263098 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 78934.8us
W20260709 12:27:44.325587 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 74854.6us
I20260709 12:27:44.327216 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:44.327946 22222 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:44.328186 25446 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.328722 25446 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.329895 22213 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:27:44.330463 22213 pending_rounds.cc:85] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting all ops after (but not including) 8
I20260709 12:27:44.330816 22213 pending_rounds.cc:107] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:27:44.331120 22213 raft_consensus.cc:2889] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:44.330147 22810 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 11.
I20260709 12:27:44.332453 25446 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:44.333065 22037 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:44.334638 22221 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:44.337466 22216 raft_consensus.cc:1275] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:44.252748 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:44.344869 25368 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.345690 25368 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.348062 25368 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.348871 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.351213 22775 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:44.352150 25503 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:44.352630 25503 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:44.353032 25503 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:44.361212 25380 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:44.361574 25228 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:44.361076 25152 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:44.361979 25380 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.302413 21970 catalog_manager.cc:5697] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
W20260709 12:27:44.394623 22114 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.414041 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:44.396986 22144 raft_consensus.cc:3055] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:44.440744 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:44.385417 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:44.420492 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:44.465241 22141 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:44.398823 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:44.444108 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:44.408229 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:44.467445 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 181776us
I20260709 12:27:44.464432 22144 raft_consensus.cc:740] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:44.467772 22145 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
W20260709 12:27:44.462517 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 67950.5us
I20260709 12:27:44.475360 22148 raft_consensus.cc:3055] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:44.475896 22148 raft_consensus.cc:740] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:44.470664 22810 raft_consensus.cc:2410] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:27:44.470396 22144 consensus_queue.cc:260] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.479816 22144 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:44.472266 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:44.487080 22185 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:44.487618 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:44.476698 22148 consensus_queue.cc:260] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.493187 22148 raft_consensus.cc:3060] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:44.427497 25430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.298s	user 0.001s	sys 0.019s
I20260709 12:27:44.509707 22146 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:44.362447 25503 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.484767 25348 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.385643 25474 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.389362 25373 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.472965 25277 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.510737 22113 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.366909 25461 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:44.377617 25228 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:44.522043 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 203171us
W20260709 12:27:44.514807 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 75144.3us
W20260709 12:27:44.509809 25430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.380s	user 0.001s	sys 0.021s
W20260709 12:27:44.530025 22188 leader_election.cc:336] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.527722 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.531988 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:44.364356 25378 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.156s
I20260709 12:27:44.371973 25117 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
I20260709 12:27:44.542733 22144 raft_consensus.cc:1275] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:27:44.509269 25446 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:44.533439 22188 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.512533 25503 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:44.547017 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 46668.8us
W20260709 12:27:44.547406 22188 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.547926 22188 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:44.549166 22188 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.549605 22188 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.534260 22805 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:44.535351 22809 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:44.376941 24949 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.147s
I20260709 12:27:44.516937 25013 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.543685 22144 pending_rounds.cc:85] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 3
I20260709 12:27:44.513276 25380 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.551712 22144 pending_rounds.cc:107] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:27:44.520705 25152 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 11 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:44.536525 21970 catalog_manager.cc:5697] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 7, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 7 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:44.553706 22144 raft_consensus.cc:2889] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:44.554055 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:44.553957 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.559173 22188 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:44.555927 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 81188.7us
W20260709 12:27:44.575121 22188 leader_election.cc:336] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.575776 22188 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:44.576822 22188 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:44.577507 22188 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.577780 22188 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.578850 25440 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:44.579615 25440 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:44.581019 25368 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:44.573421 25323 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:44.582960 25380 raft_consensus.cc:2764] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:27:44.545959 25461 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.587029 25461 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.574085 25453 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:44.589571 25152 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.558557 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:44.608958 22141 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 11.
I20260709 12:27:44.521297 25348 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.553568 25446 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.530422 25373 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.556628 25275 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:44.532745 25277 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.525740 25474 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.573117 25360 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:44.543354 25228 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.608533 21970 catalog_manager.cc:5697] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 4, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:44.592958 25434 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:44.570649 25013 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.610240 22215 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:44.620779 25446 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:44.572371 25214 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 12:27:44.659418 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 107762us
I20260709 12:27:44.664577 21970 catalog_manager.cc:5697] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:44.666296 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 135694us
I20260709 12:27:44.619321 25397 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:27:44.646524 25516 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:44.672694 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 86662.9us
W20260709 12:27:44.674357 22188 leader_election.cc:336] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.674769 22188 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.619150 25533 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:27:44.677621 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 115608us
I20260709 12:27:44.640705 25531 consensus_queue.cc:1059] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:27:44.671977 21970 catalog_manager.cc:5697] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 3 to 5, term changed from 5 to 6, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to <none>, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:44.690726 25449 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:44.692708 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:44.699437 25370 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:44.706403 25348 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.629894 24946 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:44.754174 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.718932 22188 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.772064 22188 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:44.773119 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56955.4us
I20260709 12:27:44.677258 25516 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:44.727684 22216 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:44.729861 22215 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:44.699697 25528 consensus_queue.cc:1059] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:27:44.779367 22775 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:44.780117 22808 raft_consensus.cc:1240] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:44.780767 22776 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:44.784382 22776 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:44.774580 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.793361 25013 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.796712 25449 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.797298 25449 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.800179 25277 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:44.801909 25516 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.803848 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:44.789163 21970 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:44.791076 22188 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.790230 25378 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:44.829272 22806 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:44.789548 25474 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:44.787488 25536 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:44.849682 22148 raft_consensus.cc:1275] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:27:44.852654 22148 pending_rounds.cc:85] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 6
I20260709 12:27:44.852890 22148 pending_rounds.cc:107] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:27:44.842655 21970 catalog_manager.cc:5697] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:44.828397 25434 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:44.853132 22148 raft_consensus.cc:2889] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:44.880324 22801 raft_consensus.cc:1240] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:44.887085 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 208757us
I20260709 12:27:44.863651 25228 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.895386 24946 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:44.897852 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 370198us
W20260709 12:27:44.898510 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 123956us
I20260709 12:27:44.898773 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:44.902616 22805 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:44.865484 25378 raft_consensus.cc:697] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:44.910343 22036 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.870735 25373 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.891512 25370 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.922686 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.920445 22036 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:44.926684 22114 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.927237 22114 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.927284 22113 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.928721 22113 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.916543 21970 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 6, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 6 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.930330 22113 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:44.935045 22113 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.937652 22113 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:44.951263 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.952034 22114 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:44.932840 25397 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:44.933769 25516 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:44.937770 25536 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.933938 25533 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:44.933853 25514 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:44.935858 25449 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:44.933809 25373 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:44.938954 25430 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:44.961483 25538 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:44.932499 25013 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:27:44.925467 25474 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:27:44.974526 21970 catalog_manager.cc:5697] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 3, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 3 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.935330 25370 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.963421 25532 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:44.963981 25461 raft_consensus.cc:2804] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:27:44.989636 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 52170.7us
I20260709 12:27:44.962422 25397 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.000947 25397 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:45.007210 25541 log.cc:927] Time spent T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:27:44.999979 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:44.997893 22113 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:45.009876 25533 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:45.010232 22805 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
W20260709 12:27:45.011196 25540 log.cc:927] Time spent T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:45.011722 22113 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:45.013520 21970 catalog_manager.cc:5697] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 5, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.014635 25532 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.015965 22217 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:27:45.017355 25370 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:45.017396 25397 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:45.021075 25461 raft_consensus.cc:697] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:45.041925 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:45.043406 22188 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:45.043897 22188 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:45.044559 22773 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:44.990221 25378 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:44.975996 25536 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:45.057857 20917 thread.cc:527] Waited for 11000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:45.048485 25461 consensus_queue.cc:237] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:45.047905 25533 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:45.047734 25452 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:45.071084 25536 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:45.047477 22773 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:45.044516 25430 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:45.071915 25430 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:45.072321 25430 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:45.072981 25277 raft_consensus.cc:3055] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:45.073360 25449 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:45.073380 25277 raft_consensus.cc:740] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:45.076915 25277 consensus_queue.cc:260] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.078147 25277 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:45.041898 25532 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:45.044833 25474 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:27:45.050143 25397 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:45.082247 25397 raft_consensus.cc:493] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.082828 25397 raft_consensus.cc:515] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.047046 21970 catalog_manager.cc:5697] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.089811 22037 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:45.091295 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:45.088560 21970 catalog_manager.cc:5697] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 5, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.097313 22220 raft_consensus.cc:1240] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:45.099431 25534 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:45.101413 25534 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:45.101930 25534 raft_consensus.cc:697] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:45.106545 25551 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:45.107069 25551 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:45.107870 25551 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.108649 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:45.109287 22213 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:45.114259 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:45.115216 22216 raft_consensus.cc:2410] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:45.078297 25446 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.120208 25446 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:45.128051 22114 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:45.129772 25531 raft_consensus.cc:3055] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:45.130231 25531 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:45.131206 25531 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.047778 25370 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:45.132540 25531 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:45.047561 22215 raft_consensus.cc:1240] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:45.046347 22188 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:45.134210 22188 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:45.135229 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 88919us
W20260709 12:27:45.136308 22188 leader_election.cc:336] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:45.136715 22188 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:45.140290 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:45.141098 22139 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:45.108870 25551 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:45.148444 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:45.153479 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:45.154279 22221 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:45.149782 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:45.158030 22215 raft_consensus.cc:2410] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:45.137907 25534 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.175196 25440 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:45.175681 25397 leader_election.cc:290] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:45.176254 25440 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:45.181847 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:45.094734 21970 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 10 to 12, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 12 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:45.185628 22215 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:45.190042 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:45.190855 22219 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:45.206087 22213 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:45.207178 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:45.207399 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:45.207790 22213 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:45.207942 22143 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:45.208150 25440 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:45.208899 22213 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:27:45.208698 25440 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:45.207718 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:45.210165 22214 raft_consensus.cc:2393] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:45.210899 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:45.192490 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:45.206034 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:45.213277 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 288600us
I20260709 12:27:45.213927 22214 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:27:45.213155 21970 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 8, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 8 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.212713 22114 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:45.198318 22219 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:45.224577 22038 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:45.226612 22113 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:45.228603 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:45.238942 22185 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:45.257416 22221 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:45.257746 22113 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:45.259724 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 67189.8us
W20260709 12:27:45.260501 22114 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:45.261395 22114 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:45.261847 22038 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:45.256697 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:45.272562 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:45.261812 22114 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:45.277585 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 84433.4us
W20260709 12:27:45.279769 22776 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:45.280973 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 67081.5us
I20260709 12:27:45.284955 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:45.285636 22148 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:45.288277 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:45.203293 25370 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:45.204416 25504 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:45.291625 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:45.226125 25536 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:45.227144 25452 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.271214 25373 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:45.270932 25514 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:45.276087 25539 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:45.275822 25533 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:45.256696 25214 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.292063 25440 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:45.317880 22143 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 9.
I20260709 12:27:45.256994 25453 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.304085 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:45.280592 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.344017 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 63462.5us
I20260709 12:27:45.275223 25348 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:45.275431 24840 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:45.270428 25360 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:27:45.291020 25152 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.308195 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:45.369310 22142 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:27:45.329345 22188 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:45.294828 25474 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:45.334791 22148 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:45.340935 21970 catalog_manager.cc:5697] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.313324 25013 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:27:45.321689 25504 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.323622 25373 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.354969 25532 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:45.324640 25536 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:45.377566 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 107656us
I20260709 12:27:45.315651 25370 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:45.328141 25503 consensus_queue.cc:1048] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:27:45.327692 25452 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:45.425062 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 152641us
I20260709 12:27:45.345809 25214 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.471376 22144 raft_consensus.cc:2393] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:45.415616 25373 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:45.485419 21970 catalog_manager.cc:5697] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:45.492337 21970 catalog_manager.cc:5697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 4, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
W20260709 12:27:45.495011 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 216249us
I20260709 12:27:45.496501 22808 raft_consensus.cc:3060] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:45.413551 22142 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:45.332897 25447 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:45.349493 25348 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.420614 22185 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:45.378965 25152 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.352778 25453 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:45.514935 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 94416.8us
I20260709 12:27:45.517150 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c7f71fea4a4a6d815758ecce7a83cd" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:45.519785 25556 raft_consensus.cc:2804] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:45.521708 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:45.508108 25348 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:45.535538 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 138091us
I20260709 12:27:45.548877 22808 raft_consensus.cc:2410] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:27:45.542860 21970 catalog_manager.cc:5697] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 4, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.553252 25532 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:45.559971 25447 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:45.560562 25447 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:45.561049 25430 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:45.578217 22038 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:45.588258 21970 catalog_manager.cc:5697] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 6, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 6 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.590296 22038 leader_election.cc:304] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:45.596531 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 132494us
I20260709 12:27:45.550534 25548 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.612321 25453 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:45.612546 25504 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:45.601821 21970 catalog_manager.cc:5697] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 4, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:45.596939 25117 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:45.601645 25013 raft_consensus.cc:2749] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:45.653015 22139 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:45.641570 21970 catalog_manager.cc:5697] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 4, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.675060 21970 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:27:45.649335 25277 consensus_meta.cc:287] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.005s
W20260709 12:27:45.676765 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 180940us
I20260709 12:27:45.645147 25117 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:45.686307 21970 catalog_manager.cc:5697] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.687346 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:45.608086 25548 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.676618 25214 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:45.698133 25558 log.cc:927] Time spent T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:27:45.698876 25566 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:45.699446 25566 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:45.701684 25474 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:45.702975 25152 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:45.704154 25117 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:45.705893 25548 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:45.687279 25430 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:45.692022 25536 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:45.880493 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 270353us
I20260709 12:27:45.884755 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:45.885517 22219 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:45.886387 22218 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:45.887910 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:45.902712 22114 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:45.900171 22188 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:45.908607 22188 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:45.910751 22219 raft_consensus.cc:2468] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:45.910279 22188 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:45.911597 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 202270us
I20260709 12:27:45.892222 25434 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.914799 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:45.909511 25554 log.cc:927] Time spent T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
I20260709 12:27:45.931902 22145 raft_consensus.cc:2393] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 9: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:45.899890 25566 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:45.945708 25452 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:45.973495 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 77139.7us
I20260709 12:27:45.933287 25430 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:45.937546 25536 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:45.940645 25447 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:46.052161 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 76310.7us
W20260709 12:27:46.066867 20917 thread.cc:527] Waited for 12000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:45.932888 25434 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:46.086724 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 170181us
I20260709 12:27:46.084797 22775 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:46.087433 25117 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.006836 25574 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.087908 25013 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.112350 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:46.126724 22219 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:46.113406 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:46.104679 22188 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 111 similar messages]
I20260709 12:27:46.141778 22186 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:46.055433 25430 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.143783 25013 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:46.165627 25579 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 12:27:46.166183 25373 consensus_meta.cc:287] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.005s
I20260709 12:27:46.139590 25582 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.096951 25117 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:46.164870 25556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.000s
I20260709 12:27:46.204807 25013 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.159773 25584 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.107767 25574 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.179044 25453 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:46.175134 25373 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:46.233206 25556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.009s	sys 0.001s
I20260709 12:27:46.273324 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:46.238557 25570 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.238974 25569 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:46.187525 25582 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.294168 22143 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:27:46.252226 25348 consensus_meta.cc:287] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.003s
I20260709 12:27:46.234541 25585 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:46.323374 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 181685us
W20260709 12:27:46.324887 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 190047us
I20260709 12:27:46.239228 25584 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.293633 25453 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:46.284232 25556 raft_consensus.cc:697] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:46.331636 25591 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:46.295430 25570 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:46.350742 25580 log.cc:927] Time spent T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:27:46.308286 25569 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.381276 25569 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.382164 25430 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.385052 25370 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.386368 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35998 (request call id 690) took 1205 ms. Trace:
I20260709 12:27:46.386826 22139 rpcz_store.cc:276] 0709 12:27:45.181362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.181520 (+   158us) service_pool.cc:224] Handling call
0709 12:27:46.386135 (+1204615us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400407254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:46.386291 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007817600}
I20260709 12:27:46.388440 22805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 906) took 1267 ms. Trace:
I20260709 12:27:46.388870 22805 rpcz_store.cc:276] 0709 12:27:45.120841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.121369 (+   528us) service_pool.cc:224] Handling call
0709 12:27:45.121698 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.501215 (+379517us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:45.674414 (+173199us) log.cc:844] Serialized 14 byte log entry
0709 12:27:46.188093 (+513679us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:46.216286 (+ 28193us) log.cc:844] Serialized 26 byte log entry
0709 12:27:46.216499 (+   213us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:46.216545 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.216624 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:46.388169 (+171545us) raft_consensus.cc:1685] finished
0709 12:27:46.388196 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.388369 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250113,"prepare.queue_time_us":136072,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":472795,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":44428,"thread_start_us":806344,"threads_started":4,"wal-append.queue_time_us":490129}
I20260709 12:27:46.353766 25586 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.391647 25586 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.394249 25586 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.355605 25117 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.322016 25348 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.357859 25556 consensus_queue.cc:237] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.359302 25574 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:46.340124 25434 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.378927 25582 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:46.354331 25447 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.342535 25453 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.413237 25532 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:46.415956 25570 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.364108 25584 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.370270 25591 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.422073 25430 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.424779 22139 raft_consensus.cc:1240] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:46.370745 25373 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:46.447667 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 107245us
I20260709 12:27:46.448689 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:46.450335 22141 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:46.450747 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:46.441542 25370 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.467264 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:46.472103 22775 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:46.472500 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:46.470113 25370 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.475049 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:46.475642 22140 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 11.
I20260709 12:27:46.476336 25370 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.477494 25228 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.477998 25228 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.478921 25504 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:46.479328 25504 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.479684 25504 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:46.480218 25228 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.481536 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:46.474826 25373 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.482650 25373 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.481691 25348 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:46.485934 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:46.486658 22805 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:46.489387 22113 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:46.482287 22216 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:46.502861 25453 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.499432 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:46.504462 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:46.500248 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:46.484654 25373 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.512259 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:46.507579 22775 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:46.515992 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:46.518450 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:46.523839 22186 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:46.466282 25532 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.469174 25430 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.514664 25601 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:46.527249 25453 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:46.528365 25453 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:46.530442 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:46.532949 22139 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
I20260709 12:27:46.523698 25586 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:46.528795 25453 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:46.525611 25373 raft_consensus.cc:2804] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:46.540375 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:46.535076 22036 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:46.527411 25601 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:46.543838 22140 raft_consensus.cc:2410] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:46.506860 25599 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:27:46.536586 25586 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:46.545532 25601 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:46.548792 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 804) took 1281 ms. Trace:
I20260709 12:27:46.562239 22810 rpcz_store.cc:276] 0709 12:27:45.267548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.267964 (+   416us) service_pool.cc:224] Handling call
0709 12:27:45.294893 (+ 26929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:45.430882 (+135989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:45.430919 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:45.430963 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:45.430996 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.548571 (+1117575us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54006a0254. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:46.548618 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.548736 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312187776}
I20260709 12:27:46.569804 25532 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.552811 22036 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:46.553795 25591 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.554772 25348 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:46.622632 25563 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.623365 25563 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.624385 25348 raft_consensus.cc:3060] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:46.625795 25563 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:46.601275 25397 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.562919 25586 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:46.626963 25397 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.602916 25430 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.601472 25460 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:46.611532 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:46.611817 22173 heartbeater.cc:646] Failed to heartbeat to 127.20.109.126:41439 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.109.126:41439 timed out after 15.000s (SENT)
I20260709 12:27:46.613473 25440 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.628818 25460 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.629261 25440 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.615319 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:46.546854 25576 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:46.631284 25440 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:46.634032 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 81294.8us
I20260709 12:27:46.631191 25460 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.633862 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:46.635880 25397 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.633661 25348 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:46.648164 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:46.648440 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:46.648983 22218 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 12.
I20260709 12:27:46.649734 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:46.650481 22217 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:46.651764 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:46.652637 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:46.652278 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:46.659893 22113 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:46.667964 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:46.779357 22141 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:46.661943 25228 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.665104 25608 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:46.631930 25453 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.661612 25117 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 12:27:46.661790 25347 consensus_queue.cc:1059] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:27:46.663271 25430 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:46.792578 25556 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:46.788187 25514 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.778103 25373 raft_consensus.cc:697] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:46.779837 25591 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.817916 22141 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:46.832581 22217 raft_consensus.cc:2368] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7.
I20260709 12:27:46.793413 25607 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:46.806870 25608 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:46.807822 25430 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.790102 25228 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.803186 25504 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.866181 25453 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.866410 25616 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.867071 25616 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.868657 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:46.869253 25616 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:46.869830 25616 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.862881 25591 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.873780 25591 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.833669 25596 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:46.883451 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:46.844293 25609 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.831176 25514 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.855827 25430 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:46.827939 25556 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.870313 25616 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.855474 25608 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:46.921099 22036 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:46.875166 25586 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.897660 25585 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.953372 25615 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.953608 25228 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:46.953789 22221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2566) took 1437 ms. Trace:
I20260709 12:27:46.889585 25584 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.903729 25514 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:46.949187 25117 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:46.861647 25607 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:46.959178 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 62080.6us
I20260709 12:27:46.899022 25373 consensus_queue.cc:237] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.958295 22221 rpcz_store.cc:276] 0709 12:27:45.516060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.518116 (+  2056us) service_pool.cc:224] Handling call
0709 12:27:45.518450 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.638328 (+119878us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:45.658938 (+ 20610us) log.cc:844] Serialized 14 byte log entry
0709 12:27:45.900810 (+241872us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:46.904725 (+1003915us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b2c0006c348. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18afffa11 00007ff18b00f372 00007ff18c741a01 00007ff18c70643a 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2
0709 12:27:46.905167 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:27:46.905345 (+   178us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:46.905381 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.905455 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:46.948408 (+ 42953us) raft_consensus.cc:1685] finished
0709 12:27:46.953588 (+  5180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.953730 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20410,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2236,"raft.queue_time_us":17358,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":4579,"spinlock_wait_cycles":8170240,"thread_start_us":356983,"threads_started":2,"wal-append.queue_time_us":280843}
I20260709 12:27:46.970335 22810 raft_consensus.cc:2368] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7.
I20260709 12:27:46.969700 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:46.974483 22218 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:46.902135 25601 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.983724 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58424 (request call id 2556) took 1875 ms. Trace:
I20260709 12:27:46.988082 25601 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:46.958666 25585 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:46.986644 22222 rpcz_store.cc:276] 0709 12:27:45.108601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.108725 (+   124us) service_pool.cc:224] Handling call
0709 12:27:45.136818 (+ 28093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.137202 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:45.324505 (+187303us) log.cc:844] Serialized 14 byte log entry
0709 12:27:45.726149 (+401644us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:45.880280 (+154131us) log.cc:844] Serialized 26 byte log entry
0709 12:27:45.881415 (+  1135us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:45.881456 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:45.881528 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:45.950952 (+ 69424us) raft_consensus.cc:1685] finished
0709 12:27:45.950973 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.983457 (+1032484us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b5400381dd0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:46.983638 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":279970,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":43687,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":63734656,"thread_start_us":588178,"threads_started":3,"wal-append.queue_time_us":281794,"wal-append.run_cpu_time_us":2932,"wal-append.run_wall_time_us":1340692}
I20260709 12:27:46.975942 22113 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:46.903877 25609 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:46.994424 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:46.971203 25514 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:46.886047 25596 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.982092 25117 raft_consensus.cc:697] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:47.010246 22776 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:47.013679 22776 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:46.968067 25584 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:46.962455 25615 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.042934 25584 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:47.043484 25615 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:47.047876 25607 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:47.050582 25504 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.051298 25616 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.051841 25117 consensus_queue.cc:237] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.035432 25556 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:47.017762 25586 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.019001 25618 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.055933 25618 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.019580 25601 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:47.007229 25613 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.059518 25613 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.061686 25613 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:47.021912 25596 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.032547 25609 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.034054 25348 raft_consensus.cc:3055] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:47.035531 25539 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:47.036986 25620 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:47.067524 20917 thread.cc:527] Waited for 13000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:47.075740 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2092) took 1196 ms. Trace:
I20260709 12:27:47.091142 22215 rpcz_store.cc:276] 0709 12:27:45.879813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.879940 (+   127us) service_pool.cc:224] Handling call
0709 12:27:45.880295 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:45.880684 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:45.880714 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:45.902359 (+ 21645us) log.cc:844] Serialized 52 byte log entry
0709 12:27:46.085752 (+183393us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:46.097526 (+ 11774us) log.cc:844] Serialized 14 byte log entry
0709 12:27:46.098126 (+   600us) log.cc:844] Serialized 14 byte log entry
0709 12:27:46.098415 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.098491 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:47.047065 (+948574us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b18003e5660. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:27:47.075419 (+ 28354us) raft_consensus.cc:1685] finished
0709 12:27:47.075481 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:47.075662 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33007,"prepare.queue_time_us":57866,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":11435,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":97466,"spinlock_wait_cycles":153666432,"thread_start_us":148381,"threads_started":1,"wal-append.queue_time_us":231667}
I20260709 12:27:47.088095 25576 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.054152 25608 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.120822 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.090325 25348 raft_consensus.cc:740] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:47.013273 25514 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.106877 25620 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:47.056968 25585 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.127432 25599 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:47.263979 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 270223us
I20260709 12:27:47.157838 25615 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:47.158730 25616 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:47.304447 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:47.294358 25602 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:47.259019 25620 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:47.122474 25539 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.301033 22145 raft_consensus.cc:1240] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:47.216895 25609 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:47.122759 25576 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.307890 25599 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.324626 25533 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:47.315325 25615 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:47.298825 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 223252us
I20260709 12:27:47.339990 25430 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.341528 25608 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:47.368253 25545 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:47.348403 25607 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:47.383347 25545 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.384014 25607 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.385596 25545 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.385982 25607 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.387418 25514 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.316844 25616 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:47.388515 22808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44134 (request call id 868) took 2116 ms (client timeout 1945 ms). Trace:
W20260709 12:27:47.389029 22808 rpcz_store.cc:269] 0709 12:27:45.272120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.272267 (+   147us) service_pool.cc:224] Handling call
0709 12:27:47.388280 (+2116013us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54006e0354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:47.388418 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513473920}
I20260709 12:27:47.323441 25348 consensus_queue.cc:260] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.391928 25348 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:47.395021 22809 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:27:47.395483 22809 pending_rounds.cc:85] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting all ops after (but not including) 6
I20260709 12:27:47.395704 22809 pending_rounds.cc:107] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:27:47.395912 22809 raft_consensus.cc:2889] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:47.397601 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.395038 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:47.398424 22222 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:47.399582 22807 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:47.394941 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.402220 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.314535 25602 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:47.356299 25596 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:47.413067 22806 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:47.411084 22144 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:47.416760 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.416796 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.417668 22804 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:47.424309 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:47.425674 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:47.395859 25539 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:47.442786 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:47.443624 22221 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:47.359757 25609 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.445331 22803 raft_consensus.cc:1240] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:47.446295 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.446527 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.381175 25533 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.460865 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:47.461107 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:47.460546 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.429486 25591 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:47.447533 25618 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.478181 25604 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.426218 25596 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:47.466727 25347 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:47.499330 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 75312.8us
I20260709 12:27:47.474689 25591 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:47.895458 25633 log.cc:927] Time spent T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.436s	user 0.000s	sys 0.001s
I20260709 12:27:47.826609 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2543) took 2517 ms. Trace:
I20260709 12:27:47.995707 22143 rpcz_store.cc:276] 0709 12:27:45.309492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.342456 (+ 32964us) service_pool.cc:224] Handling call
0709 12:27:45.366946 (+ 24490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:46.296912 (+929966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:47.826260 (+1529348us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400407754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:47.826517 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131861888}
I20260709 12:27:47.916656 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.001060 22139 raft_consensus.cc:2410] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:27:47.549162 22221 raft_consensus.cc:2468] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:47.506964 25604 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.139262 25596 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:48.115172 22185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.053s	sys 0.226s
I20260709 12:27:48.158123 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.098363 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:48.064740 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2548) took 1664 ms. Trace:
I20260709 12:27:48.084820 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:48.077888 22037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.007s	sys 0.030s
I20260709 12:27:48.087399 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:48.050113 22217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58436 (request call id 2102) took 1398 ms (client timeout 1619 ms). Trace:
W20260709 12:27:48.140971 22186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.023s
W20260709 12:27:48.158087 22185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.057s	sys 0.226s
I20260709 12:27:48.080752 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2547) took 1680 ms. Trace:
I20260709 12:27:48.162349 22142 rpcz_store.cc:276] 0709 12:27:46.399949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.401035 (+  1086us) service_pool.cc:224] Handling call
0709 12:27:48.079996 (+1678961us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b5800003098. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:48.080222 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:48.080420 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:48.080448 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:48.080490 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:48.080521 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:48.080578 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:48.080687 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44477696}
I20260709 12:27:47.883953 25615 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:48.161764 22186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.009s	sys 0.024s
I20260709 12:27:48.161556 22147 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:47.931619 25430 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.824661 25631 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:47.896064 25628 log.cc:927] Time spent T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.379s	user 0.000s	sys 0.000s
I20260709 12:27:48.159811 22139 raft_consensus.cc:3060] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:47.857635 25576 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:48.063716 25626 log.cc:927] Time spent T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.568s	user 0.000s	sys 0.001s
I20260709 12:27:47.537942 25585 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.635658 25613 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.167142 22773 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:48.120293 25616 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:48.166116 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 655404us
I20260709 12:27:48.092433 25533 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.159989 22144 rpcz_store.cc:276] 0709 12:27:46.400225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.401307 (+  1082us) service_pool.cc:224] Handling call
0709 12:27:46.901060 (+499753us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5800003098. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:27:46.901252 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.414184 (+512932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:48.064411 (+650227us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400058054. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:48.064654 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215352576}
I20260709 12:27:48.161367 22143 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:48.006474 25514 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:48.188779 25536 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:48.064160 25627 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:27:48.161734 22217 rpcz_store.cc:269] 0709 12:27:46.651369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.651515 (+   146us) service_pool.cc:224] Handling call
0709 12:27:48.049845 (+1398330us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540031b5d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:48.050029 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412939648}
I20260709 12:27:48.201620 22139 raft_consensus.cc:2468] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:48.110402 25556 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:47.558403 25640 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:48.046401 25602 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:47.515691 25347 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.126305 25609 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.203500 25596 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:48.160426 25644 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:27:48.215061 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.204237 22773 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:48.203749 25275 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:48.219367 25596 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:48.246062 25596 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:48.245172 25275 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.217334 25640 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:48.248411 25348 consensus_meta.cc:287] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.856s	user 0.009s	sys 0.001s
I20260709 12:27:48.249092 25275 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.217010 25556 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.249737 25640 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.213119 25571 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:48.216203 25642 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:48.210405 25613 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.214040 25627 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.252725 25640 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:48.211436 25631 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.261364 25640 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.265928 25640 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.257766 25642 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:48.091167 20917 thread.cc:527] Waited for 14000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:48.442397 25504 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:48.212188 25536 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.443712 25504 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.447158 25504 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:48.160871 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.011s	sys 0.037s
W20260709 12:27:48.299489 22036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.007s	sys 0.017s
W20260709 12:27:48.448346 22036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.007s	sys 0.017s
W20260709 12:27:48.448783 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 885019us
I20260709 12:27:48.210742 25514 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.451195 25568 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:48.451783 25568 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:48.313705 22145 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:27:48.319042 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 863433us
W20260709 12:27:48.320027 22112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.021s	sys 0.028s
W20260709 12:27:48.334741 22039 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.011s
W20260709 12:27:48.214413 22188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.009s	sys 0.041s
W20260709 12:27:48.348129 22775 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.027s
I20260709 12:27:48.448699 25613 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:48.374276 22220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 696) took 2262 ms (client timeout 1664 ms). Trace:
I20260709 12:27:48.384426 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44134 (request call id 878) took 1382 ms. Trace:
W20260709 12:27:48.386288 22810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44162 (request call id 810) took 1775 ms (client timeout 1619 ms). Trace:
I20260709 12:27:48.392270 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2561) took 1090 ms. Trace:
I20260709 12:27:48.452198 25514 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:48.268322 25620 consensus_meta.cc:287] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.932s	user 0.011s	sys 0.000s
W20260709 12:27:48.464094 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 905984us
I20260709 12:27:48.441125 25578 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:48.447778 25631 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:48.454958 22039 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.002s	sys 0.011s
W20260709 12:27:48.457224 22112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.021s	sys 0.029s
I20260709 12:27:48.256662 25591 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:48.349792 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 145558us
W20260709 12:27:48.477795 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 1.19535e+06us
W20260709 12:27:48.463143 22220 rpcz_store.cc:269] 0709 12:27:46.112003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.112915 (+   912us) service_pool.cc:224] Handling call
0709 12:27:48.373623 (+2260708us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400295754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:48.373988 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836500224}
I20260709 12:27:48.249737 25275 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.480180 25275 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.452256 25568 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:48.484555 22188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.009s	sys 0.042s
I20260709 12:27:48.486968 22217 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:27:48.463260 22809 rpcz_store.cc:276] 0709 12:27:47.001246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.001454 (+   208us) service_pool.cc:224] Handling call
0709 12:27:47.394676 (+393222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.396482 (+  1806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:48.383501 (+987019us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54006e0350. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:48.383987 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898966272}
I20260709 12:27:48.490532 25640 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:48.491163 22773 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:48.491595 25640 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.493250 25642 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.493944 25642 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.494843 25585 raft_consensus.cc:2804] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:48.495383 25640 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.495498 25585 raft_consensus.cc:697] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:48.496558 25347 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.497123 25585 consensus_queue.cc:237] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:48.469046 22775 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.003s	sys 0.027s
I20260709 12:27:48.466420 22141 rpcz_store.cc:276] 0709 12:27:47.301736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.301879 (+   143us) service_pool.cc:224] Handling call
0709 12:27:47.379359 (+ 77480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.399121 (+ 19762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:47.399193 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:47.399252 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:47.399288 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:48.391502 (+992214us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b54001392d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:48.391580 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:48.391897 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44625152}
W20260709 12:27:48.464087 22810 rpcz_store.cc:269] 0709 12:27:46.611083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.611242 (+   159us) service_pool.cc:224] Handling call
0709 12:27:48.385613 (+1774371us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54006b30d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:27:48.385939 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784805248}
I20260709 12:27:48.448825 25604 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.468667 25649 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.268370 25627 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.472832 25620 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.527196 25654 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:48.528142 25654 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.531785 22112 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:48.533473 25536 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:48.538882 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 765649us
I20260709 12:27:48.256480 25571 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.543444 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.544831 22139 raft_consensus.cc:2410] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:27:48.546418 25556 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.547489 22144 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:48.515432 25578 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.494555 25642 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.606775 25649 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:48.608688 22114 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.615088 25557 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:48.615929 25557 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.619040 25368 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:48.620064 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:48.619791 25368 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.624879 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.625247 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.625846 22220 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:48.626185 22215 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:48.622272 25368 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.635512 25574 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:48.636238 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 104690us
I20260709 12:27:48.636584 25228 consensus_queue.cc:1059] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:48.635588 25658 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.640378 25658 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:27:48.583540 25627 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:48.651216 25627 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.651913 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.652751 22219 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:48.643648 22037 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:48.655659 25117 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:48.657438 25654 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.658157 22037 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:48.645532 25503 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:48.675616 25503 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.678426 25593 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:48.678547 25503 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.679425 25593 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.647511 25649 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.649103 25563 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:48.649355 25562 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:48.649636 25556 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:48.649070 25450 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:48.659328 25599 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.644330 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.657796 25368 consensus_queue.cc:1059] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:27:48.665694 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:48.666942 25636 log.cc:927] Time spent T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.579s	user 0.002s	sys 0.003s
I20260709 12:27:48.643517 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:48.649469 25642 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.613050 25275 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.668596 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:48.669572 22140 raft_consensus.cc:1240] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:48.671952 25658 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.671973 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.738451 22213 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:48.685568 25450 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.740612 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.654455 25627 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:48.687764 25535 raft_consensus.cc:3055] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:48.682188 22037 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:48.743528 25535 raft_consensus.cc:740] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:48.744102 22217 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:48.744184 25568 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.744807 25535 consensus_queue.cc:260] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:48.675680 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 67112.3us
W20260709 12:27:48.747630 22114 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.748139 22114 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:48.748471 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.748471 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:48.751052 25649 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:48.683743 25613 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:48.752135 25613 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.752561 25613 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:48.753770 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:48.754434 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:48.746328 25535 raft_consensus.cc:3060] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:48.683341 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.687563 22216 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.693305 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.786302 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.618535 25557 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.781677 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.754621 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.802660 22143 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:48.689195 25574 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.808915 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.813066 22775 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:48.814069 25603 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:48.815601 25574 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.816566 22185 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:48.684345 25620 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.760634 25450 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.819474 25658 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:48.682525 25593 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.683128 25563 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.821376 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:48.821885 22112 leader_election.cc:400] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7.
I20260709 12:27:48.822742 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.824162 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.824698 25648 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:48.825529 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.825397 25648 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.826447 22145 raft_consensus.cc:2393] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 13: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:48.819654 22220 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:48.828552 25563 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.825341 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.830763 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.832294 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.832463 22139 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:48.818373 25574 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.831674 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.826185 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.683598 25562 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.834160 25648 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.834225 22144 raft_consensus.cc:2410] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:27:48.819227 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 137291us
I20260709 12:27:48.818394 22148 raft_consensus.cc:2393] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:48.835729 25562 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:48.836192 22037 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:48.837771 22775 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:48.839375 25503 raft_consensus.cc:2804] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:48.839908 25503 raft_consensus.cc:697] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:48.835093 25460 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:48.841655 25460 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.841632 25576 consensus_queue.cc:1059] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:48.842399 25460 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:48.844882 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.845639 22218 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:48.841027 25503 consensus_queue.cc:237] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.847118 22775 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:48.848023 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:48.855225 22809 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.848582 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:48.849830 21970 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 331) took 17603 ms (client timeout 15000 ms). Trace:
I20260709 12:27:48.850373 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:48.851325 25576 raft_consensus.cc:3055] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:48.851619 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:48.860431 22217 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:48.852186 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:48.861204 22805 raft_consensus.cc:2393] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 8: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:48.853576 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:48.822431 22112 leader_election.cc:403] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:48.855427 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 93302.2us
I20260709 12:27:48.856542 22806 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
W20260709 12:27:48.861793 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 239948us
I20260709 12:27:48.862103 22143 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
W20260709 12:27:48.883013 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 61563.3us
I20260709 12:27:48.839978 25568 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.852145 25535 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:48.908022 25574 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7.
I20260709 12:27:48.922720 25460 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.926673 21968 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 2 to 6, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 6 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.918215 25537 raft_consensus.cc:3055] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:48.931124 25537 raft_consensus.cc:740] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:48.932214 25537 consensus_queue.cc:260] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:48.930660 25571 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:48.942866 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 72745.1us
I20260709 12:27:48.936090 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.860212 25576 raft_consensus.cc:740] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:48.962755 22217 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:48.933137 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.938742 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.932435 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.935304 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.956993 22809 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 10.
I20260709 12:27:48.964795 22213 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 13.
I20260709 12:27:48.965204 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.930346 21968 catalog_manager.cc:5697] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 2 to 4, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:48.918705 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:48.980142 22217 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:48.974251 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:48.979238 22215 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:48.982082 22805 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:48.946949 25460 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:48.989156 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.987097 22218 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:48.936431 25563 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:48.991983 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.991209 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:48.931241 25347 consensus_queue.cc:1059] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:27:48.683983 25556 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:48.933396 25659 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 12:27:49.110848 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 82840.4us
I20260709 12:27:49.014453 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.992611 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:48.995460 22221 raft_consensus.cc:2368] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7.
I20260709 12:27:49.019356 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:48.976989 25537 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.134931 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.141197 22215 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:48.993956 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.039978 22213 raft_consensus.cc:2468] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:49.013408 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:48.993268 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:49.142982 21968 catalog_manager.cc:5697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 3 to 5, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 5 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.144927 22810 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
I20260709 12:27:49.154350 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.154963 22220 raft_consensus.cc:2410] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:49.052084 25578 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:49.159608 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.159685 22809 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:48.988279 25574 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.154410 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.111657 25535 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.167137 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.163537 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.165059 22221 raft_consensus.cc:2410] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:49.034754 25663 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.143893 25563 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.166018 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:49.170655 22219 raft_consensus.cc:2410] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:49.172369 22214 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.170544 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.179540 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.180967 22219 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:49.181725 22220 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:49.182312 22219 raft_consensus.cc:1240] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:49.184518 25397 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:49.185062 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.186103 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.188488 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.189069 22808 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:49.190934 25613 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.191337 22214 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:49.183800 25347 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.191768 22112 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:49.183895 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.194650 25397 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:49.196233 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.197780 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.198712 22218 raft_consensus.cc:1275] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:49.202251 22213 raft_consensus.cc:2468] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 2.
I20260709 12:27:49.203586 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2564) took 1837 ms. Trace:
I20260709 12:27:49.204380 22215 raft_consensus.cc:1240] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:49.204276 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.206476 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.245649 22221 raft_consensus.cc:1240] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:49.246975 22216 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 10.
I20260709 12:27:49.211853 22805 raft_consensus.cc:2468] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 9.
I20260709 12:27:49.207525 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.251291 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.252545 22803 raft_consensus.cc:2393] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 9: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:49.213675 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.243536 22140 rpcz_store.cc:276] 0709 12:27:47.366415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.366729 (+   314us) service_pool.cc:224] Handling call
0709 12:27:47.407706 (+ 40977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:48.790425 (+1382719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:49.203276 (+412851us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400055d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:49.203523 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805422464}
I20260709 12:27:49.253463 22147 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:49.256898 22217 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:49.255138 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 63519.2us
I20260709 12:27:49.264850 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.266443 22214 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:49.173951 25563 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.293305 22143 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:49.124301 25576 consensus_queue.cc:260] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.266773 22144 raft_consensus.cc:2393] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 9: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:49.274044 22810 raft_consensus.cc:2393] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 10: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:49.298956 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:49.302220 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 45971.5us
I20260709 12:27:49.299950 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.175334 25654 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 12:27:49.304505 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.305032 22139 raft_consensus.cc:2393] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:49.251906 25642 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:49.307387 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.266202 25649 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:49.308754 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:49.309837 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:49.310914 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.312249 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.315850 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.311836 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.317330 22216 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:49.321425 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.323048 22148 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:27:49.226104 25535 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.319169 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.322247 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.265257 25574 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.325333 22139 raft_consensus.cc:2393] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 8: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:49.329144 22143 raft_consensus.cc:2368] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 9. Current term is 10.
I20260709 12:27:49.309670 25649 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:49.254823 25347 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.311261 25620 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:48.856281 21970 rpcz_store.cc:269] 0709 12:27:31.246301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.250299 (+  3998us) service_pool.cc:224] Handling call
0709 12:27:48.849560 (+17599261us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:46.501462 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:46.529574 (+ 28112us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:46.529627 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:27:46.529645 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:46.604603 (+ 74958us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:46.604696 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:46.604726 (+    30us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:27:46.621136 (+ 16410us) tablet.cc:701] Row locks acquired
0709 12:27:46.621201 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:27:46.621484 (+   283us) write_op.cc:270] Start()
0709 12:27:46.621742 (+   258us) write_op.cc:276] Timestamp: P: 1783600066621377 usec, L: 0
0709 12:27:46.621778 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:27:46.804621 (+182843us) log.cc:844] Serialized 9435 byte log entry
0709 12:27:47.335111 (+530490us) op_driver.cc:464] REPLICATION: finished
0709 12:27:47.844559 (+509448us) write_op.cc:301] APPLY: starting
0709 12:27:47.873011 (+ 28452us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:47.873526 (+   515us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:47.873673 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:47.876231 (+  2558us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:47.876672 (+   441us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 12:27:47.876723 (+    51us) write_op.cc:312] APPLY: finished
0709 12:27:47.877272 (+   549us) log.cc:844] Serialized 164 byte log entry
0709 12:27:48.010789 (+133517us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:48.011039 (+   250us) write_op.cc:454] Released schema lock
0709 12:27:48.011140 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:48.050809 (+ 39669us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:48.050850 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5369,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":228702,"apply.run_cpu_time_us":6181,"apply.run_wall_time_us":419731,"num_ops":24,"prepare.queue_time_us":378272,"prepare.run_cpu_time_us":25548,"prepare.run_wall_time_us":465942,"raft.queue_time_us":313642,"raft.run_cpu_time_us":17111,"raft.run_wall_time_us":91714,"replication_time_us":713141,"spinlock_wait_cycles":6016,"thread_start_us":678781,"threads_started":4,"wal-append.queue_time_us":158936,"wal-append.run_cpu_time_us":13950,"wal-append.run_wall_time_us":1928136}]]}
I20260709 12:27:49.336004 22218 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:49.338864 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.267302 25663 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.338073 25649 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.358078 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:49.339775 25576 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:49.371011 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.372052 22216 raft_consensus.cc:2368] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 9. Current term is 10.
I20260709 12:27:49.374953 22037 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:49.375602 25659 consensus_queue.cc:1059] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:27:49.392581 25556 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:49.396627 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.398173 22217 raft_consensus.cc:2468] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 10.
I20260709 12:27:49.399194 22220 raft_consensus.cc:1240] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:49.399788 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 386778us
I20260709 12:27:49.351183 25620 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.392941 25659 raft_consensus.cc:3055] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:49.421890 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.423954 25659 raft_consensus.cc:740] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:49.429409 25659 consensus_queue.cc:260] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.430044 25574 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:49.430759 25659 raft_consensus.cc:3060] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:49.431898 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.433202 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:49.432862 21968 catalog_manager.cc:5697] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 3 to 5, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:49.435161 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.416116 25662 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:49.444096 20917 thread.cc:527] Waited for 15000ms trying to join with heartbeat (tid 22098)
W20260709 12:27:49.444655 25666 log.cc:927] Time spent T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:27:49.445405 25668 log.cc:927] Time spent T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 12:27:49.446856 22188 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.927s (SENT)
I20260709 12:27:49.449878 22140 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:49.363397 25397 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.455366 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:49.456578 22214 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.461373 22775 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:49.464519 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.978s (SENT)
I20260709 12:27:49.465195 22188 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:49.467473 22802 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:49.462111 21968 catalog_manager.cc:5697] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 2 to 5, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 5 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.502039 22773 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:49.499253 25648 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:49.500205 25613 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:49.500922 25503 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:49.523118 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 229421us
W20260709 12:27:49.525883 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 61414.8us
W20260709 12:27:49.526652 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 201530us
I20260709 12:27:49.527048 22112 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:49.546060 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 92344.2us
W20260709 12:27:49.557008 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 340064us
I20260709 12:27:49.558686 25503 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:49.561136 22775 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:49.536492 25578 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:49.558197 22776 leader_election.cc:336] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.632s (SENT)
I20260709 12:27:49.562716 22775 leader_election.cc:400] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 9. Current term is 10.
I20260709 12:27:49.568902 22775 leader_election.cc:403] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:49.562747 21968 catalog_manager.cc:5697] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 2 to 4, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 4 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.564446 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 709) took 1009 ms. Trace:
W20260709 12:27:49.562700 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 401499us
W20260709 12:27:49.575865 22038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.586570 22038 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:49.588582 25658 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:49.562583 25504 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:49.589635 25504 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:49.590026 25504 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.597077 25658 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:49.598851 25613 consensus_queue.cc:1059] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:49.600371 25613 raft_consensus.cc:3055] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:49.600821 25613 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:49.601851 25613 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.603976 25347 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:49.604710 25613 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.608215 22214 raft_consensus.cc:2468] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:27:49.609251 25397 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:49.570102 25535 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:49.616546 25620 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:49.567598 22186 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:49.625051 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 62467.1us
I20260709 12:27:49.624343 22185 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:49.562757 25596 consensus_meta.cc:287] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent flushing consensus metadata: real 1.205s	user 0.011s	sys 0.006s
I20260709 12:27:49.639865 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:49.639945 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:49.564453 25578 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:27:49.649122 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 174090us
I20260709 12:27:49.571460 22142 rpcz_store.cc:276] 0709 12:27:48.554453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:48.584164 (+ 29711us) service_pool.cc:224] Handling call
0709 12:27:48.658919 (+ 74755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:48.659479 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:48.659514 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:48.660121 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:27:49.052844 (+392723us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:49.273162 (+220318us) log.cc:844] Serialized 14 byte log entry
0709 12:27:49.531487 (+258325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:49.531581 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:49.563379 (+ 31798us) raft_consensus.cc:1685] finished
0709 12:27:49.563399 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:49.563534 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32486,"prepare.queue_time_us":347491,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":8482,"raft.queue_time_us":1589,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"thread_start_us":787789,"threads_started":3,"wal-append.queue_time_us":646933}
I20260709 12:27:49.668040 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:49.667687 22140 raft_consensus.cc:1240] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:49.675220 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.674932 22803 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.674973 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:49.672842 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 173897us
I20260709 12:27:49.637436 25562 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 9. Current term is 10.
I20260709 12:27:49.677227 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:49.650871 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 123900us
W20260709 12:27:49.671901 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.679759 22142 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:49.648336 25620 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:49.649626 22775 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:49.687943 22773 leader_election.cc:400] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283) with higher term. Message: Invalid argument: T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 9. Current term is 10.
I20260709 12:27:49.657537 25578 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:49.693853 25679 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:49.695145 22112 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:49.696511 25537 consensus_meta.cc:287] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.000s
I20260709 12:27:49.697139 25571 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:49.696537 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 122520us
W20260709 12:27:49.698939 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 140801us
I20260709 12:27:49.699450 25663 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:49.662117 25556 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.701509 22222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58436 (request call id 2110) took 1056 ms. Trace:
W20260709 12:27:49.713903 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.689504 25620 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:27:49.717685 22776 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Timed out: RequestConsensusVote RPC to 127.20.109.65:38979 timed out after 1.911s (SENT)
I20260709 12:27:49.734035 22776 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:49.723670 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 43836.4us
I20260709 12:27:49.716003 22803 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
W20260709 12:27:49.727890 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:49.737636 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 102427us
I20260709 12:27:49.737838 25663 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.724076 25680 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:49.738902 22775 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:49.739580 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:49.738359 25663 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.740722 25684 raft_consensus.cc:2804] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:49.741283 25684 raft_consensus.cc:697] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:49.742528 25503 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:49.742326 25684 consensus_queue.cc:237] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.717089 22185 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:49.709564 25679 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:49.744268 25679 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.745105 22185 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:49.745939 25562 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:49.746760 25571 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:49.747430 25571 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:49.742326 25663 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:49.748713 25563 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.718308 22222 rpcz_store.cc:276] 0709 12:27:48.624770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:48.625497 (+   727us) service_pool.cc:224] Handling call
0709 12:27:48.625914 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:48.626325 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:49.052597 (+426272us) log.cc:844] Serialized 14 byte log entry
0709 12:27:49.680232 (+627635us) log.cc:844] Serialized 14 byte log entry
0709 12:27:49.680497 (+   265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:49.680606 (+   109us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:49.680655 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:49.680720 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:49.680833 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":545686,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":87,"raft.queue_time_us":39593,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":303,"thread_start_us":929920,"threads_started":3,"wal-append.queue_time_us":430680}
I20260709 12:27:49.750005 22809 raft_consensus.cc:2393] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:49.720323 25620 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:49.657356 25596 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.752170 22801 raft_consensus.cc:2393] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 9: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:49.752924 25596 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:49.753469 25680 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:49.754096 22807 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:27:49.718195 25556 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.753551 22808 raft_consensus.cc:1240] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:49.756440 25556 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:49.759054 25676 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:49.759588 25676 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:49.759953 25676 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:49.728008 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.761811 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:49.762341 22037 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:49.725522 25649 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.767231 25680 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:49.728196 22114 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.778721 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 190604us
I20260709 12:27:49.775280 22114 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:49.776930 22036 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:49.784543 25537 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:49.785303 22036 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:49.786284 25613 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:49.786947 25537 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:49.787648 25537 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.787770 25613 consensus_queue.cc:1059] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:49.788496 25537 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.788861 25613 raft_consensus.cc:3055] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:49.789314 25613 raft_consensus.cc:740] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:49.790160 25613 consensus_queue.cc:260] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.791497 25613 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.799144 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:49.726161 25504 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.766502 25649 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:49.808153 22185 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:49.779034 25347 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:49.780182 25596 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:49.821043 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 92875.8us
W20260709 12:27:49.822296 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:49.827167 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 46258.1us
W20260709 12:27:49.826383 22114 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.829557 22114 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:49.828138 22775 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:49.810796 25678 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:49.812985 25537 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.833853 25679 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.835983 25537 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:49.799799 25658 consensus_queue.cc:1059] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:27:49.818555 25563 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:49.831696 25347 raft_consensus.cc:697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:49.841295 25504 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:49.802297 25397 consensus_queue.cc:1059] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:27:49.844349 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:49.858137 22219 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
W20260709 12:27:49.831466 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 180805us
W20260709 12:27:49.859719 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.849215 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:49.849769 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:49.860908 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 53141.7us
I20260709 12:27:49.860728 22143 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.831987 25576 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.870672 22219 raft_consensus.cc:1275] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:49.871042 25687 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:49.872231 25347 consensus_queue.cc:237] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.860734 25503 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:49.874257 25503 raft_consensus.cc:697] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:49.875337 25658 raft_consensus.cc:3055] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:49.875759 25658 raft_consensus.cc:740] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:49.876699 25658 consensus_queue.cc:260] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.878124 25658 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.879000 25397 raft_consensus.cc:3055] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:49.879297 25679 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:49.879834 22113 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:49.880831 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:49.881731 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.882792 25678 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:49.883194 25678 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:49.883869 25649 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:49.883625 25578 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.884344 25649 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:49.884781 25649 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:49.886111 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.888783 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:49.889731 22219 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.882345 22113 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:49.891567 22185 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:49.883558 25678 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:49.905684 22222 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:49.896111 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.907224 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 80890.6us
W20260709 12:27:49.908763 22114 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.885630 25648 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:49.885768 25397 raft_consensus.cc:740] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:49.914821 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:49.938556 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:49.919878 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 102846us
I20260709 12:27:49.907121 25679 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:49.948961 22222 raft_consensus.cc:2393] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 9: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:49.908812 25574 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:49.955965 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 47239.5us
I20260709 12:27:49.956775 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:49.959474 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 92178.6us
W20260709 12:27:49.959224 22114 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.946447 25648 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:49.970129 25648 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.976384 22114 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:49.912156 25576 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:49.875380 25503 consensus_queue.cc:237] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.991246 25397 consensus_queue.cc:260] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:49.996735 22143 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:49.997718 22113 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:49.958676 25574 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:49.947166 25562 consensus_queue.cc:1048] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:27:49.911324 25682 consensus_queue.cc:1059] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:27:50.010572 22185 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:49.987174 25687 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:50.016780 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:50.017468 25698 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:49.988873 25578 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:50.019855 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 110040us
W20260709 12:27:50.045707 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 86495.9us
W20260709 12:27:50.047848 22114 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.040992 22036 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:50.053105 22776 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.014545 25574 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:50.014966 25680 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:50.055445 25013 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:50.037380 25687 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:50.064375 22776 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.056250 25681 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:50.080120 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 105021us
W20260709 12:27:50.084018 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.085177 22776 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.086313 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.087031 25620 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:50.065267 25397 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:50.073935 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.067945 25687 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:50.091791 22776 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.067713 25013 raft_consensus.cc:697] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:50.096357 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:50.101893 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:50.094358 22114 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.097591 22219 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:50.070626 25681 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:50.105136 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 114997us
I20260709 12:27:50.073289 25695 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.108464 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:50.117007 22775 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:50.112145 22221 raft_consensus.cc:1275] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:27:50.114897 22114 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.082195 25679 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:50.116142 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 50247.9us
I20260709 12:27:50.120890 25585 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:50.118100 22114 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.100337 25576 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:50.121245 25013 consensus_queue.cc:237] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.116022 25681 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:50.136255 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:50.129230 25460 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:50.143078 22113 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:50.143985 25685 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:27:50.148455 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.158941 25692 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:27:50.139279 25704 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:50.160324 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45463.5us
W20260709 12:27:50.164382 22114 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.164861 22114 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.151485 25460 raft_consensus.cc:697] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:50.183897 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 58557us
I20260709 12:27:50.186039 22113 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:50.188469 25704 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:50.203965 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:50.195626 22185 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:50.203598 22220 raft_consensus.cc:1275] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:50.212978 22185 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:50.214078 25556 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:50.214273 25013 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.214763 25654 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.215242 22113 leader_election.cc:400] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787) with higher term. Message: Invalid argument: T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7.
W20260709 12:27:50.215834 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 51521.8us
I20260709 12:27:50.215237 25013 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.216982 25556 raft_consensus.cc:697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:50.216764 22113 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:50.218094 25556 consensus_queue.cc:237] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.222272 25013 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:50.224712 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.226464 22114 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.227008 22114 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:50.248003 22143 raft_consensus.cc:1275] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:50.210165 25620 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:50.251991 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:50.253510 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.208245 25704 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:50.257047 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:50.262415 22147 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:50.270021 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.278170 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.310068 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.318084 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.322943 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.323560 22188 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.259155 25709 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:50.329099 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.329275 22188 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.329905 22188 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.330418 22038 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:50.260038 25704 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:50.262907 25685 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:50.349521 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 236070us
W20260709 12:27:50.350556 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.363533 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 146882us
I20260709 12:27:50.243692 25460 consensus_queue.cc:237] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:50.376361 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 46003.9us
I20260709 12:27:50.384287 22038 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:50.378983 25709 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:50.379755 25720 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.380116 25556 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.380263 25576 raft_consensus.cc:2804] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:50.331857 25676 consensus_meta.cc:287] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.571s	user 0.014s	sys 0.000s
I20260709 12:27:50.385587 22038 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:50.392735 22144 raft_consensus.cc:3055] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:27:50.394156 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 64933.8us
I20260709 12:27:50.394124 22144 raft_consensus.cc:740] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
W20260709 12:27:50.400641 22188 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.401533 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:50.407502 22776 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.408030 22776 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.410564 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:50.410889 25714 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:50.411233 25708 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:50.411470 25714 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:50.393605 25576 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.412251 25576 raft_consensus.cc:3060] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:50.412559 22776 leader_election.cc:336] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.413148 25706 log.cc:927] Time spent T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 12:27:50.414033 25705 log.cc:927] Time spent T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:27:50.414846 25712 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:50.388305 25347 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:50.424022 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:50.411315 22803 raft_consensus.cc:1240] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 4. Current term is 7. Ops: []
I20260709 12:27:50.415819 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:50.423977 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:50.424777 22144 consensus_queue.cc:260] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:50.424808 25714 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:50.438545 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 53046us
I20260709 12:27:50.439585 22038 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:50.402735 25709 raft_consensus.cc:697] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:50.441044 25709 consensus_queue.cc:237] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.441512 25347 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:50.411804 25685 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.443156 22113 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:50.412505 25715 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:50.447844 20917 thread.cc:527] Waited for 16000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:50.448974 22144 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Advancing to term 7
W20260709 12:27:50.444479 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43874.7us
I20260709 12:27:50.441063 22038 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:50.467574 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 66837.5us
I20260709 12:27:50.550356 22112 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:50.455704 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.552742 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 97081.7us
W20260709 12:27:50.553365 22188 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.553686 22188 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.407094 25676 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:50.556725 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:50.562764 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 336302us
W20260709 12:27:50.564311 22114 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.447587 25715 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:50.568997 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 128043us
W20260709 12:27:50.571329 22114 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.454003 25013 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:50.576576 25710 log.cc:927] Time spent T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 12:27:50.555302 25721 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:50.581506 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:50.582926 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:50.583256 22114 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.576828 25711 log.cc:927] Time spent T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:27:50.587661 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:50.588266 22148 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:50.435647 25712 consensus_queue.cc:1048] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.137s
I20260709 12:27:50.566896 25663 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.572626 25715 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:50.595882 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 45604us
W20260709 12:27:50.599588 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 46239.9us
I20260709 12:27:50.586820 25721 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:50.598554 25725 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:50.608197 22188 leader_election.cc:336] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.601996 22114 leader_election.cc:336] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.595361 25726 consensus_queue.cc:1059] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:27:50.613058 25726 raft_consensus.cc:3055] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:50.613471 25726 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:50.597923 22773 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:50.614725 25723 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:50.615506 25013 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.604607 25721 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.618126 25585 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.622107 22114 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:50.622370 22188 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.572276 25695 consensus_queue.cc:1048] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:27:50.631705 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 44127us
I20260709 12:27:50.632807 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:50.604285 25649 consensus_meta.cc:287] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.005s
I20260709 12:27:50.596028 25662 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.640368 22144 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:50.596871 25663 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.641837 25723 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:50.668205 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 67061.5us
I20260709 12:27:50.614343 25726 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:50.621215 25576 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:50.673122 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 71174.8us
W20260709 12:27:50.670776 22188 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.677541 25013 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:50.677898 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.674467 25697 raft_consensus.cc:3055] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:50.679314 25663 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:50.660915 25681 consensus_meta.cc:287] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.002s
I20260709 12:27:50.682047 22188 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.654075 25725 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.648063 25649 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:50.687794 22114 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.689683 25687 consensus_meta.cc:287] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
W20260709 12:27:50.692348 25698 consensus_meta.cc:287] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.005s
I20260709 12:27:50.697139 25714 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:50.697764 25726 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.700104 25576 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:50.687434 25574 consensus_meta.cc:287] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.005s
W20260709 12:27:50.703583 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 70878.8us
W20260709 12:27:50.697057 25648 consensus_meta.cc:287] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.002s
I20260709 12:27:50.705096 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:50.685527 25678 consensus_meta.cc:287] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.745s	user 0.013s	sys 0.000s
W20260709 12:27:50.707787 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.710770 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:50.711167 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:50.714180 22222 raft_consensus.cc:1240] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 12:27:50.708789 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:50.687634 25697 raft_consensus.cc:740] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:50.746484 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:50.747784 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:50.749118 22214 raft_consensus.cc:2410] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:50.748157 22188 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.748478 22146 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:50.749192 22215 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:50.750352 22219 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.764780 22139 raft_consensus.cc:1240] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:50.758230 22219 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:50.763949 22185 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:50.772773 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 89831.7us
W20260709 12:27:50.773867 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:50.774503 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.775579 22114 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.715723 25717 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.714447 25723 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.707970 25698 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:50.778465 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 70708.6us
W20260709 12:27:50.790949 22188 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.763703 25571 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.720253 25676 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:50.781499 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:50.814160 22213 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 4.
I20260709 12:27:50.782399 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:50.764669 25725 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.791539 22188 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:50.776024 22114 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:50.704440 25681 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:50.722487 25574 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.745873 25648 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.827382 22141 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:50.827896 22145 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:50.806842 25723 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.761193 25678 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:50.745632 25556 consensus_queue.cc:1048] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:27:50.815423 25720 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.842011 22140 raft_consensus.cc:1240] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:50.836447 22216 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:50.825425 25576 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.843276 22221 raft_consensus.cc:2410] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:50.708770 25687 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:50.840515 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 49615.5us
W20260709 12:27:50.878777 22188 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.879220 22188 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:50.826741 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 51208.3us
I20260709 12:27:50.835448 25679 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:50.854133 25719 log.cc:927] Time spent T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:27:50.829809 25730 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.830979 25574 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:50.861171 25681 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:50.865418 22139 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:50.867563 25649 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:50.868708 25714 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:50.876498 22215 raft_consensus.cc:1275] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:50.883105 25654 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:50.967090 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.970213 25725 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:50.987413 22188 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.988627 22147 raft_consensus.cc:1240] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:50.989490 22188 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:50.989938 22114 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.971966 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.978020 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.985869 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 154611us
W20260709 12:27:50.991793 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.996847 22773 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:50.999410 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 248615us
I20260709 12:27:50.990475 22114 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:50.999897 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:51.000334 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:51.000689 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:51.003518 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.005287 22188 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:51.004664 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:50.988481 25704 consensus_meta.cc:287] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.006s
I20260709 12:27:51.009577 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:51.010185 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:51.010908 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:50.973511 25013 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.007239 22148 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:51.005615 25682 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.909864 25576 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.014922 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:51.013514 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:51.024085 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.024540 22188 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:51.004101 25460 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:51.026346 22188 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.028412 25654 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:51.028877 25556 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:51.029373 25013 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.023490 25563 consensus_queue.cc:1059] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:27:51.030938 25576 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:51.031525 22140 raft_consensus.cc:1275] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:51.035897 22188 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:51.035099 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.009819 25723 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:50.977725 25721 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:51.051590 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 44127.6us
I20260709 12:27:51.022584 25730 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:51.056497 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.015640 25704 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.056993 22188 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:51.057550 22142 raft_consensus.cc:1240] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:51.058101 22188 leader_election.cc:336] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.058862 25717 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:51.059345 25704 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:51.059491 25697 consensus_queue.cc:260] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.025367 25720 consensus_queue.cc:1059] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:27:51.060664 25697 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:51.061074 25720 raft_consensus.cc:3055] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:51.061484 25720 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:51.011899 25347 consensus_queue.cc:1059] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:27:51.004583 25535 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:27:51.058547 22188 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:51.068055 22188 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.061079 25721 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:51.068722 25723 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:51.059543 25717 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:51.070014 25648 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:51.008626 25662 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:27:51.072355 25678 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:51.012022 25659 consensus_queue.cc:1059] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:27:51.054441 25681 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:51.082767 22188 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:51.087006 25679 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:51.059254 25013 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:51.089812 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.090698 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.095297 22147 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:51.035177 25738 consensus_queue.cc:1059] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:27:51.096087 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 45442.5us
I20260709 12:27:51.124629 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:51.125342 22809 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:51.062397 25720 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:51.127482 22188 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 84 similar messages]
W20260709 12:27:51.136806 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:51.137602 22188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.139122 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:51.140858 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 56640.2us
I20260709 12:27:51.143646 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.068912 25687 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:51.152649 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 143125us
I20260709 12:27:51.173849 22809 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:51.126886 25715 consensus_meta.cc:287] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:27:51.176365 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.177623 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.130714 25684 raft_consensus.cc:3055] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:51.095718 25682 consensus_queue.cc:1048] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 12:27:51.194900 22776 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.201468 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.200052 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.074025 25681 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.208647 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.204011 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:51.213658 22216 raft_consensus.cc:2393] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 7: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:51.175397 25648 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.174342 25720 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:51.219679 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.211580 25013 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:51.220945 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 62250.9us
I20260709 12:27:51.222275 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:51.221771 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.228225 22213 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:51.226814 22808 raft_consensus.cc:1240] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:51.228730 22218 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:27:51.226888 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 206590us
I20260709 12:27:51.230472 22141 raft_consensus.cc:2393] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:51.195323 25743 raft_consensus.cc:2804] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:51.196511 25684 raft_consensus.cc:740] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:27:51.228255 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:51.199553 25596 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:51.174090 25695 consensus_queue.cc:1048] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:27:51.238427 22776 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.231361 25742 log.cc:927] Time spent T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:27:51.194376 25715 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:51.245090 22114 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.259224 22114 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.256513 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.260830 22216 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.234534 25662 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:51.238271 25743 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.275004 22143 raft_consensus.cc:1240] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:51.285584 22114 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.287115 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:51.296671 25746 consensus_queue.cc:1059] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:27:51.273056 25743 raft_consensus.cc:3060] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.298619 25746 raft_consensus.cc:3055] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:51.299366 25746 raft_consensus.cc:740] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:51.300817 25746 consensus_queue.cc:260] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.230754 25648 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:51.304711 25741 log.cc:927] Time spent T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:27:51.304814 25648 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:51.255976 25596 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.272078 22038 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:51.311658 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 259426us
I20260709 12:27:51.234719 25347 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:27:51.234025 25687 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:27:51.302320 25746 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.310410 22213 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:51.268405 25662 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.327108 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.328238 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.237768 25013 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.261808 25576 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:27:51.266726 25562 consensus_queue.cc:1059] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:27:51.329932 25662 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.330165 25596 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:51.321501 25585 consensus_queue.cc:1048] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:27:51.344015 25745 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.339735 25684 consensus_queue.cc:260] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.366979 25745 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.368153 25684 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:51.369282 25745 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:51.369972 25745 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:51.328701 25679 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:51.359793 25715 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:51.360422 25658 raft_consensus.cc:3055] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:51.364171 25013 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:51.365231 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:51.356591 25681 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:51.429483 22216 raft_consensus.cc:2468] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 10.
W20260709 12:27:51.445958 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 190786us
W20260709 12:27:51.448377 20917 thread.cc:527] Waited for 17000ms trying to join with heartbeat (tid 22098)
W20260709 12:27:51.449064 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 69653.9us
W20260709 12:27:51.475625 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:51.466137 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:51.483565 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 220780us
W20260709 12:27:51.484571 22776 leader_election.cc:336] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.471428 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 239524us
W20260709 12:27:51.486374 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:51.490935 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:51.464818 25658 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:51.495832 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.501883 22114 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:51.504806 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.505662 22114 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.474771 25679 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:51.518440 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 259041us
I20260709 12:27:51.520543 25679 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:51.520557 22038 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:51.521991 25752 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.522239 25556 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:51.522624 25752 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.523188 25750 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:51.524499 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:51.526078 25663 raft_consensus.cc:2804] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:51.526386 22038 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:51.525204 25752 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:51.529006 25576 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.530536 22038 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:51.509905 25687 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:51.532416 25750 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:51.538226 25535 raft_consensus.cc:3055] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:51.538766 25535 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:51.539656 25535 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.540861 25535 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.530887 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2612) took 1103 ms. Trace:
I20260709 12:27:51.549520 22143 rpcz_store.cc:276] 0709 12:27:50.427079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.427306 (+   227us) service_pool.cc:224] Handling call
0709 12:27:50.427636 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:51.275456 (+847820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:51.530547 (+255091us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54000c99d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:51.530793 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948411136}
I20260709 12:27:51.556254 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:51.549713 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 65166.9us
I20260709 12:27:51.557005 22222 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:51.560283 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:51.562041 22222 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:51.563189 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:51.558892 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.564550 22776 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:51.568588 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:51.565918 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:51.542291 25663 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.575958 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:51.576748 22222 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 13.
I20260709 12:27:51.577967 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:51.573388 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:51.585216 22218 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:27:51.587091 22144 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:51.530905 25658 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.570583 25692 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.593014 25692 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.595361 25692 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:51.599292 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.600682 25576 consensus_queue.cc:1059] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:51.602099 25576 raft_consensus.cc:3055] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:51.602490 25576 raft_consensus.cc:740] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:51.580341 25697 consensus_meta.cc:287] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.001s
I20260709 12:27:51.603847 22220 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:51.605633 22148 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:51.606289 22218 raft_consensus.cc:1240] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:51.608332 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 49498.5us
W20260709 12:27:51.609570 22776 leader_election.cc:336] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.610075 22776 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:51.492974 25743 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.579984 25663 raft_consensus.cc:3060] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:51.611491 25562 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:51.614006 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 62717us
W20260709 12:27:51.623798 22114 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.624450 22221 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
W20260709 12:27:51.627512 22114 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.628502 22114 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.633396 22114 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.637538 22114 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.640038 22776 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.642876 25753 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:51.648880 25596 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.649533 25596 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.650966 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:51.651672 22222 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 10.
I20260709 12:27:51.603871 25576 consensus_queue.cc:260] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.640707 22776 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:51.653842 25761 consensus_queue.cc:1059] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:51.654214 22776 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.619187 25746 consensus_queue.cc:1175] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" responder_term: 7 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:51.656529 22776 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:51.658466 22776 leader_election.cc:336] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.659739 22776 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.660815 22776 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.661835 22776 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:51.683449 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:51.684692 25684 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:51.686360 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:51.654824 25753 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:51.703388 25596 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:51.668093 25755 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:51.682169 25013 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.716763 22803 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:27:51.717602 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:51.731195 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 106886us
W20260709 12:27:51.756036 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:51.756711 22139 raft_consensus.cc:1240] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:51.769537 25754 log.cc:927] Time spent T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:27:51.716842 25013 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.771951 22140 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:51.772794 25585 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.773296 25585 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.773968 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.775005 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.775466 25585 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:51.766584 25750 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.777637 25750 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.724084 25347 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:27:51.779654 25750 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:51.773305 25013 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:51.767714 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:51.785676 22808 raft_consensus.cc:2393] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 12: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:51.788913 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:51.789222 25717 raft_consensus.cc:3055] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:51.789705 22803 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:51.791814 25702 raft_consensus.cc:3055] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:51.792261 25702 raft_consensus.cc:740] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:51.793155 22037 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:51.793332 25702 consensus_queue.cc:260] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.789155 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:51.796244 25761 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:51.796669 25761 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.797039 25761 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.809082 22218 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:27:51.810045 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.789628 25717 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:51.839800 25743 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:51.840000 25717 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.841432 25717 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:51.848536 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 45449.2us
I20260709 12:27:51.849277 25562 consensus_queue.cc:1059] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:51.829768 22112 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:51.854074 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.811805 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:51.856216 22214 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:51.860373 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.811944 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:51.834908 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:51.878479 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43637.9us
I20260709 12:27:51.855669 22142 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:51.861343 22146 raft_consensus.cc:2468] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:51.882030 22139 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:51.883034 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:51.811335 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:51.888170 22776 consensus_peers.cc:597] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:51.869764 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:51.849148 25576 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:51.889219 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:51.892336 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 59935.5us
W20260709 12:27:51.894891 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:51.895576 22776 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.850386 25562 raft_consensus.cc:3055] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:51.893687 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.899222 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:51.904084 25585 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:51.781466 25662 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:51.906508 22775 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:51.869181 25743 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.874023 25715 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:51.894556 25702 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:51.916723 21968 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46396 (request call id 331) took 20172 ms (client timeout 15000 ms). Trace:
I20260709 12:27:51.918532 22147 raft_consensus.cc:1240] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:51.912555 22036 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:51.919389 25739 log.cc:927] Time spent T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.794s	user 0.005s	sys 0.005s
I20260709 12:27:51.919981 25743 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.924044 25771 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.949579 25771 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:51.934702 22776 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.950992 25743 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:51.951707 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.952407 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:51.955448 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:51.903090 25562 raft_consensus.cc:740] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:51.907630 25585 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.901108 25613 consensus_queue.cc:1059] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:27:51.967363 25613 raft_consensus.cc:3055] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:51.967770 25613 raft_consensus.cc:740] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:51.968673 25613 consensus_queue.cc:260] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.970017 25613 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.971235 22113 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:51.971670 25771 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:51.972529 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:51.973636 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:51.974206 25687 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:51.974913 25687 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:51.976650 25658 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:51.979652 25562 consensus_queue.cc:260] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:51.981117 25562 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:51.982643 25585 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:51.917201 21968 rpcz_store.cc:269] 0709 12:27:31.744001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.808546 (+ 64545us) service_pool.cc:224] Handling call
0709 12:27:33.337956 (+1529410us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002e0090. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e20b2 00007ff19255b759 00007ff1924f3a76 00007ff1924c4d58 00007ff1925c304e 00007ff190a842a4 00007ff190a84232 00007ff190a84161 00007ff190a840dc
0709 12:27:51.916637 (+18578681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:49.851994 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:49.971965 (+119971us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:49.989376 (+ 17411us) write_op.cc:435] Acquired schema lock
0709 12:27:49.993607 (+  4231us) tablet.cc:662] Decoding operations
0709 12:27:50.089062 (+ 95455us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:50.089146 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:50.089175 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:27:50.089813 (+   638us) tablet.cc:701] Row locks acquired
0709 12:27:50.089860 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:27:50.090075 (+   215us) write_op.cc:270] Start()
0709 12:27:50.090242 (+   167us) write_op.cc:276] Timestamp: P: 1783600070089996 usec, L: 0
0709 12:27:50.090266 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:27:50.145695 (+ 55429us) log.cc:844] Serialized 2453 byte log entry
0709 12:27:50.691252 (+545557us) op_driver.cc:464] REPLICATION: finished
0709 12:27:50.850772 (+159520us) write_op.cc:301] APPLY: starting
0709 12:27:50.850893 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:50.851091 (+   198us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:50.851235 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:50.852104 (+   869us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:50.852414 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:27:50.852460 (+    46us) write_op.cc:312] APPLY: finished
0709 12:27:50.852793 (+   333us) log.cc:844] Serialized 53 byte log entry
0709 12:27:50.852994 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:50.853104 (+   110us) write_op.cc:454] Released schema lock
0709 12:27:50.853164 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:50.853672 (+   508us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:50.853703 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1488,"reported_tablets":36,"spinlock_wait_cycles":334970240,"child_traces":[["op",{"apply.queue_time_us":145545,"apply.run_cpu_time_us":2933,"apply.run_wall_time_us":12008,"num_ops":6,"prepare.queue_time_us":116604,"prepare.run_cpu_time_us":12399,"prepare.run_wall_time_us":727035,"raft.queue_time_us":110841,"raft.run_cpu_time_us":43872,"raft.run_wall_time_us":80026,"replication_time_us":600761,"spinlock_wait_cycles":2304,"thread_start_us":442858,"threads_started":4,"wal-append.queue_time_us":426891,"wal-append.run_cpu_time_us":35218,"wal-append.run_wall_time_us":1296980}]]}
I20260709 12:27:51.973770 22113 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:51.992660 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:51.993957 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.001936 25659 raft_consensus.cc:3055] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:52.002450 25659 raft_consensus.cc:740] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:52.003396 25659 consensus_queue.cc:260] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.004649 25659 raft_consensus.cc:3060] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.006963 22216 raft_consensus.cc:1275] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:52.007355 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:52.015763 22214 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
W20260709 12:27:52.019841 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 107378us
I20260709 12:27:52.036433 25744 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:52.038540 25662 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.013558 25574 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:52.014667 25687 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:52.018213 25678 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.958536 25761 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.029644 25743 raft_consensus.cc:2804] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:52.078140 25663 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:52.078424 25777 log.cc:927] Time spent T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:27:52.058784 25771 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.068205 25743 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.119565 25743 raft_consensus.cc:3060] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:52.120182 25585 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.120584 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:52.121129 22808 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.111789 25761 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.113191 25663 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.114183 25771 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.124833 25771 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.126461 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:52.129992 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 109841us
W20260709 12:27:52.130767 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:52.128750 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 81775.3us
W20260709 12:27:52.132920 22114 consensus_peers.cc:597] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:52.133363 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 120048us
I20260709 12:27:52.127477 25744 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:52.136287 22113 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.140148 25744 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:52.143818 22113 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.143042 25784 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:52.147472 25687 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:52.147652 21967 catalog_manager.cc:5697] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 7, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.149500 21967 catalog_manager.cc:5697] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 8, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 8 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:52.152062 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.152240 21967 catalog_manager.cc:5697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 6 to 9, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 9 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.153064 25663 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.153650 25663 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.154172 21967 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 4 to 7, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.157542 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:52.157886 22188 leader_election.cc:336] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.158463 22188 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.158756 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.160614 22808 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
I20260709 12:27:52.161536 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.161782 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.161913 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.162281 22213 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.162333 22216 raft_consensus.cc:2468] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:52.164242 22037 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:52.165689 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.166752 25563 consensus_queue.cc:1048] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:52.164139 25760 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.169660 25760 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.170981 25585 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.171849 25760 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.161653 25682 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:52.172021 21967 catalog_manager.cc:5697] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 5 to 6, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 6 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.187901 22218 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:52.190891 22038 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:52.201350 22213 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
W20260709 12:27:52.194456 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 50736.2us
I20260709 12:27:52.224208 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:52.225160 22808 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 12.
I20260709 12:27:52.233777 25761 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:52.234365 25761 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.234783 25761 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:52.242928 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.243636 22144 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.243794 25715 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:52.244776 22141 raft_consensus.cc:2410] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:27:52.222759 25771 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.245216 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:52.245837 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 55019.3us
I20260709 12:27:52.245815 25771 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.246897 22038 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.244680 22113 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.248131 25771 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.248268 25678 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:52.248749 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.248868 25678 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:52.249931 25678 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.250913 25784 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:52.253490 25761 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.254824 22147 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.226613 25760 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:52.171878 25663 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.258865 25746 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:52.259405 25743 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.260200 22038 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.260449 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.261008 22221 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:52.261581 25743 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.262249 25771 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:52.263736 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.178121 25744 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.265408 22801 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:52.266842 25744 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.223289 25681 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:52.268189 21967 catalog_manager.cc:5697] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.271360 22221 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
W20260709 12:27:52.268035 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:52.272716 25760 raft_consensus.cc:697] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 10 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:52.273732 25760 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.274972 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.276117 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.277521 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.277870 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:52.250329 22113 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.269940 21967 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 8 to 9, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 9 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.282845 25788 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:52.286634 22139 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:52.303063 22037 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:52.291076 22147 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
I20260709 12:27:52.283576 21967 catalog_manager.cc:5697] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 4 to 5, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.276731 22141 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 12.
W20260709 12:27:52.318557 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 68329.3us
I20260709 12:27:52.305555 21967 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 4 to 5, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:52.323205 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 43749.9us
I20260709 12:27:52.324012 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.324837 22113 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:52.329140 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:52.333910 22036 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:52.337087 25746 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:52.338145 25658 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:52.345980 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.349480 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:52.329986 22775 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:52.333073 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:52.325521 25743 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:27:52.359678 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 200082us
I20260709 12:27:52.342900 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:52.361064 22188 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.283821 25784 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:52.323824 25678 raft_consensus.cc:2804] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:52.363792 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.361510 22188 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.371119 22144 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
W20260709 12:27:52.371989 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 43603.6us
I20260709 12:27:52.374152 22038 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:52.375901 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.376959 22036 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:52.377715 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.378295 22221 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:52.379437 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 54692.2us
I20260709 12:27:52.329277 25648 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:52.342483 25697 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:52.363947 25744 raft_consensus.cc:2804] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:52.343825 25613 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:52.394510 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.345008 25761 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:52.391121 22776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.395422 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.371903 25460 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.328984 25574 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:27:52.379307 25682 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:52.395738 21967 catalog_manager.cc:5697] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.343676 25663 consensus_queue.cc:1059] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:27:52.394971 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.363618 25743 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.403617 22038 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.386898 25659 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:52.379305 25746 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:52.413267 22038 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.386291 22221 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 11.
I20260709 12:27:52.407932 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.415905 22213 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:52.395005 25678 raft_consensus.cc:697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:52.417327 25678 consensus_queue.cc:237] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.404356 25460 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.420071 25663 raft_consensus.cc:3055] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:52.420464 25663 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:52.398869 25613 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.421105 25613 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:52.396955 25648 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.421245 25663 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:52.422766 25576 consensus_queue.cc:1175] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "67742f291ab04f8b8335d3919cf2d1f7" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:52.387337 25745 raft_consensus.cc:2804] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:52.424144 25745 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.424516 25745 raft_consensus.cc:3060] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:52.390202 25787 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:27:52.405121 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:52.426782 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 51993.7us
I20260709 12:27:52.389631 25717 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:52.430781 25717 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.390828 25347 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:52.389885 25776 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:52.412949 25743 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:52.433085 21967 catalog_manager.cc:5697] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 reported cstate change: term changed from 2 to 3, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.410003 25744 raft_consensus.cc:697] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:52.422435 25663 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:52.451314 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:52.396407 25759 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:27:52.426703 25787 raft_consensus.cc:697] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:52.448832 25648 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:52.450747 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.465314 22144 raft_consensus.cc:2393] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 10: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:52.441628 22038 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.366408 25784 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:52.415632 25761 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:52.444581 25776 raft_consensus.cc:697] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 10 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:52.399869 25697 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.462648 25744 consensus_queue.cc:237] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.442670 25347 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:52.453418 22213 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
W20260709 12:27:52.475272 20917 thread.cc:527] Waited for 18000ms trying to join with heartbeat (tid 22098)
W20260709 12:27:52.471524 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:52.480687 22188 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.474000 25746 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:52.481091 22038 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:52.481142 22188 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:52.483709 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 95425.4us
I20260709 12:27:52.484839 22113 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:52.486043 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.486529 22188 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.490437 22773 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:52.491190 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.494545 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.497864 22144 raft_consensus.cc:3060] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:52.499884 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.496702 22188 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.499778 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.503062 25776 consensus_queue.cc:237] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.506630 25648 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:52.507985 25697 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:52.511305 25783 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:52.511780 25745 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.488598 25682 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:52.514097 25745 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.494699 25687 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:52.515249 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:52.507544 25787 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.517565 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:52.502343 22188 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.524161 22773 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.524367 22188 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.515343 25687 raft_consensus.cc:697] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:52.495730 25760 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:52.495949 25792 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:52.528218 22038 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.495461 25681 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.535048 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:52.542523 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:52.536149 25744 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:52.526554 25784 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.537997 25717 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.532763 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.544080 22147 raft_consensus.cc:2393] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:52.545563 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.546540 25460 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.549849 22775 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:52.549902 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:52.553596 22808 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:52.550433 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.551131 22148 raft_consensus.cc:2393] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:52.537191 22144 raft_consensus.cc:2468] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:27:52.545382 25760 raft_consensus.cc:697] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:52.543450 25682 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:52.559921 25760 consensus_queue.cc:237] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.547488 25681 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.564421 25681 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.543634 25347 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:52.566788 22139 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:27:52.571601 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:52.572471 22801 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:52.574066 22112 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:52.579902 25783 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:52.580549 25783 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:52.581490 25783 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.555250 25695 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:52.583981 22773 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:52.555130 22222 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:27:52.589570 22221 raft_consensus.cc:1240] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:52.591797 22221 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 12:27:52.595929 22186 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:52.597524 25682 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:52.597965 25682 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:52.598348 25682 raft_consensus.cc:3060] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:52.601790 25783 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:52.602245 25783 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.612362 25743 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.618763 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.619513 22216 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:52.591657 25795 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:52.602567 25783 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.639663 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.644554 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.645287 22215 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:52.615110 25784 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:52.631367 25795 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.653182 25795 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:52.654387 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.654932 22188 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.658635 25792 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.659716 25680 consensus_queue.cc:1059] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:27:52.660787 25680 raft_consensus.cc:3055] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:52.661134 25680 raft_consensus.cc:740] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:52.615433 25687 consensus_queue.cc:237] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.614585 25743 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 14 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.667994 25792 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:52.616410 25613 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.672883 25613 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 13 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.672914 25761 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.674998 25761 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.677244 25761 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.678997 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:52.679665 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.683669 25745 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.661985 25680 consensus_queue.cc:260] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.691309 22037 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:52.697530 22188 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.698451 22216 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 14.
I20260709 12:27:52.702661 22188 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.703002 22221 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:27:52.700977 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:52.704532 22038 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:52.704386 22801 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:52.678025 25783 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.647351 25562 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:52.706450 25717 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:52.706050 25562 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.708597 25562 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.709141 25783 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.711717 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.713089 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.713937 22147 raft_consensus.cc:2393] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:52.715134 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.715767 22148 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:52.715848 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.716535 22216 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:52.717594 22775 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:52.723207 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.723940 22215 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.720410 25751 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:52.729075 25751 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:52.716315 25761 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:52.684281 25745 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.719667 25743 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:52.746405 25795 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.731536 25751 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:52.743198 25347 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.750907 25347 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.753041 25795 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.747253 25743 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 14 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:52.724098 25556 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:52.754125 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.754624 25556 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.755856 22139 raft_consensus.cc:2393] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 10: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:52.748484 25717 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:52.756058 22141 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 11.
I20260709 12:27:52.756995 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:52.759214 22808 raft_consensus.cc:2393] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 10: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:27:52.758226 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.760185 22216 raft_consensus.cc:2410] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:52.764039 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:52.765654 22038 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:52.766444 22114 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:52.770404 22113 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:52.773089 22801 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 13.
I20260709 12:27:52.734521 25680 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:52.774466 22037 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:52.727519 25681 consensus_queue.cc:1059] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:27:52.753095 25347 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.775490 25784 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:52.819271 25556 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:52.819461 22215 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 10.
I20260709 12:27:52.823241 25682 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.826210 25745 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.826953 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.775199 25761 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:52.827351 22139 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:52.828347 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:52.828348 22148 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 13.
I20260709 12:27:52.830572 22775 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:52.830935 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:52.831559 22141 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:52.803848 25760 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:52.840991 25751 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.839748 25708 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:52.840296 25678 raft_consensus.cc:3055] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:52.849295 25682 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:52.851643 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:52.854019 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:52.855406 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:52.870067 22141 raft_consensus.cc:2393] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:52.856992 25745 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:52.754199 25743 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.873585 22036 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:52.876497 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.876986 22188 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:52.877838 22221 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 5.
I20260709 12:27:52.867803 25678 raft_consensus.cc:740] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:52.879345 25678 consensus_queue.cc:260] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:52.880801 25678 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:52.884181 25613 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:52.884702 25613 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.885085 25613 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:52.887188 22216 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:52.866030 25760 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 13 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:52.912674 22808 raft_consensus.cc:2468] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 6.
I20260709 12:27:52.913939 22186 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:52.916618 25717 raft_consensus.cc:2804] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:52.917174 25717 raft_consensus.cc:697] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:52.918135 25717 consensus_queue.cc:237] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.888152 25682 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:52.886515 25708 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:52.896772 25784 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 12:27:52.964623 25796 log.cc:927] Time spent T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.151s	user 0.000s	sys 0.002s
I20260709 12:27:52.967854 25708 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:52.970764 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:52.958978 25760 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:52.973201 25751 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:52.975613 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:52.976501 22148 raft_consensus.cc:2393] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:53.001295 22213 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:27:53.002386 25807 log.cc:927] Time spent T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:27:53.003029 22214 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:53.006758 25745 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:53.006982 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:53.017572 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 147303us
I20260709 12:27:53.026573 25596 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:27:53.042929 22148 raft_consensus.cc:1275] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:53.050339 22808 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:53.038390 25613 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:53.060252 25347 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:53.060626 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:53.061249 22148 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.070211 22216 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:53.078173 22215 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:53.076083 25585 consensus_queue.cc:1048] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:27:53.087637 25761 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.120224 22148 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
W20260709 12:27:53.120417 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 52315.9us
I20260709 12:27:53.076602 25784 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:27:53.130971 22036 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:53.134055 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:53.134766 22215 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.136811 22221 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:53.119647 25556 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:53.146530 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56826.3us
I20260709 12:27:53.127851 25613 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:53.153182 22222 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:53.136699 25013 raft_consensus.cc:493] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.159919 22775 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:53.140050 25682 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.180131 22221 raft_consensus.cc:1275] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:53.122812 25761 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:53.190987 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:53.144407 25743 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:53.169111 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:53.189023 22801 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:53.142818 25708 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:27:53.154062 25717 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:53.143276 25347 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:27:53.228510 22215 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:53.155051 25556 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.220041 25755 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:53.220541 25745 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.199921 25680 consensus_queue.cc:1048] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:27:53.189584 25682 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.240722 25744 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:53.263774 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 132895us
I20260709 12:27:53.270025 22148 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:53.274991 22148 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:27:53.275447 22148 pending_rounds.cc:85] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 5
I20260709 12:27:53.213507 25013 raft_consensus.cc:515] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.241014 25717 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.275678 22148 pending_rounds.cc:107] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:27:53.294731 22148 raft_consensus.cc:2889] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:53.261603 25755 raft_consensus.cc:697] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:53.282280 25776 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.315894 25761 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:53.320379 22148 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:53.302866 25746 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.336781 25746 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:53.338203 25783 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:53.339169 25746 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:53.343528 25682 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:53.345644 25761 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.333662 25755 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.303457 25695 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:53.349506 25695 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.346249 25761 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.260803 25745 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:53.281594 25744 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.352913 25761 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:53.357019 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.357774 22148 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:53.320314 25743 raft_consensus.cc:697] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:53.360064 25013 leader_election.cc:290] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:53.359598 25743 consensus_queue.cc:237] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:53.323807 25776 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:53.361892 22773 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:53.354387 25744 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:53.364539 25556 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:53.317606 25715 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.365595 25715 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.367103 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.368049 22148 raft_consensus.cc:2393] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 10: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:53.368280 25715 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:53.363086 25702 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:53.372378 25702 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.376325 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.377243 22216 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:53.372828 25702 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:53.391782 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.385842 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:53.412057 22801 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
I20260709 12:27:53.386662 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:53.413367 22803 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:53.387291 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.414369 22213 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
I20260709 12:27:53.388844 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.389073 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.416916 22214 raft_consensus.cc:2468] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 6.
I20260709 12:27:53.398095 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.417780 22217 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:53.363255 25776 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:53.458142 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.461850 22139 raft_consensus.cc:2393] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:53.354354 25745 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:53.345562 25717 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:53.381407 25695 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:53.466643 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 73999.1us
I20260709 12:27:53.480751 25776 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:53.481202 20917 thread.cc:527] Waited for 19000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:53.522924 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.535332 25776 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:53.467504 25678 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:27:53.641449 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:53.643344 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ce66af87f04e5db12d1d3b0ed6ffd5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:53.627079 25795 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.661068 25795 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.663614 25795 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:53.678341 25795 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.703279 25795 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.721167 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.722288 22148 raft_consensus.cc:2393] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 5: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:53.728896 22808 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:53.729472 25678 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.730017 25678 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:53.732226 25678 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:53.734633 22218 raft_consensus.cc:1275] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:53.737361 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.737862 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:53.737998 22218 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 4.
I20260709 12:27:53.739253 22038 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:53.746848 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.747694 22218 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:53.758984 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.771123 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.771401 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:53.771855 22141 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 10.
I20260709 12:27:53.773157 22038 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:53.759701 22148 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 7.
I20260709 12:27:53.775184 22037 leader_election.cc:304] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:53.778930 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:53.777253 22113 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:53.783814 22808 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:53.787968 22186 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:53.791365 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.796607 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:53.791796 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 52301.1us
I20260709 12:27:53.798034 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:53.799916 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:53.800643 22808 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:27:53.777135 25745 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:53.831984 22147 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:27:53.838475 22147 pending_rounds.cc:85] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 8
I20260709 12:27:53.838896 22147 pending_rounds.cc:107] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 13.9
W20260709 12:27:53.853293 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 54953.4us
I20260709 12:27:53.856005 22147 raft_consensus.cc:2889] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:53.796329 25680 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:53.802325 25829 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:53.857898 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 58632.3us
I20260709 12:27:53.858207 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:53.870018 22806 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:53.856176 22036 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:53.829512 25837 log.cc:927] Time spent T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.090s	user 0.000s	sys 0.006s
I20260709 12:27:53.792909 25788 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:53.815893 25697 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:53.853374 25745 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.856362 25746 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:53.897917 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 110059us
I20260709 12:27:53.865769 25680 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.860152 25013 raft_consensus.cc:2749] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:53.889384 25829 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.783358 25678 consensus_queue.cc:1048] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 12:27:53.905740 22186 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:53.862672 25827 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:27:53.905423 25746 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.896694 25697 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:53.914012 25697 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:53.915377 25746 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:53.905500 25680 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:53.896818 25788 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.920145 25788 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.922315 25829 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:53.807629 25702 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.837832 25819 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:27:53.904522 25745 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:53.929844 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 145881us
I20260709 12:27:53.896461 25613 raft_consensus.cc:2804] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:53.945077 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:53.949460 22221 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:53.909747 25347 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:53.951401 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 77537.8us
I20260709 12:27:53.954711 22803 raft_consensus.cc:2368] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 8. Current term is 9.
I20260709 12:27:53.957082 22147 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:53.929255 25013 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:53.929250 25792 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:53.961849 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:53.949077 25613 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.952545 25776 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:53.962564 22809 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 9.
I20260709 12:27:53.960798 25792 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:53.987879 22037 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
W20260709 12:27:53.988554 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 150043us
I20260709 12:27:53.983999 25845 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:53.960471 25717 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:27:53.956919 25347 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.983479 25613 raft_consensus.cc:3060] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:53.985265 25792 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:53.995807 25829 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:53.988883 25697 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:53.995223 25743 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:54.006022 25845 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.009384 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:54.011561 22215 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:27:54.016218 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 83998us
I20260709 12:27:54.033771 22215 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:54.032214 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 74073.5us
I20260709 12:27:54.039695 22139 raft_consensus.cc:1275] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:54.022032 25743 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:54.041929 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 185685us
I20260709 12:27:54.039616 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:54.050082 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:53.877144 25824 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.172s
I20260709 12:27:54.039104 25715 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:54.094817 25715 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.095256 25715 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:54.099623 25697 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.054284 25585 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:27:54.067847 25743 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:54.103600 25746 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.104178 25746 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.107067 25680 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.111295 22221 raft_consensus.cc:1240] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:54.089408 22186 leader_election.cc:400] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 8. Current term is 9.
I20260709 12:27:54.090760 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:54.091413 25702 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.112061 22186 leader_election.cc:403] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:54.112404 22148 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:54.120355 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:54.121160 22221 raft_consensus.cc:3060] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:27:54.128060 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.144193 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
W20260709 12:27:54.148907 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:54.114114 25853 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:54.067327 25717 consensus_queue.cc:1048] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:27:54.053676 25823 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
W20260709 12:27:54.151230 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.125201 25857 raft_consensus.cc:493] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.125422 25855 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.125450 25824 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.147276 25761 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.161351 25853 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.191937 25347 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.170524 25746 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.195263 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:54.200287 22221 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:27:54.169481 25596 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:27:54.201287 22148 raft_consensus.cc:2468] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
W20260709 12:27:54.168835 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 68342.2us
I20260709 12:27:54.167028 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:54.208292 22773 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:54.209146 25755 raft_consensus.cc:2804] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:54.209873 25755 raft_consensus.cc:697] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:54.210807 25755 consensus_queue.cc:237] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.212519 25864 consensus_queue.cc:1059] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:54.174520 25855 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.216958 25855 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.217669 25855 raft_consensus.cc:3055] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:54.218005 25855 raft_consensus.cc:740] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:54.182971 25824 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:54.221122 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 448014us
W20260709 12:27:54.221261 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:54.221998 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:54.202339 25697 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 8. Current term is 9.
I20260709 12:27:54.194037 25853 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:54.223197 22217 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:27:54.183143 25761 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:54.226812 22114 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.228353 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:54.230126 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:54.232226 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:54.233536 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:54.235172 22214 raft_consensus.cc:1275] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:54.236429 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:54.202452 25845 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:54.238451 22038 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:54.244565 22148 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:54.248143 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:54.248435 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:54.248756 22141 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:54.203137 25681 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.250221 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:54.192584 25347 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:27:54.174172 25857 raft_consensus.cc:515] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.223255 25824 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.303715 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:54.304841 22219 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:54.305158 22141 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 11.
I20260709 12:27:54.304364 22038 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:54.251463 25829 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.258481 25681 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.256196 25715 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.266676 25760 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.267884 25013 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:54.268970 25680 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.322835 22147 raft_consensus.cc:2393] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 11: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:54.323355 25760 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.323637 25745 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.325606 25760 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.325816 25745 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.315035 25788 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:54.329581 25865 log.cc:927] Time spent T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:27:54.349731 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 120566us
W20260709 12:27:54.360570 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 149131us
I20260709 12:27:54.359373 25850 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:54.366200 22219 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 11.
I20260709 12:27:54.369696 25746 raft_consensus.cc:493] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.369453 25852 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:54.318787 25827 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
W20260709 12:27:54.422675 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 151295us
I20260709 12:27:54.316622 25743 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.301892 25855 consensus_queue.cc:260] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.390765 25760 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.435634 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 154506us
I20260709 12:27:54.439463 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:54.440644 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:54.441972 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:54.443715 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:54.444484 22219 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:54.447829 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:54.459090 22219 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 8.
I20260709 12:27:54.425588 25746 raft_consensus.cc:515] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:54.465602 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.453807 25855 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:54.403887 25850 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.441591 25760 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:54.521284 20917 thread.cc:527] Waited for 20000ms trying to join with heartbeat (tid 22098)
W20260709 12:27:54.475972 25867 log.cc:927] Time spent T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:27:54.526348 25851 raft_consensus.cc:493] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.521606 25788 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:54.536686 25861 log.cc:927] Time spent T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:27:54.558702 25857 leader_election.cc:290] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.589563 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:54.591647 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:54.607453 22140 raft_consensus.cc:2393] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:27:54.595487 25613 consensus_meta.cc:287] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.002s
I20260709 12:27:54.537386 25853 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.613155 25788 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.629647 25878 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:27:54.631687 22114 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.632563 25746 leader_election.cc:290] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.621999 25681 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.624783 25743 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:54.635250 25792 consensus_meta.cc:287] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.004s
I20260709 12:27:54.535570 25851 raft_consensus.cc:515] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.623845 22140 raft_consensus.cc:1275] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:54.631534 25760 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.658753 22139 raft_consensus.cc:1240] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:54.623580 25613 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.672816 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:54.673152 25851 leader_election.cc:290] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.674914 25853 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.676026 25850 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:54.662533 25792 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.690122 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:54.690851 22809 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:27:54.693956 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:54.694191 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:54.657166 25788 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.695221 25845 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:54.701498 22809 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d465f3cb42174eb89615dcd747f9e682 in term 11.
I20260709 12:27:54.704859 22037 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:54.698695 25792 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.701450 25845 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.712563 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:54.715785 22215 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:54.717231 25845 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.709295 25760 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:54.728832 25788 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.782338 22215 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:54.765586 25792 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.764204 25760 raft_consensus.cc:697] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 11 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:54.785072 25792 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.785470 25613 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:54.785720 25760 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.787911 25792 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.836069 25715 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.892241 25717 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:54.892969 25717 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.895403 25845 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:54.896122 25845 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:54.896054 25717 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.898067 25717 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:54.898558 25717 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.913049 25795 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.913156 25792 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:54.928179 25717 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:54.928068 25792 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:54.898528 25845 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:54.930384 25792 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:54.957203 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 925862us
I20260709 12:27:54.996311 22036 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:54.998895 25819 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:55.001771 22036 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682; no voters: 
I20260709 12:27:55.004194 25613 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:55.004923 25613 raft_consensus.cc:697] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 11 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:55.005956 25613 consensus_queue.cc:237] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.005973 25819 consensus_queue.cc:1048] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
W20260709 12:27:55.095376 25862 log.cc:927] Time spent T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.908s	user 0.004s	sys 0.009s
W20260709 12:27:55.171865 22148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.014s	sys 0.016s
W20260709 12:27:55.172245 22148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.014s	sys 0.016s
I20260709 12:27:55.203253 25864 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:27:55.203133 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 466260us
I20260709 12:27:55.203866 25864 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:55.205318 22114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.206681 22113 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:55.207355 25864 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:55.209630 22142 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:55.211335 22113 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:55.212155 25864 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:55.284163 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 70743.6us
I20260709 12:27:55.285377 22113 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:55.289443 25868 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:55.290006 25868 raft_consensus.cc:697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:55.291186 25883 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.291052 25868 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.291759 25883 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.297708 25709 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.298290 25709 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.301282 25709 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:55.314007 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44162 (request call id 868) took 1506 ms. Trace:
I20260709 12:27:55.314427 22808 rpcz_store.cc:276] 0709 12:27:53.807165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.808272 (+  1107us) service_pool.cc:224] Handling call
0709 12:27:53.808672 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:54.020790 (+212118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:54.020826 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:54.021476 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 12:27:54.151669 (+130193us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:54.151705 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.151773 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:55.094760 (+942987us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:27:55.313564 (+218804us) raft_consensus.cc:1685] finished
0709 12:27:55.313591 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.313923 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54420,"raft.queue_time_us":138984,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":2700,"spinlock_wait_cycles":22956416,"thread_start_us":270182,"threads_started":2,"wal-append.queue_time_us":149076}
I20260709 12:27:55.359172 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.361900 21960 maintenance_manager.cc:419] P 338e7fd7f8b642b4a2b24f544ca70832: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033521
W20260709 12:27:55.365432 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 407185us
I20260709 12:27:55.371070 25708 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.371632 25708 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.373679 25708 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.373740 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:55.374202 25708 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.376186 25708 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.379034 25708 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.389854 25708 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:55.390440 25708 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.392558 25708 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:55.395267 25708 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:55.395763 25708 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.396597 25702 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.397137 25702 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.397882 25708 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.399184 25702 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.399586 22220 raft_consensus.cc:1275] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:55.400543 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:55.401975 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:55.408905 22802 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 5.
I20260709 12:27:55.411530 25845 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.412107 25845 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.413872 25845 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.413568 22186 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:55.416594 25697 raft_consensus.cc:2764] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:27:55.417253 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:55.417378 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:55.417840 22802 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:55.422052 25868 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.418948 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:55.414431 25845 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.425931 25347 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.447453 25347 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.426318 25823 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:55.429879 22802 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:55.432333 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:55.432327 25841 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:55.449062 25823 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.433914 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:55.434669 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.435314 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35998 (request call id 772) took 1352 ms. Trace:
I20260709 12:27:55.451370 25845 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.452032 22139 rpcz_store.cc:276] 0709 12:27:54.082587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.117014 (+ 34427us) service_pool.cc:224] Handling call
0709 12:27:54.117317 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:54.663498 (+546181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.435068 (+771570us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b5400057154. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:55.435230 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244616960}
I20260709 12:27:55.438330 25864 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:55.441749 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:55.454761 22807 raft_consensus.cc:2393] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 11: Already voted for candidate d465f3cb42174eb89615dcd747f9e682 in this term.
I20260709 12:27:55.454339 25864 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.455304 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.445031 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:55.456497 22146 raft_consensus.cc:2393] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d465f3cb42174eb89615dcd747f9e682 in current term 11: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:55.445910 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:55.458196 25347 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:55.458959 22144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.015s	sys 0.016s
W20260709 12:27:55.459319 22144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.015s	sys 0.016s
I20260709 12:27:55.459957 25823 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.425776 25868 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.461520 25680 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:55.463727 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2684) took 1216 ms. Trace:
I20260709 12:27:55.465495 25681 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.464186 22144 rpcz_store.cc:276] 0709 12:27:54.247006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.247110 (+   104us) service_pool.cc:224] Handling call
0709 12:27:54.247411 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:54.252859 (+  5448us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:54.273152 (+ 20293us) log.cc:844] Serialized 14 byte log entry
0709 12:27:54.925363 (+652211us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b1800424180. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:27:55.459665 (+534302us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:55.460316 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 12:27:55.460514 (+   198us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:55.460769 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 12:27:55.461002 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.461122 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:55.463476 (+  2354us) raft_consensus.cc:1685] finished
0709 12:27:55.463502 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.463654 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4982,"prepare.queue_time_us":36246,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":74,"raft.queue_time_us":136319,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":32347,"spinlock_wait_cycles":16528640,"thread_start_us":1124687,"threads_started":2,"wal-append.queue_time_us":216260}
I20260709 12:27:55.466104 25681 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.468463 25681 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:55.471509 25845 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.482149 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:55.483088 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.484545 25845 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.489354 25845 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.498006 25845 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:55.524374 20917 thread.cc:527] Waited for 21000ms trying to join with heartbeat (tid 22098)
I20260709 12:27:55.549800 22038 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:55.827590 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 277885us
I20260709 12:27:55.828685 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:55.829231 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.829921 22141 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 10.
I20260709 12:27:55.551586 25901 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.830930 25901 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.833151 25901 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.596738 22144 raft_consensus.cc:2468] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 9.
I20260709 12:27:55.658402 25819 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.834535 25819 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.837245 25819 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:55.681903 25864 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:55.686169 25347 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.838850 25347 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.840096 25911 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:55.840849 25911 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:55.841049 25347 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:55.482398 22148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51462 (request call id 2681) took 1236 ms. Trace:
I20260709 12:27:55.842316 22148 rpcz_store.cc:276] 0709 12:27:54.246119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.248766 (+  2647us) service_pool.cc:224] Handling call
0709 12:27:54.249032 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:54.371754 (+122722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:54.371784 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:54.372208 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:27:55.172589 (+800381us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:55.172944 (+   355us) log.cc:844] Serialized 14 byte log entry
0709 12:27:55.173157 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.482020 (+308863us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400055d54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:27:55.482065 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:55.482107 (+    42us) raft_consensus.cc:1685] finished
0709 12:27:55.482201 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.482331 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11611,"prepare.queue_time_us":679,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1480,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":17439,"spinlock_wait_cycles":281441536,"thread_start_us":800047,"threads_started":1,"wal-append.queue_time_us":410529}
I20260709 12:27:55.692148 25788 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:27:55.844699 25788 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:55.697095 22776 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:55.846840 22776 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:55.848050 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 150988us
W20260709 12:27:55.721163 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 245993us
I20260709 12:27:55.748086 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.749851 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.750607 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.852324 22142 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 10.
I20260709 12:27:55.756006 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:55.780428 25697 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.853128 25585 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:55.853387 25697 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.854527 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0007b92daafb42eda8843693014ea1d1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.854861 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.855571 25697 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.857250 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838948750f334b409ad4d7798a822e6d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.801807 25906 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:55.859968 25906 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.803825 25907 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.863217 25907 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.865422 25907 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.805487 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:55.806946 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 43785.4us
I20260709 12:27:55.821028 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:55.879638 22221 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:55.882408 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.882905 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.858415 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.890365 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.896293 25761 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:55.904034 25788 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:55.904994 25883 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:55.906926 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.907480 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.862311 25906 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.918767 25347 consensus_queue.cc:1048] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:55.919572 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:55.837795 25819 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:55.927141 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 96820.6us
I20260709 12:27:55.928419 22038 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:55.929230 25914 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:55.929584 22038 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:55.930344 25914 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:55.930861 25914 raft_consensus.cc:697] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Leader. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:55.931704 25914 consensus_queue.cc:237] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.946816 25680 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:55.947214 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:55.948596 25680 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:55.951169 25680 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:55.954540 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:55.959470 25678 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:55.972506 25909 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:55.972949 25697 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:27:55.973158 25909 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.973562 25697 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:55.975647 25697 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.975831 25909 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:55.976619 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.977305 22216 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 14.
I20260709 12:27:55.984623 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6d6e7c5d4c484487206e2d8b43cebf" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.984930 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.988953 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.990397 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.993567 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:55.994786 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:56.001286 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:55.999850 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:56.002895 22221 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 6.
I20260709 12:27:56.005403 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:56.008028 22188 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:56.009711 22145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.010s
I20260709 12:27:56.018343 22188 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.026165 25909 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:56.027460 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.028688 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.029752 25868 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:56.030889 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.031550 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.033996 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.036265 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.012948 22217 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:56.015401 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35bc73fc9544276942bc2c3ee41e639" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
W20260709 12:27:56.038802 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 161808us
I20260709 12:27:56.040525 22185 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:56.018412 22145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.011s
I20260709 12:27:56.042418 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.050740 25717 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.051342 25717 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:56.050393 25460 consensus_queue.cc:1048] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:56.053640 25717 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:56.055475 25695 consensus_queue.cc:1059] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:56.056655 25755 raft_consensus.cc:3055] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:56.056761 25868 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:56.057085 25755 raft_consensus.cc:740] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:56.057397 25868 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.058622 25755 consensus_queue.cc:260] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.059677 25868 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:56.061412 25868 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:56.062120 25868 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.075847 22145 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:27:56.077574 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 272545us
I20260709 12:27:56.076020 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.086292 22185 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:56.088796 22038 leader_election.cc:304] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:56.017729 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 62081.2us
I20260709 12:27:56.103700 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.105988 22140 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:56.107854 25755 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:56.130249 25908 raft_consensus.cc:2804] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:56.130894 25908 raft_consensus.cc:697] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:56.111430 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.131750 25908 consensus_queue.cc:237] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.114673 25868 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:56.010998 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:56.168808 25717 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:56.173702 25717 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:56.174579 25717 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:56.135855 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 49680.2us
I20260709 12:27:56.153030 25783 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:27:56.136065 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 109569us
W20260709 12:27:56.168212 22114 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 169 similar messages]
I20260709 12:27:56.181137 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:56.183368 22114 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.183995 22113 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.184917 25788 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:56.185315 25783 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.187270 25844 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:56.185379 25788 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:56.187793 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.188380 25788 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:56.189646 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 106404us
I20260709 12:27:56.189847 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.190868 25776 raft_consensus.cc:2749] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:56.191990 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 103308us
W20260709 12:27:56.192761 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 113491us
I20260709 12:27:56.193399 22038 leader_election.cc:304] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.194896 25347 raft_consensus.cc:2749] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:56.196585 22113 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.196775 22802 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:56.197731 25678 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:56.199853 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:56.202265 25776 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:56.205293 25788 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:56.206838 25844 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:56.207305 25844 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:56.207954 25844 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:56.156473 22773 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.215575 25848 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:56.216221 25678 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:27:56.216595 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 60206.5us
I20260709 12:27:56.218506 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.229568 22185 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:56.235878 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.240828 22140 raft_consensus.cc:2393] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 9: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:56.243001 25761 raft_consensus.cc:493] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.243175 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.243628 25761 raft_consensus.cc:515] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.245445 25792 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:56.246155 25761 leader_election.cc:290] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:56.238690 22036 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:56.247740 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 67543us
I20260709 12:27:56.187585 25783 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:56.222254 21970 catalog_manager.cc:5697] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 7, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 7 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.262348 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.262995 21970 catalog_manager.cc:5697] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 5, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:56.265084 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 78340.5us
I20260709 12:27:56.264743 21970 catalog_manager.cc:5697] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 6, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 6 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.271797 22037 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.239308 25844 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:56.250895 22185 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:27:56.251693 22147 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 14. Current term is 15. Ops: []
W20260709 12:27:56.146068 21967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46372 (request call id 299) took 15310 ms (client timeout 15000 ms). Trace:
I20260709 12:27:56.230014 25717 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:56.271137 21970 catalog_manager.cc:5697] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 7, leader changed from <none> to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 7 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.279430 22185 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:56.284571 22188 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.288395 22188 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.287364 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.290236 22802 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:56.294200 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.294526 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:56.300149 22188 leader_election.cc:336] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.300621 22188 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:56.301838 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.288648 21970 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.304183 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.304908 22142 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 11.
I20260709 12:27:56.304220 21970 catalog_manager.cc:5697] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 5, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.351004 22139 raft_consensus.cc:1240] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:56.352870 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:56.350886 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:56.355224 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.341198 21970 catalog_manager.cc:5697] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 9, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 9 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.360452 22112 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.360649 21970 catalog_manager.cc:5697] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 7, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 7 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.368157 21970 catalog_manager.cc:5697] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.261348 25760 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:56.380028 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:56.371722 21970 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.383800 21970 catalog_manager.cc:5697] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.385711 21970 catalog_manager.cc:5697] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 8, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 8 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:27:56.390565 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:56.391415 22114 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.391853 22114 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.387378 21970 catalog_manager.cc:5697] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:56.398844 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:56.368450 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.410526 22776 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.296926 25907 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:56.394429 21970 catalog_manager.cc:5697] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 6, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 6 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.297973 25909 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:56.413713 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 105766us
W20260709 12:27:56.413971 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 142271us
I20260709 12:27:56.416241 21970 catalog_manager.cc:5697] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 5, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 5 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.421087 21970 catalog_manager.cc:5697] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
W20260709 12:27:56.277068 21967 rpcz_store.cc:269] 0709 12:27:40.845767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.846061 (+   294us) service_pool.cc:224] Handling call
0709 12:27:56.145896 (+15299835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:52.812506 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:52.813053 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:52.813091 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:27:52.813107 (+    16us) tablet.cc:662] Decoding operations
0709 12:27:52.842627 (+ 29520us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:52.842693 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:52.842720 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:27:52.848293 (+  5573us) tablet.cc:701] Row locks acquired
0709 12:27:52.848313 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:27:52.848547 (+   234us) write_op.cc:270] Start()
0709 12:27:52.848673 (+   126us) write_op.cc:276] Timestamp: P: 1783600072848494 usec, L: 0
0709 12:27:52.848695 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:27:52.849401 (+   706us) log.cc:844] Serialized 4397 byte log entry
0709 12:27:53.185044 (+335643us) op_driver.cc:464] REPLICATION: finished
0709 12:27:53.715646 (+530602us) write_op.cc:301] APPLY: starting
0709 12:27:53.715747 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:53.716094 (+   347us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:53.716241 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:53.717826 (+  1585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:53.856942 (+139116us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:27:53.863481 (+  6539us) write_op.cc:312] APPLY: finished
0709 12:27:53.948270 (+ 84789us) log.cc:844] Serialized 83 byte log entry
0709 12:27:53.955630 (+  7360us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:53.961776 (+  6146us) write_op.cc:454] Released schema lock
0709 12:27:53.963795 (+  2019us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:53.964222 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:53.964253 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":276381,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":530333,"apply.run_cpu_time_us":4438,"apply.run_wall_time_us":248556,"num_ops":11,"prepare.queue_time_us":278691,"prepare.run_cpu_time_us":53365,"prepare.run_wall_time_us":146389,"raft.queue_time_us":118956,"raft.run_cpu_time_us":17181,"raft.run_wall_time_us":335767,"replication_time_us":336074,"thread_start_us":602349,"threads_started":4,"wal-append.queue_time_us":143997,"wal-append.run_cpu_time_us":9851,"wal-append.run_wall_time_us":1971191}]]}
I20260709 12:27:56.413235 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:56.306692 25845 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:56.418648 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 58295.2us
I20260709 12:27:56.282831 25613 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 12:27:56.422411 21970 catalog_manager.cc:5697] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.425184 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.432420 21970 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.287971 25824 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
W20260709 12:27:56.419355 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:56.428203 22112 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:56.418128 25918 log.cc:927] Time spent T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:27:56.438728 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befabab572c4ed8832b542ff35c0ee1" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:56.433884 21970 catalog_manager.cc:5697] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
W20260709 12:27:56.440372 22114 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:56.445163 22114 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.445660 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:56.426978 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 58577us
I20260709 12:27:56.417423 25911 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:56.445304 21970 catalog_manager.cc:5697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 1 to 4, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 4 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:56.415267 25907 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:56.416720 25788 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:56.452047 20917 tablet_replica.cc:333] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:56.423873 25678 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:56.424407 25883 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:56.454705 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 162811us
I20260709 12:27:56.427814 25838 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:56.468039 22776 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.469204 22185 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:56.469918 22776 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.475471 22038 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.462657 25907 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:56.498431 22038 leader_election.cc:304] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:56.506384 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 58570.8us
W20260709 12:27:56.507510 22776 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.508009 22776 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.509685 22038 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.511229 22038 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.453212 25819 consensus_queue.cc:1059] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 12:27:56.513849 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:56.516407 22776 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.518620 22038 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.477807 25709 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:56.476689 25845 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:56.463579 25851 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:27:56.484210 25761 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.504765 25883 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:56.510085 25760 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:56.540794 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 112695us
I20260709 12:27:56.509208 25783 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:56.555171 22112 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.541455 22776 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:56.560166 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43787.3us
W20260709 12:27:56.553725 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 124443us
I20260709 12:27:56.521093 25841 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:56.561058 22776 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:56.562330 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 133832us
I20260709 12:27:56.609591 22776 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.526188 25845 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.525398 25914 raft_consensus.cc:2749] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:56.558816 22112 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.551254 25819 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:27:56.619369 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 60633.4us
I20260709 12:27:56.527066 25846 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:56.554298 25761 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:56.619939 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 174715us
I20260709 12:27:56.612711 25841 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:56.618428 25845 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:56.604645 25760 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:56.601402 25562 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:56.611143 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 50095.5us
I20260709 12:27:56.611805 25911 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:56.611564 25883 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:56.630470 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 179002us
W20260709 12:27:56.681314 22038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 141840us
I20260709 12:27:56.694638 22038 leader_election.cc:304] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:56.696195 22188 leader_election.cc:336] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.696669 22188 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.703451 25761 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:56.643679 25844 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:56.621711 25788 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:27:56.708331 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:56.680706 25936 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:56.704092 25909 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:56.712065 22094 debug-util.cc:398] Leaking SignalData structure 0x7b080030c360 after lost signal to thread 20920
W20260709 12:27:56.713279 22094 debug-util.cc:398] Leaking SignalData structure 0x7b0800336d40 after lost signal to thread 22005
W20260709 12:27:56.713764 22094 debug-util.cc:398] Leaking SignalData structure 0x7b0800313fe0 after lost signal to thread 22025
W20260709 12:27:56.714185 22094 debug-util.cc:398] Leaking SignalData structure 0x7b080033d240 after lost signal to thread 22097
W20260709 12:27:56.714290 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 289191us
W20260709 12:27:56.715287 25931 log.cc:927] Time spent T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:27:56.714461 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2680 after lost signal to thread 22098
W20260709 12:27:56.718443 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08000dcb00 after lost signal to thread 22172
W20260709 12:27:56.718796 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08000dcc00 after lost signal to thread 22173
W20260709 12:27:56.721942 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc020 after lost signal to thread 22246
W20260709 12:27:56.722333 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc060 after lost signal to thread 22247
W20260709 12:27:56.723730 22094 debug-util.cc:398] Leaking SignalData structure 0x7b08003f96e0 after lost signal to thread 22834
W20260709 12:27:56.724061 22094 debug-util.cc:398] Leaking SignalData structure 0x7b080038ece0 after lost signal to thread 22835
I20260709 12:27:56.678845 25914 consensus_queue.cc:1059] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:27:56.709364 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 89426.1us
I20260709 12:27:56.745333 25936 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:56.746147 25936 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.745467 25940 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:56.750032 25940 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.751894 25844 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:56.752502 25844 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.739456 25944 raft_consensus.cc:2749] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:56.783619 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 140726us
I20260709 12:27:56.787901 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:56.797777 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:56.799686 20917 raft_consensus.cc:2243] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:27:56.801102 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 68597.2us
W20260709 12:27:56.817550 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.796166 25844 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:56.795253 25717 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:56.796128 25940 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:56.820829 22114 leader_election.cc:336] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.855820 22775 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.819015 25914 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.874181 22114 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:56.877128 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56342.7us
W20260709 12:27:56.877934 22114 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:56.876392 22037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 57472us
I20260709 12:27:56.878353 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:56.903766 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.903970 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.882264 25940 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:56.879428 25844 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:56.889559 25934 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.889313 25846 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.918845 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:56.893522 25838 raft_consensus.cc:3060] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:56.888651 25914 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:56.799170 25936 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:56.935688 25949 raft_consensus.cc:3055] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:27:56.974582 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 96667.4us
W20260709 12:27:56.978739 22114 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.979199 22114 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:56.939424 25851 raft_consensus.cc:932] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 14 LEADER]: Unable to handle notification of new term (15): Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:27:56.934306 25824 raft_consensus.cc:493] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:56.944828 25938 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:56.999544 20917 raft_consensus.cc:2272] T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.999789 22114 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.000455 22114 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.933336 25844 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:57.005522 22169 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1bc0 after lost signal to thread 20920
W20260709 12:27:57.008200 22169 debug-util.cc:398] Leaking SignalData structure 0x7b08000ceee0 after lost signal to thread 22005
W20260709 12:27:57.008764 22169 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1d40 after lost signal to thread 22097
W20260709 12:27:57.009943 22169 debug-util.cc:398] Leaking SignalData structure 0x7b08000bde20 after lost signal to thread 22172
W20260709 12:27:57.010205 22169 debug-util.cc:398] Leaking SignalData structure 0x7b0800304ce0 after lost signal to thread 22173
W20260709 12:27:57.011458 22114 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.012005 22114 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:56.977741 25949 raft_consensus.cc:740] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
W20260709 12:27:57.017230 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 110772us
I20260709 12:27:57.019771 22146 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:56.943053 25846 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:56.937829 25934 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:57.021016 22169 debug-util.cc:398] Leaking SignalData structure 0x7b080015a7a0 after lost signal to thread 22246
I20260709 12:27:57.003463 25961 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.025877 25347 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.033608 25347 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:57.029451 22776 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:57.030464 22169 debug-util.cc:398] Leaking SignalData structure 0x7b080036a560 after lost signal to thread 22247
I20260709 12:27:57.051067 25914 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:57.018522 25883 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:57.000412 25824 raft_consensus.cc:515] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.063890 25844 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:57.064829 25824 leader_election.cc:290] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:57.028123 25938 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:57.066533 25938 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.069089 25949 consensus_queue.cc:260] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:57.070468 25949 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:57.034228 25951 log.cc:927] Time spent T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:27:57.081367 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:57.054418 25957 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:27:57.028118 25717 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:27:57.084523 25938 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:57.057685 25961 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.095335 25961 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:57.058326 22169 debug-util.cc:398] Leaking SignalData structure 0x7b08003fc8e0 after lost signal to thread 22834
W20260709 12:27:57.098189 22169 debug-util.cc:398] Leaking SignalData structure 0x7b08000dbc80 after lost signal to thread 22835
W20260709 12:27:57.099753 22169 debug-util.cc:398] Leaking SignalData structure 0x7b080031a880 after lost signal to thread 25859
I20260709 12:27:57.105525 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:57.106303 22139 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
I20260709 12:27:57.108559 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:57.111032 25907 consensus_meta.cc:287] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.010s
I20260709 12:27:57.111596 22185 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:57.112555 25908 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:57.112968 25908 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.113293 25908 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:57.115727 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:57.119630 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:57.120340 25845 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:57.121021 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:57.124014 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:57.036065 25347 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:57.054724 25946 log.cc:927] Time spent T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:27:57.059542 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:57.086555 25934 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:57.129081 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:57.089442 25953 log.cc:927] Time spent T 79fd945ff0ce4fa4a9967036f06d82f7 P d465f3cb42174eb89615dcd747f9e682: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:27:57.037353 22776 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:57.130313 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 100889us
W20260709 12:27:57.132076 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:57.132155 20917 tablet_replica.cc:333] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.036375 25678 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:27:57.128108 22039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:57.134064 25841 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:57.135042 25838 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:57.135895 22806 raft_consensus.cc:1275] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:57.088634 25846 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:57.133229 20917 raft_consensus.cc:2243] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.137775 20917 pending_rounds.cc:70] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: Trying to abort 1 pending ops.
I20260709 12:27:57.138031 20917 pending_rounds.cc:77] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 4 index: 6 } timestamp: 7305625800091435008 op_type: NO_OP noop_request { }
I20260709 12:27:57.138401 20917 raft_consensus.cc:2889] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:57.141539 20917 raft_consensus.cc:2272] T 147ee46d74a94d69bbe00644cd192cc2 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.144294 20917 tablet_replica.cc:333] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.145318 20917 raft_consensus.cc:2243] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.145951 20917 raft_consensus.cc:2272] T ca62bb8242354d418721b86a9b704e37 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.153520 25906 consensus_queue.cc:1048] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:27:57.030845 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 83471.2us
I20260709 12:27:57.111557 25907 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.159749 22218 raft_consensus.cc:1240] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:57.163733 25907 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:57.168135 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:57.184743 22142 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer d465f3cb42174eb89615dcd747f9e682: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:57.186321 22139 raft_consensus.cc:1240] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:57.195807 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:57.173915 25845 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:57.201548 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:57.204702 22113 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:57.211692 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:57.214069 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:57.222317 22114 leader_election.cc:336] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.223436 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:57.225762 22113 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:57.230984 22113 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:57.236328 25938 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:57.224550 25347 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.254722 25961 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:27:57.261695 25908 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:57.234962 25952 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:57.231416 25960 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:57.256057 20917 tablet_replica.cc:333] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.273746 22036 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:27:57.278438 22114 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.283735 20917 raft_consensus.cc:2243] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.284616 20917 raft_consensus.cc:2272] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.278218 25950 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:57.292798 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 52940.6us
I20260709 12:27:57.294119 22113 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:57.295729 25908 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:57.280635 22114 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.296300 25678 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:57.298020 25868 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:57.256223 25347 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:57.301888 25347 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:57.306479 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:57.307148 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:57.298156 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:57.308293 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:57.269490 25460 consensus_queue.cc:1059] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:27:57.309911 25460 raft_consensus.cc:3055] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:57.310349 25460 raft_consensus.cc:740] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:57.311332 25460 consensus_queue.cc:260] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.290228 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:57.315977 22220 raft_consensus.cc:1240] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:27:57.317301 22215 raft_consensus.cc:1240] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:57.318424 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:57.319624 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980127ed884f4554a2daf41b92732061" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:57.321103 22188 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.321656 22188 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.318212 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:57.326032 22188 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.326761 22188 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.331094 25901 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:57.329208 25845 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:57.334465 20917 tablet_replica.cc:333] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.335752 20917 raft_consensus.cc:2243] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.336400 20917 pending_rounds.cc:70] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: Trying to abort 1 pending ops.
I20260709 12:27:57.336716 20917 pending_rounds.cc:77] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305625750587359232 op_type: NO_OP noop_request { }
I20260709 12:27:57.364821 20917 raft_consensus.cc:2889] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:57.344974 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:57.371775 20917 raft_consensus.cc:2272] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.347440 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f20d90a634149ef85ae0b05adb8a34a" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:57.327327 25460 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:57.379478 22218 raft_consensus.cc:1240] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Rejecting Update request from peer d465f3cb42174eb89615dcd747f9e682 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:57.381126 25347 consensus_queue.cc:1059] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:57.382414 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 52164.3us
W20260709 12:27:57.383698 22188 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.383857 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:57.384124 22188 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.382544 25948 raft_consensus.cc:3055] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:57.384824 25948 raft_consensus.cc:740] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:57.385663 25948 consensus_queue.cc:260] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:57.389206 20917 tablet_replica.cc:333] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.390265 20917 raft_consensus.cc:2243] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.390786 20917 pending_rounds.cc:70] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Trying to abort 1 pending ops.
I20260709 12:27:57.391036 20917 pending_rounds.cc:77] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 3 index: 6 } timestamp: 7305625806883749888 op_type: NO_OP noop_request { }
I20260709 12:27:57.391371 20917 raft_consensus.cc:2889] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:57.391686 20917 raft_consensus.cc:2272] T 838948750f334b409ad4d7798a822e6d P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.393157 25908 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:57.394541 22803 raft_consensus.cc:2468] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 11.
I20260709 12:27:57.394726 25948 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:57.397804 22186 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:57.398923 25908 raft_consensus.cc:2804] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:57.399664 25908 raft_consensus.cc:697] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:57.400609 25908 consensus_queue.cc:237] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.404786 20917 tablet_replica.cc:333] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.405134 22038 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:57.405843 22038 raft_consensus.cc:2686] T 980127ed884f4554a2daf41b92732061 P d465f3cb42174eb89615dcd747f9e682: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:27:57.406466 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.406950 22188 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.407833 25907 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:57.414081 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.414659 22188 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.414772 25347 raft_consensus.cc:493] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.415387 25347 raft_consensus.cc:515] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.417721 25347 leader_election.cc:290] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:57.418902 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:57.421958 25907 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:57.423614 22188 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.424166 22188 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.425606 25907 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:57.435177 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.435735 22188 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.405982 20917 raft_consensus.cc:2243] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.441759 20917 raft_consensus.cc:2272] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.446117 25907 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:57.446516 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.446998 22188 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.447708 25907 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:57.448077 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.448506 22038 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:57.456578 20917 tablet_replica.cc:333] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.464577 22038 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:57.464105 25347 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:57.483271 21959 maintenance_manager.cc:643] P 338e7fd7f8b642b4a2b24f544ca70832: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 1.810s	user 0.146s	sys 0.056s Metrics: {"bytes_written":29237,"cfile_init":1,"dirs.queue_time_us":118372,"dirs.run_cpu_time_us":416,"dirs.run_wall_time_us":2505,"drs_written":1,"lbm_read_time_us":413,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3954,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":63,"thread_start_us":168412,"threads_started":1}
I20260709 12:27:57.489353 21960 maintenance_manager.cc:419] P 338e7fd7f8b642b4a2b24f544ca70832: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10148 bytes on disk
I20260709 12:27:57.494632 25851 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:57.498049 21959 maintenance_manager.cc:643] P 338e7fd7f8b642b4a2b24f544ca70832: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.006s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":906,"lbm_reads_lt_1ms":4}
I20260709 12:27:57.501705 22038 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:57.507490 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:57.519963 22776 consensus_peers.cc:597] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.520794 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:57.521562 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:57.523331 22038 leader_election.cc:304] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:57.524698 25819 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:57.528678 22038 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:57.529935 22038 raft_consensus.cc:2686] T b9f4ba2e44d142d4810d14babd35c984 P d465f3cb42174eb89615dcd747f9e682: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:57.527824 25819 consensus_queue.cc:1059] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:57.527813 25949 raft_consensus.cc:2749] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:57.533289 25935 raft_consensus.cc:3055] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:57.533720 25935 raft_consensus.cc:740] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d465f3cb42174eb89615dcd747f9e682, State: Running, Role: LEADER
I20260709 12:27:57.539793 20917 raft_consensus.cc:2243] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.542212 20917 raft_consensus.cc:2272] T 3fd4242f251b46f1a7e47490973fd53c P d465f3cb42174eb89615dcd747f9e682 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.544152 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d18246b3984c719bedcfe7da84c5c5" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:27:57.547328 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.546969 25935 consensus_queue.cc:260] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:57.547821 22188 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.548769 25908 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:57.549012 20917 tablet_replica.cc:333] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.553659 20917 raft_consensus.cc:2243] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:57.540109 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:57.550701 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:57.555966 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:57.556572 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:57.560537 22038 leader_election.cc:304] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:57.556746 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.561604 22188 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.563560 20917 pending_rounds.cc:70] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Trying to abort 1 pending ops.
I20260709 12:27:57.563907 20917 pending_rounds.cc:77] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 5 index: 7 } timestamp: 7305625807023951872 op_type: NO_OP noop_request { }
I20260709 12:27:57.564258 20917 raft_consensus.cc:2889] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:57.564587 20917 raft_consensus.cc:2272] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:57.568734 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:57.569022 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:57.573207 22188 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.576489 25347 raft_consensus.cc:2749] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:57.577049 25907 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:57.574450 25908 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:57.571595 25935 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:57.609582 20917 tablet_replica.cc:333] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.610661 20917 raft_consensus.cc:2243] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.612648 20917 raft_consensus.cc:2272] T 9f20d90a634149ef85ae0b05adb8a34a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.625546 25907 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:57.645779 25907 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.647975 25907 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:57.647908 21970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 332) took 5844 ms. Trace:
I20260709 12:27:57.650681 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:57.651501 22142 raft_consensus.cc:2393] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:57.648715 21970 rpcz_store.cc:276] 0709 12:27:51.803576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.803756 (+   180us) service_pool.cc:224] Handling call
0709 12:27:57.647808 (+5844052us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:56.742768 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:56.743407 (+   639us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:56.743447 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:27:56.743461 (+    14us) tablet.cc:662] Decoding operations
0709 12:27:56.745407 (+  1946us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:56.745474 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:56.745509 (+    35us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:27:57.035375 (+289866us) tablet.cc:701] Row locks acquired
0709 12:27:57.035400 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:27:57.035553 (+   153us) write_op.cc:270] Start()
0709 12:27:57.035668 (+   115us) write_op.cc:276] Timestamp: P: 1783600077035507 usec, L: 0
0709 12:27:57.035693 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:27:57.039238 (+  3545us) log.cc:844] Serialized 7913 byte log entry
0709 12:27:57.330504 (+291266us) op_driver.cc:464] REPLICATION: finished
0709 12:27:57.375781 (+ 45277us) write_op.cc:301] APPLY: starting
0709 12:27:57.375887 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:57.531316 (+155429us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:57.531413 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:57.613047 (+ 81634us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:57.613401 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 12:27:57.613445 (+    44us) write_op.cc:312] APPLY: finished
0709 12:27:57.613878 (+   433us) log.cc:844] Serialized 180 byte log entry
0709 12:27:57.614073 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:57.614280 (+   207us) write_op.cc:454] Released schema lock
0709 12:27:57.614337 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:57.614811 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:57.614845 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":44950,"apply.run_cpu_time_us":27948,"apply.run_wall_time_us":239006,"cfile_cache_hit":78,"cfile_cache_hit_bytes":81510,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":1,"lbm_read_time_us":3801,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":7,"num_ops":20,"prepare.queue_time_us":240078,"prepare.run_cpu_time_us":17814,"prepare.run_wall_time_us":485541,"raft.queue_time_us":43356,"raft.run_cpu_time_us":1336,"raft.run_wall_time_us":48639,"replication_time_us":294665,"thread_start_us":391807,"threads_started":4,"wal-append.queue_time_us":212262}]]}
I20260709 12:27:57.649235 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:57.659705 22804 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
I20260709 12:27:57.661165 22186 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:57.662285 25908 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:57.662827 25908 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:27:57.663239 25908 raft_consensus.cc:3060] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:57.611035 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.667622 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 56628.7us
I20260709 12:27:57.679944 20917 tablet_replica.cc:333] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.680882 20917 raft_consensus.cc:2243] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.684990 25908 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:57.689942 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:57.695109 25949 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.715306 25949 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:57.717485 25949 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:57.719817 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:57.719841 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "d465f3cb42174eb89615dcd747f9e682" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:57.723119 22038 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d465f3cb42174eb89615dcd747f9e682; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:57.724445 25949 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:57.738088 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:57.739051 22142 raft_consensus.cc:2393] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 8: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:57.740604 25908 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:57.741510 20917 raft_consensus.cc:2272] T 7befabab572c4ed8832b542ff35c0ee1 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.742683 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:57.744403 20917 tablet_replica.cc:333] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.745604 20917 raft_consensus.cc:2243] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.746134 20917 raft_consensus.cc:2272] T de6d6e7c5d4c484487206e2d8b43cebf P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:57.713300 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.747035 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:57.706162 21971 catalog_manager.cc:5697] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.752135 21971 catalog_manager.cc:5697] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.754076 21971 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 6 to 8, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 8 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:57.757566 21971 catalog_manager.cc:5697] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 1 to 4, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 4 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.758468 22801 raft_consensus.cc:2468] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
I20260709 12:27:57.759729 22186 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:27:57.760723 25908 raft_consensus.cc:2804] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:57.761835 25908 raft_consensus.cc:697] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:57.776424 20917 tablet_replica.cc:333] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.777524 20917 raft_consensus.cc:2243] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.778113 20917 raft_consensus.cc:2272] T e7199ba25bca48e89b961cf6ef78ab28 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.775205 21971 catalog_manager.cc:5697] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 7 to 8, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 8 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.763486 25908 consensus_queue.cc:237] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:57.785097 21971 catalog_manager.cc:5697] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:57.803122 21971 catalog_manager.cc:5697] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 3 to 4, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:57.799448 20917 tablet_replica.cc:333] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
W20260709 12:27:57.805948 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:57.811622 20917 raft_consensus.cc:2243] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.812404 21971 catalog_manager.cc:5697] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 5 to 6, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 6 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:57.814890 21971 catalog_manager.cc:5697] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 3 to 4, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 4 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.821286 20917 raft_consensus.cc:2272] T b155a7c146564fdbb5330057eca55fd8 P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.858227 20917 tablet_replica.cc:333] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.863602 20917 raft_consensus.cc:2243] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.864856 20917 raft_consensus.cc:2272] T 2601e033c5b34310a9d1582b3d94c3aa P d465f3cb42174eb89615dcd747f9e682 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.869979 20917 tablet_replica.cc:333] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.880375 20917 raft_consensus.cc:2243] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.881667 20917 raft_consensus.cc:2272] T 4321547cceb341b9babe64debb9fb125 P d465f3cb42174eb89615dcd747f9e682 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.885417 20917 tablet_replica.cc:333] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.886381 20917 raft_consensus.cc:2243] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.889142 20917 raft_consensus.cc:2272] T 39f024f1dc1c4aaaa8094ad37822a6e1 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.902868 20917 tablet_replica.cc:333] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.903620 20917 raft_consensus.cc:2243] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.904036 20917 raft_consensus.cc:2272] T b35bc73fc9544276942bc2c3ee41e639 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.908757 20917 tablet_replica.cc:333] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.909862 20917 raft_consensus.cc:2243] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.910677 20917 raft_consensus.cc:2272] T 0a00dfd4bb864cbe94033b53b925fd76 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.913405 20917 tablet_replica.cc:333] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.918962 20917 raft_consensus.cc:2243] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.919574 20917 pending_rounds.cc:70] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: Trying to abort 1 pending ops.
I20260709 12:27:57.922456 20917 pending_rounds.cc:77] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 5 index: 6 } timestamp: 7305625757057011712 op_type: NO_OP noop_request { }
I20260709 12:27:57.922935 20917 raft_consensus.cc:2889] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:57.923344 20917 raft_consensus.cc:2272] T 4ec6cbbf70dc43daa892eda3ef90f702 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.926216 20917 tablet_replica.cc:333] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.930135 25908 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:57.934933 25908 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:57.937282 25908 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:57.938287 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:57.939131 22142 raft_consensus.cc:2393] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 7: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
I20260709 12:27:57.940276 20917 raft_consensus.cc:2243] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:27:57.940893 22188 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.941474 20917 raft_consensus.cc:2272] T 52ee10bae8ef4b668f33b9ef12e13a6a P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.941381 22188 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:57.942574 25908 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:57.944417 20917 tablet_replica.cc:333] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.945418 20917 raft_consensus.cc:2243] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.950944 20917 pending_rounds.cc:70] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Trying to abort 2 pending ops.
I20260709 12:27:57.951295 20917 pending_rounds.cc:77] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 6 index: 8 } timestamp: 7305625866909315072 op_type: NO_OP noop_request { }
I20260709 12:27:57.951740 20917 raft_consensus.cc:2889] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:57.952086 20917 pending_rounds.cc:77] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 4 index: 7 } timestamp: 7305625828572766208 op_type: NO_OP noop_request { }
I20260709 12:27:57.952477 20917 raft_consensus.cc:2889] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:57.952850 20917 raft_consensus.cc:2272] T 953fcacc5a2943eeb23356e2f1c2cc5f P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.954958 25908 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:57.955894 20917 tablet_replica.cc:333] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.958071 20917 raft_consensus.cc:2243] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.962321 20917 raft_consensus.cc:2272] T f3c7f71fea4a4a6d815758ecce7a83cd P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.965070 20917 tablet_replica.cc:333] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.965931 20917 raft_consensus.cc:2243] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.966506 20917 raft_consensus.cc:2272] T 9bbdc6920d6f481f9edabac1f94774ff P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.969687 20917 tablet_replica.cc:333] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.969985 22804 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:57.970667 20917 raft_consensus.cc:2243] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.971285 20917 raft_consensus.cc:2272] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.974013 20917 tablet_replica.cc:333] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.973771 25907 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:57.974918 20917 raft_consensus.cc:2243] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.975628 20917 raft_consensus.cc:2272] T a2d181824b34483d8653c405c650ec94 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.978205 20917 tablet_replica.cc:333] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.979272 20917 raft_consensus.cc:2243] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.980317 20917 raft_consensus.cc:2272] T ce0cbcda6ab94ef68d36321d19671059 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.983124 20917 tablet_replica.cc:333] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.984004 20917 raft_consensus.cc:2243] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.984573 20917 raft_consensus.cc:2272] T 5dae45fb2bfa401ab5a87bc3a8672e60 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.987423 20917 tablet_replica.cc:333] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.988286 20917 raft_consensus.cc:2243] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.989782 20917 raft_consensus.cc:2272] T 68d18246b3984c719bedcfe7da84c5c5 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.978165 22142 raft_consensus.cc:3060] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:57.996387 20917 tablet_replica.cc:333] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:57.997265 20917 raft_consensus.cc:2243] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.997829 20917 raft_consensus.cc:2272] T 57757a075ae444bf9e3ae62e6892f42a P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.000298 20917 tablet_replica.cc:333] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.001066 20917 raft_consensus.cc:2243] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.003342 20917 raft_consensus.cc:2272] T cf2d9646522845819383a8daea185649 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.007295 20917 tablet_replica.cc:333] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.008172 20917 raft_consensus.cc:2243] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.009865 20917 raft_consensus.cc:2272] T f14db25b634d44dda22c20f58ac81a55 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.011991 22142 raft_consensus.cc:1275] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:58.012744 20917 tablet_replica.cc:333] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
W20260709 12:27:58.013334 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.015010 20917 raft_consensus.cc:2243] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.015659 20917 raft_consensus.cc:2272] T 0007b92daafb42eda8843693014ea1d1 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.018325 20917 tablet_replica.cc:333] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.018778 25908 consensus_queue.cc:1048] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:58.019202 20917 raft_consensus.cc:2243] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.019857 20917 raft_consensus.cc:2272] T a71d215daee640dc8183aa5bb0a69a18 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.022675 20917 tablet_replica.cc:333] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.023530 20917 raft_consensus.cc:2243] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:58.024628 20917 raft_consensus.cc:2272] T 48a34f9ae8654955bc6eda7229323ca3 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.027498 20917 tablet_replica.cc:333] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.028380 20917 raft_consensus.cc:2243] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:58.029410 20917 raft_consensus.cc:2272] T 1cfcc23bf9854a5e8cf97a83c188f631 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.032023 20917 tablet_replica.cc:333] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.032819 20917 raft_consensus.cc:2243] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:27:58.033725 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:58.033897 20917 raft_consensus.cc:2272] T f3726200783e487b9963f5fc73170d31 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.037278 20917 tablet_replica.cc:333] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
W20260709 12:27:58.049037 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:58.051379 20917 raft_consensus.cc:2243] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:58.059643 20917 raft_consensus.cc:2272] T 5e537942a08e4c8fbf26a1a0084997c4 P d465f3cb42174eb89615dcd747f9e682 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.063649 20917 tablet_replica.cc:333] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.064563 20917 raft_consensus.cc:2243] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.065428 20917 raft_consensus.cc:2272] T 12cca886b64e4c138e59114be95a8549 P d465f3cb42174eb89615dcd747f9e682 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.068365 20917 tablet_replica.cc:333] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.071857 20917 raft_consensus.cc:2243] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.072661 20917 pending_rounds.cc:70] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Trying to abort 1 pending ops.
I20260709 12:27:58.073002 20917 pending_rounds.cc:77] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 6 index: 5 } timestamp: 7305625753975152640 op_type: NO_OP noop_request { }
I20260709 12:27:58.073422 20917 raft_consensus.cc:2889] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:58.073832 20917 raft_consensus.cc:2272] T 8fd1d178990d44f78512d81cdacd6b1d P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:58.070745 21971 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38180 (request call id 210) took 13559 ms (client timeout 15000 ms). Trace:
W20260709 12:27:58.074839 21971 rpcz_store.cc:269] 0709 12:27:44.511003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.512729 (+  1726us) service_pool.cc:224] Handling call
0709 12:27:58.070656 (+13557927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:57.902811 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:57.903416 (+   605us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:57.903458 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:27:57.903478 (+    20us) tablet.cc:662] Decoding operations
0709 12:27:57.904404 (+   926us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:57.904497 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:57.904524 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:27:57.905257 (+   733us) tablet.cc:701] Row locks acquired
0709 12:27:57.905275 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:27:57.905438 (+   163us) write_op.cc:270] Start()
0709 12:27:57.905559 (+   121us) write_op.cc:276] Timestamp: P: 1783600077905379 usec, L: 0
0709 12:27:57.905579 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:27:57.906265 (+   686us) log.cc:844] Serialized 3601 byte log entry
0709 12:27:57.961828 (+ 55563us) op_driver.cc:464] REPLICATION: finished
0709 12:27:57.962251 (+   423us) write_op.cc:301] APPLY: starting
0709 12:27:57.962333 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:57.966551 (+  4218us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:57.966907 (+   356us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:57.971598 (+  4691us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:57.971802 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:27:57.971851 (+    49us) write_op.cc:312] APPLY: finished
0709 12:27:57.972117 (+   266us) log.cc:844] Serialized 89 byte log entry
0709 12:27:57.974749 (+  2632us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:57.974872 (+   123us) write_op.cc:454] Released schema lock
0709 12:27:57.974918 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:57.975259 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:57.975286 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":125,"apply.run_cpu_time_us":10307,"apply.run_wall_time_us":12987,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37620,"num_ops":9,"prepare.queue_time_us":47552,"prepare.run_cpu_time_us":3765,"prepare.run_wall_time_us":3764,"replication_time_us":56087,"thread_start_us":47181,"threads_started":1}]]}
I20260709 12:27:58.074113 21970 catalog_manager.cc:5697] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 8, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 8 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:58.082006 21970 catalog_manager.cc:5697] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:58.089303 20917 tablet_replica.cc:333] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.090683 20917 raft_consensus.cc:2243] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:58.083282 21970 catalog_manager.cc:5697] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 9, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 9 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.102077 20917 raft_consensus.cc:2272] T 6b8326670393490f9fabe3827cd6d958 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.105203 20917 tablet_replica.cc:333] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.106035 20917 raft_consensus.cc:2243] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.106961 20917 raft_consensus.cc:2272] T e92d357da9e844b2ae270e73b28170db P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.109943 20917 tablet_replica.cc:333] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.110769 20917 raft_consensus.cc:2243] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.099226 21970 catalog_manager.cc:5697] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 9 to 10, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 10 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.113899 21970 catalog_manager.cc:5697] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 2 to 9, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 9 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.115618 21970 catalog_manager.cc:5697] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:58.117283 20917 raft_consensus.cc:2272] T 9360ea2e8bd04bd899235529e921b05d P d465f3cb42174eb89615dcd747f9e682 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.117051 21970 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 10, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 10 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.118762 21970 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.120309 20917 tablet_replica.cc:333] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.121207 20917 raft_consensus.cc:2243] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.120359 21970 catalog_manager.cc:5697] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.123232 21970 catalog_manager.cc:5697] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.124828 21970 catalog_manager.cc:5697] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:58.126266 21970 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.128362 20917 raft_consensus.cc:2272] T 0ae34788927d43db8e0aa62c5dae8dd9 P d465f3cb42174eb89615dcd747f9e682 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.131258 20917 tablet_replica.cc:333] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.132403 20917 raft_consensus.cc:2243] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:58.133598 20917 raft_consensus.cc:2272] T 7e4753dcc01343d1b0ac9cef09e22af4 P d465f3cb42174eb89615dcd747f9e682 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.136473 20917 tablet_replica.cc:333] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.137219 20917 raft_consensus.cc:2243] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.137773 20917 pending_rounds.cc:70] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Trying to abort 2 pending ops.
I20260709 12:27:58.127556 21970 catalog_manager.cc:5697] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 7, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 7 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.140147 21970 catalog_manager.cc:5697] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.141723 21970 catalog_manager.cc:5697] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:58.143980 21970 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 8 to 11, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 11 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.145365 21970 catalog_manager.cc:5697] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 6, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 6 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.147006 21970 catalog_manager.cc:5697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 6, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 6 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.148517 21970 catalog_manager.cc:5697] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 7, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 7 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:58.138204 20917 pending_rounds.cc:77] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 5 index: 8 } timestamp: 7305625806969389056 op_type: NO_OP noop_request { }
I20260709 12:27:58.150763 20917 raft_consensus.cc:2889] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:58.151090 20917 pending_rounds.cc:77] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682: Aborting op as it isn't in flight: id { term: 4 index: 7 } timestamp: 7305625756752576512 op_type: NO_OP noop_request { }
I20260709 12:27:58.151420 20917 raft_consensus.cc:2889] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:58.151760 20917 raft_consensus.cc:2272] T 03eee184731a4ec1bf7ba98505a56567 P d465f3cb42174eb89615dcd747f9e682 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.156818 20917 tablet_replica.cc:333] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682: stopping tablet replica
I20260709 12:27:58.157593 20917 raft_consensus.cc:2243] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:58.158192 20917 raft_consensus.cc:2272] T 754c2d759050420898a081f3dfa0a18c P d465f3cb42174eb89615dcd747f9e682 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:58.149766 21970 catalog_manager.cc:5697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 7, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 7 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.165925 22142 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:58.167739 25845 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:58.167119 21970 catalog_manager.cc:5697] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 9, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 9 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:58.191265 22801 raft_consensus.cc:1275] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:58.192761 25908 consensus_queue.cc:1048] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:27:58.192480 21970 catalog_manager.cc:5697] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } }
I20260709 12:27:58.198333 21970 catalog_manager.cc:5697] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 5 to 6, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 6 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:27:58.468683 22114 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:58.515331 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 55425.6us
W20260709 12:27:58.633854 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.660321 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:58.699141 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 48437.6us
W20260709 12:27:58.700978 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:58.734807 26000 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.736056 26000 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:58.771104 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 66001.1us
I20260709 12:27:58.779387 25936 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:58.780565 25936 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:58.783881 25936 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:58.785670 26000 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:58.785894 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 46012.1us
I20260709 12:27:58.797947 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:58.798724 26013 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:58.799166 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:58.799896 22213 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 14.
I20260709 12:27:58.799641 26013 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:58.799355 22218 raft_consensus.cc:2393] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 12: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:58.802330 26013 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:58.807379 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:58.808452 22218 raft_consensus.cc:2393] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 11: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:58.809537 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:58.823549 26013 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:58.824095 26013 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.824522 26013 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:58.847711 26013 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:58.851624 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:58.852248 22218 raft_consensus.cc:3060] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:27:58.862534 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 66054.9us
I20260709 12:27:58.869042 26013 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 16 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:58.870326 22218 raft_consensus.cc:2468] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 16.
I20260709 12:27:58.872383 22113 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:58.873395 26012 raft_consensus.cc:2804] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:58.873937 26012 raft_consensus.cc:697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 16 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:58.875597 26012 consensus_queue.cc:237] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:58.876762 25995 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.877418 25995 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:58.880916 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:58.881614 22220 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:58.882681 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:58.883435 26013 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:58.883876 26013 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.884280 26013 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:58.886050 25995 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:58.892761 26013 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:58.928004 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:58.931932 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:58.936097 25995 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:58.942656 25995 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:58.946988 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:58.948357 25995 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:58.949986 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:58.951009 22214 raft_consensus.cc:2393] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 9: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:58.955041 26013 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:58.957453 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:58.958209 22214 raft_consensus.cc:3060] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:58.971292 22114 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:58.977255 22114 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:58.978246 26013 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:58.978583 22114 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:58.979557 22114 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:58.979930 22114 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:58.991858 26013 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:58.994752 26012 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:59.006017 26012 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:59.007478 22114 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:59.008580 22114 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.008308 21969 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 6 to 9, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to d465f3cb42174eb89615dcd747f9e682 (127.20.109.65). New cstate: current_term: 9 leader_uuid: "d465f3cb42174eb89615dcd747f9e682" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:59.019510 21970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 333) took 1317 ms. Trace:
W20260709 12:27:59.021260 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.022994 22114 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:59.024701 26013 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:59.030812 22214 raft_consensus.cc:2468] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:59.032189 22113 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:59.037034 25995 raft_consensus.cc:2804] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:59.037648 25995 raft_consensus.cc:697] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:59.038956 25995 consensus_queue.cc:237] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.041356 26013 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:59.020059 21970 rpcz_store.cc:276] 0709 12:27:57.703832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:57.706773 (+  2941us) service_pool.cc:224] Handling call
0709 12:27:59.019238 (+1312465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:58.219307 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:58.219818 (+   511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:58.219852 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:27:58.219864 (+    12us) tablet.cc:662] Decoding operations
0709 12:27:58.221889 (+  2025us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:58.221948 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:58.221978 (+    30us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:27:58.228535 (+  6557us) tablet.cc:701] Row locks acquired
0709 12:27:58.228552 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:27:58.228703 (+   151us) write_op.cc:270] Start()
0709 12:27:58.228832 (+   129us) write_op.cc:276] Timestamp: P: 1783600078228655 usec, L: 0
0709 12:27:58.228852 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:27:58.231288 (+  2436us) log.cc:844] Serialized 9009 byte log entry
0709 12:27:58.242533 (+ 11245us) op_driver.cc:464] REPLICATION: finished
0709 12:27:58.243264 (+   731us) write_op.cc:301] APPLY: starting
0709 12:27:58.243372 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:58.528837 (+285465us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:58.530741 (+  1904us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:58.892637 (+361896us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:58.893299 (+   662us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=0,mrs_lookups=0
0709 12:27:58.893345 (+    46us) write_op.cc:312] APPLY: finished
0709 12:27:58.893981 (+   636us) log.cc:844] Serialized 204 byte log entry
0709 12:27:58.897044 (+  3063us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:58.897692 (+   648us) write_op.cc:454] Released schema lock
0709 12:27:58.897779 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:58.937586 (+ 39807us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:58.937624 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20016,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":382,"apply.run_cpu_time_us":36810,"apply.run_wall_time_us":694208,"cfile_cache_hit":92,"cfile_cache_hit_bytes":96140,"num_ops":23,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":5457,"prepare.run_wall_time_us":21643,"replication_time_us":13519}]]}
W20260709 12:27:59.063012 22114 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.070961 26013 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.071756 26013 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.078620 26004 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.079341 26004 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.080981 25936 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.081727 25936 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.083976 25936 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:59.084486 26004 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.084486 25936 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.085664 25936 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.086227 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:27:59.087270 22776 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.087944 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:59.091636 25936 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:59.094820 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:59.091912 26013 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:59.111624 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:59.113220 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:59.141795 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:59.143455 22773 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.144260 26004 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:59.154740 26013 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.156033 25845 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.156625 25845 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.155653 26013 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:59.160902 22114 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.161468 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.162081 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.162231 26012 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:59.162774 22142 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 11.
W20260709 12:27:59.163957 22114 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.164194 25845 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.165508 26013 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:59.166405 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.171036 22185 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.172825 25845 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:59.173237 25845 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.173571 25845 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:59.188514 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:59.196516 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.201352 26012 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:59.202329 25908 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.202940 25908 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.205153 25908 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.205857 26003 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:59.200634 22114 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.209739 22114 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.199321 26013 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.213303 25999 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.213927 25999 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.216740 25999 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.215381 21971 catalog_manager.cc:5697] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 10 to 11, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 11 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:59.221283 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.222110 22148 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 9.
I20260709 12:27:59.221366 25907 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.223939 25907 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:59.224404 21969 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46396 (request call id 332) took 11687 ms (client timeout 15000 ms). Trace:
I20260709 12:27:59.226454 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:27:59.224864 21969 rpcz_store.cc:269] 0709 12:27:47.537240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.813336 (+276096us) service_pool.cc:224] Handling call
0709 12:27:59.224311 (+11410975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:59.055951 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:59.056646 (+   695us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:59.056705 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:27:59.056741 (+    36us) tablet.cc:662] Decoding operations
0709 12:27:59.057198 (+   457us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:59.057308 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:59.057344 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:59.057688 (+   344us) tablet.cc:701] Row locks acquired
0709 12:27:59.060043 (+  2355us) write_op.cc:260] PREPARE: finished
0709 12:27:59.060291 (+   248us) write_op.cc:270] Start()
0709 12:27:59.060479 (+   188us) write_op.cc:276] Timestamp: P: 1783600079060198 usec, L: 0
0709 12:27:59.060512 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:27:59.061522 (+  1010us) log.cc:844] Serialized 536 byte log entry
0709 12:27:59.149340 (+ 87818us) op_driver.cc:464] REPLICATION: finished
0709 12:27:59.150105 (+   765us) write_op.cc:301] APPLY: starting
0709 12:27:59.150239 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:59.151177 (+   938us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:59.151288 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:59.151974 (+   686us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:59.152138 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:27:59.152188 (+    50us) write_op.cc:312] APPLY: finished
0709 12:27:59.152402 (+   214us) log.cc:844] Serialized 25 byte log entry
0709 12:27:59.152578 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:59.152673 (+    95us) write_op.cc:454] Released schema lock
0709 12:27:59.152719 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":42115,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":149,"apply.run_cpu_time_us":3002,"apply.run_wall_time_us":4897,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":9235,"prepare.run_cpu_time_us":3647,"prepare.run_wall_time_us":5941,"replication_time_us":88621,"thread_start_us":13175,"threads_started":1}]]}
I20260709 12:27:59.226212 25907 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.236485 21971 catalog_manager.cc:5697] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 5 to 6, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 6 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.199172 25845 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.213218 26013 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.206446 26003 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.245505 22185 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:59.249531 25936 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.252354 25936 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:59.253119 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:59.253355 26003 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.249740 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.250116 25993 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.255862 25993 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.244310 21971 catalog_manager.cc:5697] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 9 to 10, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 10 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.259301 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:59.259932 22803 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 11.
I20260709 12:27:59.219235 25995 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:59.257045 22143 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 8.
I20260709 12:27:59.262701 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.263396 22148 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 10.
I20260709 12:27:59.258375 25993 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:59.251209 26000 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.264420 26000 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.259868 21971 catalog_manager.cc:5697] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 7 to 9, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 9 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.254539 25936 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:59.266572 26000 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:59.251600 25845 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.271318 22185 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:59.267791 22776 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.270772 25999 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:59.278712 25999 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.279111 25999 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:59.281128 22773 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.268455 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:59.282045 26014 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:59.267741 26013 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:59.270551 22188 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.282763 26014 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.283234 26014 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:59.286024 25907 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:59.286456 25907 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
W20260709 12:27:59.284106 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.286885 25907 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:59.286988 22188 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.287817 26013 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:59.288373 26013 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.288757 26013 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:59.288874 25908 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:59.299000 22114 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.305239 22114 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:27:59.268528 21971 catalog_manager.cc:5697] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 4 to 7, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 7 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.313359 25845 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.313835 26000 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:59.319450 25845 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.320241 25993 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.321077 25993 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.322749 25845 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.324774 25999 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.327476 25993 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:59.333938 25999 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:59.336614 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 52508.5us
I20260709 12:27:59.338474 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:59.342375 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.343168 22142 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 7.
I20260709 12:27:59.344749 26014 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.345865 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:59.351017 22148 raft_consensus.cc:3060] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:59.352521 26014 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.347316 26004 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.366132 26004 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.368431 26004 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.369517 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:59.370242 22220 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:59.370954 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:59.371634 22218 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:59.372058 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.372687 22143 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:27:59.373207 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:27:59.374359 22113 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:59.374900 22773 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:59.361567 26011 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.376245 26011 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.376734 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:59.378024 26019 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:59.378459 26019 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.379032 26019 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:59.360646 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:59.380048 22142 raft_consensus.cc:3060] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:59.375624 25993 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:59.382087 25993 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.378468 26011 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.383647 21970 catalog_manager.cc:5697] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 12 to 16, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 16 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.382524 25993 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:59.392993 22142 raft_consensus.cc:2468] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 11.
I20260709 12:27:59.394855 26014 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:59.395325 26014 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.395725 26014 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:59.391024 26019 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.401585 22773 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:59.400763 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 58757.1us
I20260709 12:27:59.404744 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:59.405647 22143 raft_consensus.cc:3060] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:59.413406 26011 raft_consensus.cc:2804] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:59.414089 26011 raft_consensus.cc:697] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:59.415100 26011 consensus_queue.cc:237] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:59.365577 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.419991 26019 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:27:59.420563 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 55003.3us
I20260709 12:27:59.421195 25996 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.421885 25996 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:59.421454 22114 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:59.423401 22114 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.424410 25996 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.425038 25996 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.425557 25996 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.427892 25996 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.432149 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.432834 22146 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 10.
I20260709 12:27:59.432884 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.433741 22140 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 13.
W20260709 12:27:59.433910 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.404122 21970 catalog_manager.cc:5697] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 4 to 8, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 8 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.437686 25907 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.437916 21970 catalog_manager.cc:5697] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:27:59.439100 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:59.439263 22214 raft_consensus.cc:2393] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 9: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:27:59.439682 22213 raft_consensus.cc:3060] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:59.443820 22188 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:59.424566 22114 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.433435 22148 raft_consensus.cc:2468] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 12.
I20260709 12:27:59.448807 22143 raft_consensus.cc:2468] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 10.
I20260709 12:27:59.404747 22185 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:59.455701 22773 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:59.455308 22113 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:27:59.457978 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.458384 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:59.459136 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 54596.4us
W20260709 12:27:59.456986 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:59.461680 22185 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:27:59.464421 22188 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.470216 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.471578 25999 raft_consensus.cc:2804] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:59.471807 26001 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:59.472298 26001 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.472657 26001 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:59.473100 25907 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.475729 22213 raft_consensus.cc:2468] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:27:59.461153 26004 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:59.476722 22114 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.481448 22114 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.482474 25999 raft_consensus.cc:697] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:59.481426 22113 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:27:59.468959 26014 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.463560 26019 raft_consensus.cc:3060] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:59.496007 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:27:59.499253 22188 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.499660 22185 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.513231 26012 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.513883 26012 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.516324 26012 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:59.516980 26012 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:59.529404 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 62559.8us
I20260709 12:27:59.479437 25845 raft_consensus.cc:2764] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:59.529537 22218 raft_consensus.cc:1275] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:27:59.495982 26004 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.527526 25995 raft_consensus.cc:2804] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:59.543542 21971 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38180 (request call id 211) took 1365 ms. Trace:
I20260709 12:27:59.543942 26020 raft_consensus.cc:2804] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:59.553941 26020 raft_consensus.cc:697] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:59.536577 26004 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:59.544018 21971 rpcz_store.cc:276] 0709 12:27:58.178532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.178692 (+   160us) service_pool.cc:224] Handling call
0709 12:27:59.543471 (+1364779us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:59.362897 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:59.363443 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:59.363476 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:27:59.363492 (+    16us) tablet.cc:662] Decoding operations
0709 12:27:59.364167 (+   675us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:59.364227 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:59.364253 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:27:59.364768 (+   515us) tablet.cc:701] Row locks acquired
0709 12:27:59.364782 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:27:59.364915 (+   133us) write_op.cc:270] Start()
0709 12:27:59.365032 (+   117us) write_op.cc:276] Timestamp: P: 1783600079364874 usec, L: 0
0709 12:27:59.365047 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:27:59.365669 (+   622us) log.cc:844] Serialized 2069 byte log entry
0709 12:27:59.367587 (+  1918us) op_driver.cc:464] REPLICATION: finished
0709 12:27:59.368064 (+   477us) write_op.cc:301] APPLY: starting
0709 12:27:59.368137 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:59.374521 (+  6384us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:59.374631 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:59.378163 (+  3532us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:59.378350 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:27:59.378425 (+    75us) write_op.cc:312] APPLY: finished
0709 12:27:59.378678 (+   253us) log.cc:844] Serialized 57 byte log entry
0709 12:27:59.378853 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:59.378959 (+   106us) write_op.cc:454] Released schema lock
0709 12:27:59.379007 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:59.379419 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:59.379453 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":28867,"mutex_wait_us":18721,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":262,"apply.run_cpu_time_us":7333,"apply.run_wall_time_us":11288,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20900,"num_ops":5,"prepare.queue_time_us":28401,"prepare.run_cpu_time_us":3062,"prepare.run_wall_time_us":3062,"replication_time_us":2397}]]}
I20260709 12:27:59.560761 26023 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.561342 26014 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.561375 26023 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.563910 26023 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.565141 25936 consensus_queue.cc:1048] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:59.554803 25999 consensus_queue.cc:237] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.554176 26013 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:59.559984 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 83288.4us
I20260709 12:27:59.577872 25995 raft_consensus.cc:697] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:59.579205 25995 consensus_queue.cc:237] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:59.582041 22114 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.586573 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:59.587345 22804 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:27:59.588907 25993 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.591136 26020 consensus_queue.cc:237] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:59.599153 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:59.601174 26019 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:59.647769 25993 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:27:59.649580 26013 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:27:59.651028 22114 consensus_peers.cc:597] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:59.598973 26001 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:27:59.672739 22114 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.674372 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.676290 22148 raft_consensus.cc:2468] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 9.
I20260709 12:27:59.677502 26019 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.679908 26012 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:59.680377 26012 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.680761 26012 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:59.683939 22185 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.685225 26001 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.685695 26021 raft_consensus.cc:2804] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:59.686281 26021 raft_consensus.cc:697] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:27:59.678107 26019 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.697880 26019 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:59.687227 26021 consensus_queue.cc:237] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.700305 26004 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.711215 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:59.712366 22803 raft_consensus.cc:3060] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:59.711205 22114 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.713922 26004 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.726859 22803 raft_consensus.cc:2468] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 12.
W20260709 12:27:59.741220 22114 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:59.743588 22114 consensus_peers.cc:597] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:59.751183 22114 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.756407 26012 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.759104 26012 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:27:59.757083 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:27:59.768934 22810 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 5.
I20260709 12:27:59.751443 26021 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.770480 26021 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:27:59.771286 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 237124us
I20260709 12:27:59.785570 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:59.785750 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.786206 22148 raft_consensus.cc:3060] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:59.786288 22143 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 5.
W20260709 12:27:59.777480 22114 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.794345 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:27:59.795059 22213 raft_consensus.cc:3060] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:59.797786 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:59.798460 22143 raft_consensus.cc:3060] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:59.799135 22214 raft_consensus.cc:1275] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:59.803018 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:59.803658 22146 raft_consensus.cc:3060] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:27:59.806300 22776 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:59.807282 22776 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.807967 26030 consensus_queue.cc:1048] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:27:59.808288 22776 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.809788 22776 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.814721 22143 raft_consensus.cc:2468] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 11.
I20260709 12:27:59.815254 22773 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
W20260709 12:27:59.820384 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:59.824520 26003 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:59.824976 26003 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.825377 26003 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:59.823927 22146 raft_consensus.cc:2468] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 14.
I20260709 12:27:59.829325 22148 raft_consensus.cc:2468] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:27:59.833165 25996 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:59.833249 22773 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:59.843806 26023 raft_consensus.cc:2804] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:59.843971 22773 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:59.844452 26023 raft_consensus.cc:697] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:59.845011 22773 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:27:59.846160 26014 raft_consensus.cc:2804] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:59.846861 26014 raft_consensus.cc:697] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 14 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:59.847271 26025 raft_consensus.cc:2804] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:59.847875 26025 raft_consensus.cc:697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:27:59.848865 26025 consensus_queue.cc:237] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.849455 26014 consensus_queue.cc:237] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.845566 26023 consensus_queue.cc:237] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.852044 22803 consensus_queue.cc:237] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.856787 22213 raft_consensus.cc:2468] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
W20260709 12:27:59.832052 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:59.864679 22776 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.866904 22113 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
W20260709 12:27:59.874320 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.878365 22112 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.879864 22112 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.881089 26019 raft_consensus.cc:2804] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:59.845144 26003 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.895872 22146 raft_consensus.cc:1275] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:59.900128 26021 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:27:59.900496 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:59.888728 26030 raft_consensus.cc:2804] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:59.888499 25936 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:59.889060 26019 raft_consensus.cc:697] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:59.909652 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:27:59.910706 22146 raft_consensus.cc:2410] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:27:59.910373 22776 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.908080 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:27:59.914944 22802 raft_consensus.cc:3060] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:59.916036 22776 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:59.917886 22776 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:59.919035 22776 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.907445 25936 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d465f3cb42174eb89615dcd747f9e682)
I20260709 12:27:59.913039 26030 raft_consensus.cc:697] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:27:59.923282 25936 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:59.931247 26019 consensus_queue.cc:237] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:27:59.905197 25996 consensus_queue.cc:1048] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:27:59.939098 22802 raft_consensus.cc:2468] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
W20260709 12:27:59.932673 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:59.941708 22188 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.946573 26003 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:27:59.946913 25845 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:59.967393 26030 consensus_queue.cc:237] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:27:59.973459 21970 catalog_manager.cc:5697] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 10 to 11, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 11 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.977145 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:27:59.979544 22112 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:27:59.972720 21971 catalog_manager.cc:5697] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 8, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 8 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.981200 25995 raft_consensus.cc:2804] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:59.994055 25995 raft_consensus.cc:697] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:28:00.008749 25995 consensus_queue.cc:237] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:00.024534 26038 log.cc:927] Time spent T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: Append to log took a long time: real 0.258s	user 0.006s	sys 0.000s
I20260709 12:28:00.041169 22148 raft_consensus.cc:1275] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:00.043054 26021 consensus_queue.cc:1048] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:00.045025 22215 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:28:00.048549 22143 raft_consensus.cc:1275] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:28:00.051616 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:00.062500 22188 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:00.062463 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 66994.7us
I20260709 12:28:00.080062 25936 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:00.083009 22146 raft_consensus.cc:2393] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in current term 6: Already voted for candidate 67742f291ab04f8b8335d3919cf2d1f7 in this term.
W20260709 12:28:00.087949 22188 connection.cc:769] client connection to 127.20.109.65:38979 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:28:00.088774 22188 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:00.091282 22216 raft_consensus.cc:1275] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:28:00.048791 26001 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:28:00.095198 26025 consensus_queue.cc:1048] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:28:00.072793 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.105070 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:00.110355 21967 catalog_manager.cc:5697] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 10 to 12, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 12 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:00.120069 21967 catalog_manager.cc:5697] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 9 to 10, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 10 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:00.131086 22146 raft_consensus.cc:1275] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:00.121534 21967 catalog_manager.cc:5697] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 8 to 9, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 9 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:00.143458 22776 connection.cc:769] client connection to 127.20.109.65:38979 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:28:00.135671 26021 consensus_queue.cc:1048] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:28:00.169986 25936 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:00.155378 26013 consensus_queue.cc:1048] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:28:00.200030 22142 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:00.202519 25845 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:00.246050 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:28:00.247407 22810 raft_consensus.cc:2393] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 6: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:28:00.277690 25996 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:28:00.287225 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:00.287789 22776 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:00.288164 22776 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:00.289841 26025 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:28:00.293625 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:00.315042 22140 raft_consensus.cc:1275] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:28:00.307600 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:00.326295 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:00.349972 26059 log.cc:927] Time spent T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:28:00.351495 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:00.352160 22114 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:00.352586 22114 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:00.355232 26030 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:00.335279 26001 consensus_queue.cc:1048] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 12:28:00.392715 22188 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:00.394444 22215 raft_consensus.cc:1275] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:00.342710 22140 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:00.391739 22216 raft_consensus.cc:2955] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:00.413932 22148 raft_consensus.cc:1275] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:28:00.415236 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.416275 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:00.417311 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:00.418883 26031 consensus_queue.cc:1048] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:00.421195 26067 consensus_queue.cc:1048] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:00.429551 21956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2d181824b34483d8653c405c650ec94 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:28:00.434082 22148 raft_consensus.cc:1275] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:28:00.431007 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:28:00.438402 26066 consensus_queue.cc:1048] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:28:00.441160 22804 raft_consensus.cc:1275] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:28:00.453387 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:00.454120 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:00.453171 25995 consensus_queue.cc:1048] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 12:28:00.504223 22114 consensus_peers.cc:597] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:00.541842 22114 consensus_peers.cc:597] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:00.546213 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:00.549033 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:00.550886 22810 raft_consensus.cc:1275] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:00.552435 26030 consensus_queue.cc:1048] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:28:00.558059 26072 log.cc:927] Time spent T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:28:00.572413 26077 log.cc:927] Time spent T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:28:00.605290 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:00.642149 21971 catalog_manager.cc:5697] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 11 to 12, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 12 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:00.643069 26069 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.643611 26069 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:00.643893 21971 catalog_manager.cc:5697] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 8 to 9, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 9 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:00.645712 21971 catalog_manager.cc:5697] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 8, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 8 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:00.646837 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:00.647699 22146 raft_consensus.cc:2410] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:28:00.648597 26069 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:00.657905 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:00.660552 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.681195 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:00.681694 22188 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:00.682435 26069 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:00.647495 21971 catalog_manager.cc:5697] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 7 to 8, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 8 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.692600 21971 catalog_manager.cc:5697] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 10 to 11, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 11 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:00.696916 21971 catalog_manager.cc:5697] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 13 to 14, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 14 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:00.698700 21971 catalog_manager.cc:5697] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 5 to 7, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 7 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:00.785712 26035 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.786298 26035 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:00.788556 26035 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:00.791044 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:00.791761 22213 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 9.
I20260709 12:28:00.793165 22113 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:28:00.795220 25993 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:00.795650 25993 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.796000 25993 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:00.801605 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:00.818346 25993 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:00.825858 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2d9646522845819383a8daea185649" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:28:00.826542 22213 raft_consensus.cc:3060] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:00.838917 22114 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:00.862730 25993 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:00.869481 22213 raft_consensus.cc:2468] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 10.
I20260709 12:28:00.873967 22113 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:00.875881 26035 raft_consensus.cc:2804] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:00.876364 26035 raft_consensus.cc:697] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:28:00.886085 26035 consensus_queue.cc:237] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:28:00.917055 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a2d181824b34483d8653c405c650ec94: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:00.922145 21970 catalog_manager.cc:5697] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 8 to 10, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 10 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:00.980329 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:01.062552 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:01.068302 26035 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.068921 26035 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:28:01.074246 22114 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:01.077564 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:01.078347 22215 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 12.
W20260709 12:28:01.080485 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:01.080770 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:28:01.081570 25993 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:01.081972 25993 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.082312 25993 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:01.085377 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:28:01.083413 26035 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:01.094852 25993 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:28:01.097772 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:28:01.099066 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd4242f251b46f1a7e47490973fd53c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:28:01.099710 22215 raft_consensus.cc:3060] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:01.112003 22215 raft_consensus.cc:2468] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 13.
I20260709 12:28:01.113394 22113 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:28:01.114355 26035 raft_consensus.cc:2804] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:01.114871 26035 raft_consensus.cc:697] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:28:01.115784 26035 consensus_queue.cc:237] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:28:01.095865 22114 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:01.125813 25993 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:28:01.133394 22114 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:01.137089 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:01.149607 21970 catalog_manager.cc:5697] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 11 to 13, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 13 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:01.187741 22188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111) [suppressed 366 similar messages]
W20260709 12:28:01.202032 20917 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22094)
I20260709 12:28:01.287241 22213 raft_consensus.cc:1275] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:01.288925 25993 consensus_queue.cc:1048] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:28:01.421525 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 61051.9us
W20260709 12:28:01.422785 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:01.496042 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 64846.2us
W20260709 12:28:01.535208 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:01.536543 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.537093 22114 consensus_peers.cc:597] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:01.562127 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 57428.5us
W20260709 12:28:01.700548 22114 consensus_peers.cc:597] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:01.738390 22213 raft_consensus.cc:1275] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:01.745127 26035 consensus_queue.cc:1048] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:28:01.754480 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:01.907460 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:01.959331 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:01.987615 26098 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.988199 26098 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:01.990206 26098 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:02.010140 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:02.010882 22148 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:28:02.012530 22773 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 
I20260709 12:28:02.013408 26095 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:02.013837 26095 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.014168 26095 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:02.055655 22114 consensus_peers.cc:597] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:02.064090 22776 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:02.080281 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:02.110040 26095 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:02.125933 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:28:02.126557 22148 raft_consensus.cc:3060] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:02.131560 26095 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:02.135339 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:02.145582 22776 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:02.154729 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:02.155556 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:02.163956 22148 raft_consensus.cc:2468] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 7.
I20260709 12:28:02.166525 22773 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:02.167912 26089 raft_consensus.cc:2804] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:02.168460 26089 raft_consensus.cc:697] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:28:02.170217 26089 consensus_queue.cc:237] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:02.179072 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.196411 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a2d181824b34483d8653c405c650ec94: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:02.202519 20917 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22094)
I20260709 12:28:02.209710 21970 catalog_manager.cc:5697] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 5 to 7, leader changed from d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 7 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:02.236910 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:02.251519 22114 consensus_peers.cc:597] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:02.279847 22148 consensus_queue.cc:237] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:02.300117 22213 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:28:02.301155 22112 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7199ba25bca48e89b961cf6ef78ab28. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.302572 26091 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:28:02.315989 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.349102 26035 raft_consensus.cc:2955] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.368898 22213 raft_consensus.cc:2955] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.393010 21971 catalog_manager.cc:5697] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 9 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.400286 22148 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:28:02.467494 22112 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12cca886b64e4c138e59114be95a8549. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.472343 22213 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:02.477660 26090 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:28:02.487741 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:02.499913 22114 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:02.526356 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:02.549984 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:02.555250 26035 raft_consensus.cc:2955] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.557205 22213 raft_consensus.cc:2955] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
W20260709 12:28:02.572142 22188 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:02.607661 21971 catalog_manager.cc:5697] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 9 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.625656 22148 consensus_queue.cc:237] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
W20260709 12:28:02.635263 22188 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:02.631115 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:02.661967 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:02.673857 22213 raft_consensus.cc:1275] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:02.679811 26035 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:28:02.685889 22776 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:02.689708 22112 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9f4ba2e44d142d4810d14babd35c984. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:02.691057 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.705387 22148 raft_consensus.cc:1275] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:02.709127 26095 consensus_queue.cc:1048] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:02.710711 26090 raft_consensus.cc:2955] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.720352 22213 raft_consensus.cc:2955] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.741591 21971 catalog_manager.cc:5697] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index -1 to 4, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
W20260709 12:28:02.753208 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:02.810271 26124 ts_tablet_manager.cc:933] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:02.827445 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:02.830535 26124 tablet_copy_client.cc:323] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:28:02.843660 22214 consensus_queue.cc:237] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:02.849834 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet e7199ba25bca48e89b961cf6ef78ab28 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:28:02.850629 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet e7199ba25bca48e89b961cf6ef78ab28 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-e7199ba25bca48e89b961cf6ef78ab28
I20260709 12:28:02.880515 22158 tablet_copy_source_session.cc:215] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:28:02.884325 26124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7199ba25bca48e89b961cf6ef78ab28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:02.887269 22186 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677): Couldn't send request to peer 7ff8d9fd78c1454cacc77bbc1bfb992e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52ee10bae8ef4b668f33b9ef12e13a6a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.887667 22148 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:02.890241 26112 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:28:02.899233 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:02.923066 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:02.925155 22188 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.937031 26124 tablet_copy_client.cc:806] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
W20260709 12:28:02.937393 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:28:02.939133 26096 raft_consensus.cc:2955] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.942793 22146 raft_consensus.cc:2955] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.945866 26124 tablet_copy_client.cc:670] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
W20260709 12:28:02.948411 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:02.950443 26124 tablet_copy_client.cc:538] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:28:02.961335 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:02.962179 21971 catalog_manager.cc:5697] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index -1 to 7, NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) added. New cstate: current_term: 9 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } } }
I20260709 12:28:02.966981 26124 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
W20260709 12:28:02.981619 22114 consensus_peers.cc:597] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:03.052759 26124 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:03.053851 26124 tablet_bootstrap.cc:492] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:28:03.054649 26124 ts_tablet_manager.cc:1403] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.013s
I20260709 12:28:03.057720 26124 raft_consensus.cc:359] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:03.062742 26124 raft_consensus.cc:740] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:28:03.063508 26124 consensus_queue.cc:260] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:03.075479 26124 ts_tablet_manager.cc:1434] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:28:03.082862 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-e7199ba25bca48e89b961cf6ef78ab28 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:28:03.083417 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-e7199ba25bca48e89b961cf6ef78ab28 on tablet e7199ba25bca48e89b961cf6ef78ab28 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:03.087852 26124 ts_tablet_manager.cc:933] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:03.131306 26124 tablet_copy_client.cc:323] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:28:03.132901 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet 12cca886b64e4c138e59114be95a8549 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:28:03.133433 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet 12cca886b64e4c138e59114be95a8549 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-12cca886b64e4c138e59114be95a8549
W20260709 12:28:03.137012 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:03.145236 22158 tablet_copy_source_session.cc:215] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:28:03.146772 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:28:03.156147 26124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cca886b64e4c138e59114be95a8549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.178423 26124 tablet_copy_client.cc:806] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:28:03.179207 26124 tablet_copy_client.cc:670] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:28:03.184237 26124 tablet_copy_client.cc:538] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:28:03.187047 22804 raft_consensus.cc:1217] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:28:03.194010 26129 ts_tablet_manager.cc:933] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:03.201073 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:03.203042 20917 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22094)
I20260709 12:28:03.209837 26129 tablet_copy_client.cc:323] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.66:46283
I20260709 12:28:03.211714 22158 tablet_copy_service.cc:140] P 67742f291ab04f8b8335d3919cf2d1f7: Received BeginTabletCopySession request for tablet b9f4ba2e44d142d4810d14babd35c984 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:35998)
I20260709 12:28:03.212220 22158 tablet_copy_service.cc:161] P 67742f291ab04f8b8335d3919cf2d1f7: Beginning new tablet copy session on tablet b9f4ba2e44d142d4810d14babd35c984 from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:35998: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-b9f4ba2e44d142d4810d14babd35c984
I20260709 12:28:03.215287 26124 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:28:03.220126 22158 tablet_copy_source_session.cc:215] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:28:03.231930 26129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f4ba2e44d142d4810d14babd35c984. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:03.247481 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.256343 22114 consensus_peers.cc:597] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:03.339089 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:03.355218 26129 tablet_copy_client.cc:806] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:28:03.363135 26129 tablet_copy_client.cc:670] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
W20260709 12:28:03.362274 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a2d181824b34483d8653c405c650ec94: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:03.369076 26129 tablet_copy_client.cc:538] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:28:03.389220 26134 ts_tablet_manager.cc:933] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Initiating tablet copy from peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:28:03.392184 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:03.395031 26124 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:03.397845 26124 tablet_bootstrap.cc:492] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
W20260709 12:28:03.398433 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:28:03.401618 26124 ts_tablet_manager.cc:1403] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.187s	user 0.033s	sys 0.014s
I20260709 12:28:03.411715 26129 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:28:03.412524 26124 raft_consensus.cc:359] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:03.413676 26134 tablet_copy_client.cc:323] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Beginning tablet copy session from remote peer at address 127.20.109.67:37787
I20260709 12:28:03.431458 26124 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:28:03.439957 22232 tablet_copy_service.cc:140] P ecc1814bfd604baa9cc66be8c02c5cfa: Received BeginTabletCopySession request for tablet 52ee10bae8ef4b668f33b9ef12e13a6a from peer 7ff8d9fd78c1454cacc77bbc1bfb992e ({username='slave'} at 127.0.0.1:50756)
I20260709 12:28:03.440709 22232 tablet_copy_service.cc:161] P ecc1814bfd604baa9cc66be8c02c5cfa: Beginning new tablet copy session on tablet 52ee10bae8ef4b668f33b9ef12e13a6a from peer 7ff8d9fd78c1454cacc77bbc1bfb992e at {username='slave'} at 127.0.0.1:50756: session id = 7ff8d9fd78c1454cacc77bbc1bfb992e-52ee10bae8ef4b668f33b9ef12e13a6a
I20260709 12:28:03.441720 26124 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:03.451475 26124 ts_tablet_manager.cc:1434] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:28:03.459985 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-12cca886b64e4c138e59114be95a8549 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:28:03.460440 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-12cca886b64e4c138e59114be95a8549 on tablet 12cca886b64e4c138e59114be95a8549 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:03.456084 22232 tablet_copy_source_session.cc:215] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:28:03.469607 26134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ee10bae8ef4b668f33b9ef12e13a6a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:03.475039 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:03.523888 26134 tablet_copy_client.cc:806] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 0 data blocks...
I20260709 12:28:03.524952 26134 tablet_copy_client.cc:670] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:28:03.534719 26134 tablet_copy_client.cc:538] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:28:03.574779 26134 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap starting.
I20260709 12:28:03.581614 22804 raft_consensus.cc:1217] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:28:03.586619 26129 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:03.588171 26129 tablet_bootstrap.cc:492] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:28:03.589371 26129 ts_tablet_manager.cc:1403] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.026s
W20260709 12:28:03.610885 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.614187 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:03.606074 26129 raft_consensus.cc:359] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:03.623399 26129 raft_consensus.cc:740] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:28:03.624414 26129 consensus_queue.cc:260] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:03.632176 26129 ts_tablet_manager.cc:1434] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:28:03.637403 22158 tablet_copy_service.cc:342] P 67742f291ab04f8b8335d3919cf2d1f7: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-b9f4ba2e44d142d4810d14babd35c984 received from {username='slave'} at 127.0.0.1:35998
I20260709 12:28:03.637846 22158 tablet_copy_service.cc:434] P 67742f291ab04f8b8335d3919cf2d1f7: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-b9f4ba2e44d142d4810d14babd35c984 on tablet b9f4ba2e44d142d4810d14babd35c984 with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:03.667994 26090 raft_consensus.cc:1064] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:28:03.674446 26090 consensus_queue.cc:237] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:03.713227 26134 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:03.714412 26134 tablet_bootstrap.cc:492] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Bootstrap complete.
I20260709 12:28:03.715292 26134 ts_tablet_manager.cc:1403] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent bootstrapping tablet: real 0.145s	user 0.035s	sys 0.009s
I20260709 12:28:03.718672 26134 raft_consensus.cc:359] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:03.719550 26134 raft_consensus.cc:740] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Initialized, Role: LEARNER
I20260709 12:28:03.720257 26134 consensus_queue.cc:260] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: NON_VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: true } }
I20260709 12:28:03.724562 26134 ts_tablet_manager.cc:1434] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:28:03.728250 22232 tablet_copy_service.cc:342] P ecc1814bfd604baa9cc66be8c02c5cfa: Request end of tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-52ee10bae8ef4b668f33b9ef12e13a6a received from {username='slave'} at 127.0.0.1:50756
I20260709 12:28:03.728762 22232 tablet_copy_service.cc:434] P ecc1814bfd604baa9cc66be8c02c5cfa: ending tablet copy session 7ff8d9fd78c1454cacc77bbc1bfb992e-52ee10bae8ef4b668f33b9ef12e13a6a on tablet 52ee10bae8ef4b668f33b9ef12e13a6a with peer 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:03.738744 22804 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:03.740430 22213 raft_consensus.cc:1275] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:03.740515 26091 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:28:03.743186 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:03.776331 26091 consensus_queue.cc:1048] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:03.791337 22804 raft_consensus.cc:1217] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:28:03.807394 22804 raft_consensus.cc:1217] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:28:03.829128 26140 raft_consensus.cc:2955] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:03.839506 22214 raft_consensus.cc:2955] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:03.871382 21967 catalog_manager.cc:5697] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:03.898144 22804 raft_consensus.cc:2955] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:28:03.909538 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.925627 22114 consensus_peers.cc:597] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:03.930083 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:04.035085 26091 raft_consensus.cc:1064] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:28:04.038008 26091 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:04.060878 22804 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:04.063261 26140 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:04.065459 22213 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:04.067186 26035 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:28:04.077535 22114 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:04.095930 26140 raft_consensus.cc:2955] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.120260 22804 raft_consensus.cc:2955] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.134303 22214 raft_consensus.cc:2955] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.142580 21970 catalog_manager.cc:5697] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.182562 22146 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:04.203490 20917 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22094)
I20260709 12:28:04.207130 22213 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:04.210605 26091 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:04.229744 22810 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:04.229683 26035 raft_consensus.cc:1064] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
I20260709 12:28:04.232257 26035 consensus_queue.cc:237] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:04.238739 26091 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:04.240814 26090 raft_consensus.cc:2955] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:28:04.256297 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:04.247747 22214 raft_consensus.cc:2955] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.260243 21955 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12cca886b64e4c138e59114be95a8549 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:28:04.280448 22803 raft_consensus.cc:1275] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEARNER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:28:04.284075 26152 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:04.285274 22802 raft_consensus.cc:2955] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:28:04.290488 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:04.331828 21970 catalog_manager.cc:5697] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 8 to 9, VOTER d465f3cb42174eb89615dcd747f9e682 (127.20.109.65) evicted. New cstate: current_term: 9 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.351900 22213 raft_consensus.cc:1275] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:28:04.364429 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:04.369009 26151 consensus_queue.cc:1048] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:04.408959 25845 raft_consensus.cc:1064] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: attempting to promote NON_VOTER 7ff8d9fd78c1454cacc77bbc1bfb992e to VOTER
W20260709 12:28:04.410668 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:04.415290 25845 consensus_queue.cc:237] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:04.433228 22803 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEARNER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:04.433900 22148 raft_consensus.cc:1275] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:04.434996 26155 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:04.435745 26112 consensus_queue.cc:1048] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:04.441793 26152 raft_consensus.cc:2955] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.443794 22213 raft_consensus.cc:2955] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:28:04.454928 22188 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:04.459228 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:28:04.476838 22803 raft_consensus.cc:2955] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.481887 22802 raft_consensus.cc:2955] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.478657 26155 raft_consensus.cc:2955] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:28:04.509636 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12cca886b64e4c138e59114be95a8549: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:04.528885 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:04.528523 22148 raft_consensus.cc:2955] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
I20260709 12:28:04.533695 21967 catalog_manager.cc:5697] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 4 to 5, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:28:04.573542 22114 consensus_peers.cc:597] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:04.603116 22114 consensus_peers.cc:597] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:04.606710 21971 catalog_manager.cc:5697] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: config changed from index 7 to 8, 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } } }
W20260709 12:28:04.652153 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:04.696952 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.725121 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:04.794741 22114 consensus_peers.cc:597] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:04.815771 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:04.841356 22188 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:04.961747 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:05.051234 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:05.081815 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.111321 22776 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:05.139864 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.164943 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:05.171258 22188 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.184932 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:05.185667 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:05.196367 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:05.204206 20917 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:05.298166 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.471601 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:05.501909 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.508548 22114 consensus_peers.cc:597] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.654862 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:05.681515 22114 consensus_peers.cc:597] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.686447 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:05.744717 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.772846 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:06.848429 20917 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22094)
I20260709 12:28:06.962694 26169 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
W20260709 12:28:06.965821 21958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111) [suppressed 429 similar messages]
I20260709 12:28:06.972370 26169 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:07.005952 26176 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.006675 26176 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.009052 26176 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.009635 26176 raft_consensus.cc:493] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:06.988278 26169 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.020081 26171 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.020852 26171 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.030136 26182 raft_consensus.cc:493] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.031095 26182 raft_consensus.cc:515] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:07.010164 26176 raft_consensus.cc:515] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.052874 26176 leader_election.cc:290] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:28:07.044849 21958 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 79051.5us
I20260709 12:28:07.046269 26175 raft_consensus.cc:493] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:06.999327 26172 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.050479 26171 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.062494 26175 raft_consensus.cc:515] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.062418 26172 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:28:07.071110 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12cca886b64e4c138e59114be95a8549: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:07.078691 26175 leader_election.cc:290] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.081480 26172 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.091670 26179 raft_consensus.cc:493] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.092283 26182 leader_election.cc:290] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.092391 26179 raft_consensus.cc:515] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.094787 26181 raft_consensus.cc:493] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.095402 26181 raft_consensus.cc:515] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.098163 26171 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.098723 26171 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:07.227828 26188 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.228575 26188 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.231333 26189 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.232040 26189 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.239880 26184 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.240854 26184 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.244256 26184 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.245045 26184 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.247648 26184 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.302089 26168 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.302875 26168 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.305425 26168 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.309772 26187 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.310515 26187 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.313830 26187 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.339274 26168 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.340085 26168 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.342520 26168 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.361482 26185 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.394439 26185 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.397550 26185 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.364998 26189 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.383283 26184 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.388072 26187 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.401621 26187 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.404122 26187 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.390985 26188 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.432782 26188 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.433431 26188 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.435958 26188 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:28:07.553705 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 113372us
I20260709 12:28:07.611438 26181 leader_election.cc:290] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.637713 26181 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.638382 26181 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.640558 26181 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.641470 26181 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.640897 26171 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.668290 26188 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
W20260709 12:28:07.676349 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:07.677594 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:07.678252 22776 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:07.678932 26187 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.668330 26181 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:07.680460 26187 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.682433 26181 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.682945 26187 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.679422 26188 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.684834 26188 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:28:07.680401 22775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.018s
W20260709 12:28:07.685510 22775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.010s	sys 0.019s
I20260709 12:28:07.686859 26187 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.687364 26187 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:07.689258 22776 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:07.689831 22776 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:07.690616 22776 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:07.691150 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:07.693538 26180 raft_consensus.cc:493] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.694568 26168 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.695097 26168 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.697175 26168 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.697639 26168 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.698732 26189 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.699247 26189 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.694097 26180 raft_consensus.cc:515] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.701236 26189 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.698055 26168 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.703176 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:07.689473 26187 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.707425 26168 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.728817 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.801440 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.802065 22218 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 4.
I20260709 12:28:07.729442 26195 raft_consensus.cc:493] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.803524 26195 raft_consensus.cc:515] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.805657 26195 leader_election.cc:290] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.806107 26195 raft_consensus.cc:493] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.732712 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.808369 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.808961 22222 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:28:07.809754 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.734558 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.811542 22213 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 6.
I20260709 12:28:07.734964 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.736013 26194 raft_consensus.cc:493] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.812698 22214 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:28:07.812752 26194 raft_consensus.cc:515] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.814955 26194 leader_election.cc:290] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.737035 26197 raft_consensus.cc:493] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.815789 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.752910 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.781252 26198 raft_consensus.cc:493] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.738029 26196 raft_consensus.cc:493] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.782711 26200 raft_consensus.cc:493] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.816993 26200 raft_consensus.cc:515] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:07.806526 26195 raft_consensus.cc:515] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.819068 26200 leader_election.cc:290] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.819198 26195 leader_election.cc:290] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.816629 26198 raft_consensus.cc:515] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.815596 26197 raft_consensus.cc:515] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.822265 26198 leader_election.cc:290] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.822755 26197 leader_election.cc:290] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.816694 26196 raft_consensus.cc:515] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.825228 26196 leader_election.cc:290] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:28:07.832669 22114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.007s	sys 0.026s
W20260709 12:28:07.833452 22114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.008s	sys 0.026s
I20260709 12:28:07.846563 26179 leader_election.cc:290] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:28:07.849023 20917 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:07.861001 22831 debug-util.cc:398] Leaking SignalData structure 0x7b080023bc40 after lost signal to thread 20920
W20260709 12:28:07.862310 22831 debug-util.cc:398] Leaking SignalData structure 0x7b080023bfc0 after lost signal to thread 22005
W20260709 12:28:07.871140 22831 debug-util.cc:398] Leaking SignalData structure 0x7b08003836a0 after lost signal to thread 22172
W20260709 12:28:07.872452 22831 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8420 after lost signal to thread 22246
I20260709 12:28:07.873564 26201 raft_consensus.cc:493] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.874310 26201 raft_consensus.cc:515] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:07.876721 26201 leader_election.cc:290] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:28:07.884765 22831 debug-util.cc:398] Leaking SignalData structure 0x7b08001160e0 after lost signal to thread 22834
I20260709 12:28:07.894567 26181 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.895418 26171 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:07.895269 26181 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:07.896004 26171 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.897590 26181 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:07.898219 26181 raft_consensus.cc:493] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.703271 26180 leader_election.cc:290] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.907917 26181 raft_consensus.cc:515] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.908098 26171 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.913504 26196 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.959810 26196 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.962006 26196 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.913880 26197 raft_consensus.cc:493] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.962782 26197 raft_consensus.cc:515] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } attrs { replace: true } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.965449 26197 leader_election.cc:290] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.931011 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:07.931830 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:07.931882 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953fcacc5a2943eeb23356e2f1c2cc5f" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:07.932278 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147ee46d74a94d69bbe00644cd192cc2" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:07.932677 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:07.933571 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:07.940733 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.945653 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b155a7c146564fdbb5330057eca55fd8" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:07.946296 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eee184731a4ec1bf7ba98505a56567" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:07.968298 22807 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 9.
I20260709 12:28:07.982087 26181 leader_election.cc:290] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:28:07.985461 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:07.986234 22188 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:07.986800 22188 leader_election.cc:336] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:07.987296 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:07.988487 26196 raft_consensus.cc:493] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.988993 26194 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.989408 26206 raft_consensus.cc:493] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
W20260709 12:28:07.989720 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 59754.3us
I20260709 12:28:07.989553 26194 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.989959 26206 raft_consensus.cc:515] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.989068 26196 raft_consensus.cc:515] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:07.991740 26194 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.992036 26206 leader_election.cc:290] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.992203 26194 raft_consensus.cc:493] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.988627 26200 raft_consensus.cc:493] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:07.993880 26200 raft_consensus.cc:515] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:07.992798 26196 leader_election.cc:290] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:07.995934 26200 leader_election.cc:290] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:07.993465 26194 raft_consensus.cc:515] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:07.988061 22188 leader_election.cc:336] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:07.998553 22188 leader_election.cc:336] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:07.999765 22188 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:07.985292 26197 raft_consensus.cc:493] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:08.000643 26197 raft_consensus.cc:515] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.000823 26200 raft_consensus.cc:493] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:07.998559 26194 leader_election.cc:290] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:08.001479 26200 raft_consensus.cc:515] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:08.004215 22188 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.009701 26198 raft_consensus.cc:493] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:08.009768 26194 raft_consensus.cc:493] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:08.010567 26194 raft_consensus.cc:515] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:08.016518 26204 raft_consensus.cc:493] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:08.017155 26204 raft_consensus.cc:515] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.018728 26201 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:08.019253 26201 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.019915 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4321547cceb341b9babe64debb9fb125" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.021337 26201 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:08.021848 26201 raft_consensus.cc:493] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:08.023041 26198 raft_consensus.cc:515] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.023694 26200 leader_election.cc:290] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:08.025187 26198 leader_election.cc:290] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:08.025767 26197 leader_election.cc:290] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:08.025925 26194 leader_election.cc:290] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:08.027287 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.036955 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e537942a08e4c8fbf26a1a0084997c4" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.041013 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca62bb8242354d418721b86a9b704e37" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.014541 22775 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.057930 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8326670393490f9fabe3827cd6d958" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.058130 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f024f1dc1c4aaaa8094ad37822a6e1" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.059845 22775 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:28:08.070963 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0cbcda6ab94ef68d36321d19671059" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.022269 26201 raft_consensus.cc:515] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.072549 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d181824b34483d8653c405c650ec94" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.073189 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ebd42ef0064f2489bbc02ec3e9500b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:28:08.076933 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 138687us
I20260709 12:28:08.076364 22775 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
I20260709 12:28:08.084412 26171 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:08.085565 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754c2d759050420898a081f3dfa0a18c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.085806 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.087067 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5b05d9a0b94a05a3cdb04bbe7113b2" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.079730 26168 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:08.090951 26168 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:08.091361 26168 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:08.091454 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfcc23bf9854a5e8cf97a83c188f631" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.091681 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.092932 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.096076 26179 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:08.094419 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4753dcc01343d1b0ac9cef09e22af4" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.096637 26179 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:08.085983 26171 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:08.098779 26171 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:08.092849 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.101015 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.102481 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.103914 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.105074 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.106406 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.107275 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1a99afb1f741bf8a2d6318f0ca4e2b" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.109000 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dae45fb2bfa401ab5a87bc3a8672e60" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.109617 26210 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.093336 26204 leader_election.cc:290] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:08.083170 26181 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:08.111832 26181 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:08.113862 26181 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:08.084213 26189 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:08.115036 26189 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:08.115427 26189 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:08.119087 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd1d178990d44f78512d81cdacd6b1d" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.123657 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26519f93f2144612acf259d481dc4485" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.123852 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.127919 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.128561 22144 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 11.
I20260709 12:28:08.129441 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71d215daee640dc8183aa5bb0a69a18" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.122260 26179 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:08.130905 26201 leader_election.cc:290] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:08.131973 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:28:08.138370 22188 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:08.138937 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:08.139401 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:08.139849 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:08.140302 22188 leader_election.cc:336] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.142279 22185 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.143208 26193 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:08.144506 22185 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.144886 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ee10bae8ef4b668f33b9ef12e13a6a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.145190 26171 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:08.145658 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57757a075ae444bf9e3ae62e6892f42a" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.146956 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fd945ff0ce4fa4a9967036f06d82f7" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:28:08.148635 22188 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:08.149210 22188 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.149529 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bbdc6920d6f481f9edabac1f94774ff" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.147850 22185 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.148350 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.152618 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.152925 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec6cbbf70dc43daa892eda3ef90f702" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.160521 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.152642 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.196830 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9360ea2e8bd04bd899235529e921b05d" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.150032 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14db25b634d44dda22c20f58ac81a55" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:28:08.208632 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 87799.1us
I20260709 12:28:08.156000 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2601e033c5b34310a9d1582b3d94c3aa" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
W20260709 12:28:08.211091 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 63313.4us
W20260709 12:28:08.149700 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:28:08.212710 22185 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 
W20260709 12:28:08.214857 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 65199.7us
W20260709 12:28:08.215350 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.215401 22185 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.150465 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae34788927d43db8e0aa62c5dae8dd9" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.201534 22186 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:08.217365 22148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e92d357da9e844b2ae270e73b28170db" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.218444 22185 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.221648 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.222447 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.222502 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.153118 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.224189 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3726200783e487b9963f5fc73170d31" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.226003 26205 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.226377 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.226835 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.227128 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.227491 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.228186 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a34f9ae8654955bc6eda7229323ca3" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.228513 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.229446 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a00dfd4bb864cbe94033b53b925fd76" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.229957 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:08.232266 22186 leader_election.cc:304] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.233075 26205 raft_consensus.cc:2749] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:08.228576 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee09151218d04cb69512d91f7b843c32" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:08.159078 26168 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.235735 22186 leader_election.cc:304] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.238270 22186 leader_election.cc:304] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.239591 26205 raft_consensus.cc:2749] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:08.239820 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3632e739cf449a83c07dcdbce1528c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.240765 26205 raft_consensus.cc:2749] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:08.243242 22186 leader_election.cc:304] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.227058 26203 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:08.234900 26181 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:08.263049 26181 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:08.263463 26181 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:08.264038 22806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451d96b5461b4c21aa4930657c835b50" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.246882 22113 leader_election.cc:304] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.265393 22804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161e19d23ae64fb1919e4e43e3e26bd3" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.266316 22802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f775ac681f8f42d3a3a16bf664e0bee7" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.263593 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369b15e6e4254982a559940734df1656" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.219472 26179 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.254292 26168 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:08.256043 26193 raft_consensus.cc:2749] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:08.256531 26202 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:08.271292 22801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9cf5f021f44b55831f1ed964025c7e" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
W20260709 12:28:08.274417 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 56087.3us
I20260709 12:28:08.279027 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7ac68dfb384745935240b56803f52c" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:08.156654 26189 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.281992 26189 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:08.278005 26204 raft_consensus.cc:2749] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:08.285523 22185 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:28:08.289016 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 77441us
W20260709 12:28:08.290300 22776 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:08.292953 22775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 50806.3us
W20260709 12:28:08.294345 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 51190us
I20260709 12:28:08.296466 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:28:08.299041 22773 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.301291 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:28:08.304790 26181 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.306772 26168 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:08.307843 26181 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:28:08.308614 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:28:08.309180 22185 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:28:08.309568 22114 leader_election.cc:336] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.310009 22114 leader_election.cc:304] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.314639 26197 raft_consensus.cc:2749] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:08.319326 22185 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.320345 26207 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:08.320794 26171 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:08.320511 22185 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.319522 26179 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:08.322578 22185 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.323598 26193 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:08.322665 26179 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.327893 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:28:08.337663 22112 leader_election.cc:304] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.338882 26204 raft_consensus.cc:2749] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.348084 22112 leader_election.cc:304] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.349326 22112 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.351102 22112 leader_election.cc:304] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.351296 26197 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:08.350989 26208 raft_consensus.cc:2749] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:08.353138 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 50607.8us
W20260709 12:28:08.355086 22186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 51107.3us
I20260709 12:28:08.355270 26197 raft_consensus.cc:2749] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:08.357108 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:28:08.356637 22112 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.361018 26197 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:08.361768 22773 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.362694 26213 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:08.363366 22773 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.363394 22112 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.364650 22773 leader_election.cc:304] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.364977 26213 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:08.365998 26201 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:08.366686 22776 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:08.367274 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.367707 22776 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:08.368147 22776 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:08.368578 22776 leader_election.cc:336] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.368795 22112 leader_election.cc:304] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.369441 22186 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:08.371861 22773 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.368942 22776 leader_election.cc:304] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.372684 22112 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.375065 26216 raft_consensus.cc:2749] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.377034 26201 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.377640 26213 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:08.378350 26215 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:08.379106 22773 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.377810 22112 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.383594 22773 leader_election.cc:304] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.383994 26213 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:08.385675 26213 raft_consensus.cc:2749] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:08.386293 21958 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 61965us
I20260709 12:28:08.385600 26201 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:08.387447 22773 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.385037 26216 raft_consensus.cc:2749] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:08.388615 22112 leader_election.cc:304] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:28:08.364722 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 53716.2us
I20260709 12:28:08.397631 26201 raft_consensus.cc:2749] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:08.398557 22773 leader_election.cc:304] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.398903 22112 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.399706 26201 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:08.400084 26180 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:08.383014 26197 raft_consensus.cc:2749] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.400971 22112 leader_election.cc:304] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:28:08.401355 22114 leader_election.cc:336] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.401790 26197 raft_consensus.cc:2749] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:08.401837 22114 leader_election.cc:304] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.402751 26197 raft_consensus.cc:2749] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:08.403390 26216 raft_consensus.cc:2749] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:08.405582 22773 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.406352 26216 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:08.407559 22773 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.408803 22773 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.409539 26216 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.410166 26216 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:08.402961 22114 leader_election.cc:336] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.412782 22114 leader_election.cc:304] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.413498 26197 raft_consensus.cc:2749] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:08.414060 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12cca886b64e4c138e59114be95a8549: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.415450 22773 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.422941 26213 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:08.413710 22114 leader_election.cc:336] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.424043 22114 leader_election.cc:304] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.424765 26197 raft_consensus.cc:2749] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:08.425097 22114 leader_election.cc:336] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.425560 22114 leader_election.cc:304] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.426250 26197 raft_consensus.cc:2749] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:08.426445 22114 leader_election.cc:336] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.426936 22114 leader_election.cc:304] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.427896 26197 raft_consensus.cc:2749] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:08.429551 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:28:08.430259 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
W20260709 12:28:08.414445 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.431704 22114 leader_election.cc:336] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.432154 22114 leader_election.cc:304] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.432992 26197 raft_consensus.cc:2749] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:08.439679 22222 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Rejecting Update request from peer 7ff8d9fd78c1454cacc77bbc1bfb992e for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:08.442202 26213 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:08.443279 26213 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:08.443656 26213 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:28:08.444506 26213 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.445947 26213 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:08.454023 22773 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.455071 26216 raft_consensus.cc:2749] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.455399 22773 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:28:08.433123 22114 leader_election.cc:336] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.461376 22114 leader_election.cc:304] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:28:08.462373 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:08.462633 26197 raft_consensus.cc:2749] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:08.463110 26180 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:28:08.492053 22114 leader_election.cc:336] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:08.493094 22114 leader_election.cc:336] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.493510 22114 leader_election.cc:304] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:08.494289 26197 raft_consensus.cc:2749] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:08.494514 22114 leader_election.cc:336] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.495048 22114 leader_election.cc:304] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.495760 26197 raft_consensus.cc:2749] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:08.496084 22114 leader_election.cc:336] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:08.496557 22114 leader_election.cc:304] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7; no voters: d465f3cb42174eb89615dcd747f9e682, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:08.497231 26197 raft_consensus.cc:2749] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:08.544482 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:28:08.546268 22805 raft_consensus.cc:1240] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:08.555153 26201 consensus_queue.cc:1059] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:08.556228 26201 raft_consensus.cc:3055] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:08.556604 26201 raft_consensus.cc:740] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:28:08.557511 26201 consensus_queue.cc:260] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.558779 26201 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:08.556564 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:08.581055 22805 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:28:08.582646 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:08.583889 26197 consensus_queue.cc:1059] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:08.585091 26208 raft_consensus.cc:3055] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:08.585704 26208 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:28:08.586737 26208 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:08.587975 26208 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:08.589372 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.642376 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:08.643146 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:08.749465 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800361700 after lost signal to thread 20920
W20260709 12:28:08.752224 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800361a80 after lost signal to thread 22005
W20260709 12:28:08.755013 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08002effc0 after lost signal to thread 22172
W20260709 12:28:08.787180 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800311a40 after lost signal to thread 22246
W20260709 12:28:08.790283 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800223e60 after lost signal to thread 22834
W20260709 12:28:08.796545 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:08.848871 22114 consensus_peers.cc:597] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:08.849849 20917 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:08.901212 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:09.011438 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.051309 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.093823 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.127120 22188 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.139581 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.196334 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:09.249336 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:09.264771 22776 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:09.275695 22114 consensus_peers.cc:597] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:09.341858 22114 consensus_peers.cc:597] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:09.376015 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:09.388581 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.399461 22114 consensus_peers.cc:597] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:09.510128 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:09.627312 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a2d181824b34483d8653c405c650ec94: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:09.669036 22188 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:09.689945 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.705435 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:09.707825 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.721336 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.744964 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.745491 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.750005 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:09.776968 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:09.781018 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:09.810045 22188 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:09.850358 20917 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 22094)
I20260709 12:28:09.850814 26179 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:09.851838 26179 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:09.859990 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:09.860944 22147 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 10.
I20260709 12:28:09.862453 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:09.863303 22805 raft_consensus.cc:2393] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 10: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:28:09.866307 26179 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:09.885246 26194 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.885910 26194 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:09.888200 26194 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:09.888979 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:09.890687 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:09.891376 22805 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 7.
I20260709 12:28:09.892740 22112 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:09.893953 26194 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:09.894320 26194 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.894667 26194 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:09.904336 26195 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:09.905028 26195 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:09.908865 22185 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
W20260709 12:28:09.909560 22114 consensus_peers.cc:597] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:09.909849 26224 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:09.910315 26224 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:09.910724 26224 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:09.911787 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:09.912580 22218 raft_consensus.cc:2393] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 12: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:28:09.911254 26195 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:09.913728 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:09.914361 22805 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 12.
I20260709 12:28:09.922688 22112 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:09.924269 26195 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:09.925105 26195 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ff8d9fd78c1454cacc77bbc1bfb992e)
I20260709 12:28:09.925537 26195 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:09.929343 26224 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:09.962337 26194 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:09.969599 26194 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:09.971655 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:28:09.972100 26224 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:09.975745 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:28:09.976544 22805 raft_consensus.cc:2393] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa in current term 10: Already voted for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in this term.
I20260709 12:28:09.994868 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:28:09.995538 22805 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:09.996752 26195 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:10.008176 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 56111us
I20260709 12:28:10.026846 26195 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 election: Requested vote from peers ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:10.036370 22805 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 8.
I20260709 12:28:10.038431 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:28:10.041800 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "67742f291ab04f8b8335d3919cf2d1f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:28:10.070931 22221 raft_consensus.cc:2393] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 67742f291ab04f8b8335d3919cf2d1f7 in current term 12: Already voted for candidate ecc1814bfd604baa9cc66be8c02c5cfa in this term.
I20260709 12:28:10.063977 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:28:10.085728 26179 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:10.086539 26179 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.096421 22112 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:10.104131 26179 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:10.107187 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:10.118453 22805 raft_consensus.cc:2368] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 7. Current term is 8.
I20260709 12:28:10.121971 22186 leader_election.cc:400] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 7. Current term is 8.
I20260709 12:28:10.122901 22186 leader_election.cc:403] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:10.124696 26232 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:28:10.145152 26231 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:10.145850 26231 raft_consensus.cc:697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:28:10.146982 26231 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:10.164064 22112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41677, user_credentials={real_user=slave}} blocked reactor thread for 67735.8us
I20260709 12:28:10.193156 26227 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.193961 26227 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.197012 26227 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:10.209609 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:10.216121 22140 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 10.
I20260709 12:28:10.223953 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:10.226711 22807 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67742f291ab04f8b8335d3919cf2d1f7 in term 12.
I20260709 12:28:10.134433 26232 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677) with higher term. Message: Invalid argument: T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 7. Current term is 8.
I20260709 12:28:10.233708 22185 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:10.242828 26214 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:10.243376 26214 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:28:10.244324 26214 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.237607 22147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:10.249302 22147 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 12.
W20260709 12:28:10.265341 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:10.265388 22185 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:10.274137 26232 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:10.274561 26232 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.274910 26232 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:10.277657 21970 catalog_manager.cc:5697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.283447 22112 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:28:10.291795 22114 consensus_peers.cc:597] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:10.292284 26195 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:10.292898 26195 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 LEADER]: Becoming Leader. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:28:10.293924 26195 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:10.317855 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:10.343528 21971 catalog_manager.cc:5697] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 9 to 10, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 10 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.349248 26232 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.365633 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:28:10.370473 22805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2772ed1f79a846e3852654dad2c86235" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e"
I20260709 12:28:10.371034 22805 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:10.374826 26232 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:10.384384 22805 raft_consensus.cc:2468] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 13.
I20260709 12:28:10.389457 22186 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:28:10.393244 26232 raft_consensus.cc:2804] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:10.394990 26232 raft_consensus.cc:697] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 LEADER]: Becoming Leader. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:28:10.396035 26232 consensus_queue.cc:237] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.449509 21970 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 reported cstate change: term changed from 11 to 12, leader changed from 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68) to 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66). New cstate: current_term: 12 leader_uuid: "67742f291ab04f8b8335d3919cf2d1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.474838 21971 catalog_manager.cc:5697] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa reported cstate change: term changed from 12 to 13, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67). New cstate: current_term: 13 leader_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.553711 22805 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:10.555184 26189 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.555809 26189 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.560009 26195 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:10.585335 26189 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:10.587046 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:10.596892 22222 raft_consensus.cc:1275] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Refusing update from remote peer 67742f291ab04f8b8335d3919cf2d1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:10.613185 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7" is_pre_election: true
I20260709 12:28:10.613870 22140 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 10.
I20260709 12:28:10.616608 22773 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:10.617596 26180 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:10.617988 26180 raft_consensus.cc:493] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.618834 26180 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:10.619541 26195 consensus_queue.cc:1048] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:28:10.622059 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:28:10.652311 26180 raft_consensus.cc:515] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.661290 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "67742f291ab04f8b8335d3919cf2d1f7"
I20260709 12:28:10.661942 22140 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:10.661990 26180 leader_election.cc:290] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:10.663419 22221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cca886b64e4c138e59114be95a8549" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:28:10.693872 22140 raft_consensus.cc:2468] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 11.
I20260709 12:28:10.695165 22773 leader_election.cc:304] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:10.696545 26189 raft_consensus.cc:2804] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:10.697050 26189 raft_consensus.cc:697] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
I20260709 12:28:10.697968 26189 consensus_queue.cc:237] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:10.703186 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:28:10.722877 22807 raft_consensus.cc:1240] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Rejecting Update request from peer ecc1814bfd604baa9cc66be8c02c5cfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:10.727886 26232 consensus_queue.cc:1059] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:10.728703 26232 consensus_queue.cc:1243] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Peer 7ff8d9fd78c1454cacc77bbc1bfb992e log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:28:10.729193 26232 raft_consensus.cc:3055] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:10.729506 26232 raft_consensus.cc:740] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecc1814bfd604baa9cc66be8c02c5cfa, State: Running, Role: LEADER
I20260709 12:28:10.730283 26232 consensus_queue.cc:260] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.736455 21970 catalog_manager.cc:5697] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 10 to 11, leader changed from ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 11 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:10.737246 26232 raft_consensus.cc:3060] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:10.784389 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:10.804539 22807 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:10.806066 22221 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 LEADER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:10.806402 26227 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:28:10.850862 20917 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:10.863843 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:10.872145 26195 consensus_queue.cc:1059] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:10.873193 26195 consensus_queue.cc:1243] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [LEADER]: Peer ecc1814bfd604baa9cc66be8c02c5cfa log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:28:10.873932 26195 raft_consensus.cc:3055] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:10.874279 26195 raft_consensus.cc:740] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 67742f291ab04f8b8335d3919cf2d1f7, State: Running, Role: LEADER
I20260709 12:28:10.875300 26195 consensus_queue.cc:260] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:10.876292 26195 raft_consensus.cc:3060] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:10.883757 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:10.899600 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:28:10.914485 22805 raft_consensus.cc:1240] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Rejecting Update request from peer 67742f291ab04f8b8335d3919cf2d1f7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:28:10.965842 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 52275.2us
I20260709 12:28:11.022671 22147 raft_consensus.cc:1275] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Refusing update from remote peer ecc1814bfd604baa9cc66be8c02c5cfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:28:11.023109 22147 pending_rounds.cc:85] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting all ops after (but not including) 10
I20260709 12:28:11.023327 22147 pending_rounds.cc:107] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:28:11.023591 22147 raft_consensus.cc:2889] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:11.025964 26214 consensus_queue.cc:1048] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:28:11.034360 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 43990.9us
W20260709 12:28:11.111584 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:11.053074 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:11.130065 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 77052.8us
I20260709 12:28:11.235082 22221 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:28:11.235463 22221 pending_rounds.cc:85] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting all ops after (but not including) 9
I20260709 12:28:11.235667 22221 pending_rounds.cc:107] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:28:11.235878 22221 raft_consensus.cc:2889] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:11.238066 26243 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:11.260576 22140 raft_consensus.cc:1275] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Refusing update from remote peer 7ff8d9fd78c1454cacc77bbc1bfb992e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:11.273474 26180 consensus_queue.cc:1048] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:28:11.320796 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 91953.3us
W20260709 12:28:11.393399 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.394163 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.394575 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:11.394975 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.434059 22114 consensus_peers.cc:597] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:11.434562 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:11.435179 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:11.504276 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:11.508587 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:11.545672 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:11.610713 22188 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:11.632560 22114 consensus_peers.cc:597] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:11.650470 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.655730 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:11.734874 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:11.762734 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:11.823377 22776 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:11.851373 20917 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:11.905813 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:11.917616 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:11.969013 22776 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111) [suppressed 422 similar messages]
W20260709 12:28:12.013124 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:12.094849 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:12.097422 22114 consensus_peers.cc:597] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:12.118018 22114 consensus_peers.cc:597] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:12.196367 22114 consensus_peers.cc:597] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:12.207156 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:12.247922 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:12.281263 22188 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:12.283668 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:12.379544 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:12.461647 22188 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:12.502635 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:12.504511 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:12.521730 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:12.619331 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:12.792203 22114 consensus_peers.cc:597] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:12.800266 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:12.851889 20917 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:12.856714 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:13.067068 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:13.127434 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:13.291558 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:13.357867 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:13.364184 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:13.395684 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:13.422214 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:13.463976 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:13.475890 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:13.547050 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:13.561153 22114 consensus_peers.cc:597] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:13.717088 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:13.755479 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:13.756036 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:13.809303 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:13.852481 20917 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:13.858047 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:13.923012 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:13.923760 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:14.029444 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:14.144050 22114 consensus_peers.cc:597] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:14.230185 22113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37787, user_credentials={real_user=slave}} blocked reactor thread for 54639.7us
W20260709 12:28:14.252521 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:14.253129 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 77343.1us
W20260709 12:28:14.265342 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:14.310721 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 45429.3us
W20260709 12:28:14.324517 22188 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:14.351032 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:14.382548 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:14.412482 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:14.417320 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:14.456835 22114 consensus_peers.cc:597] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:14.546245 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 71960us
W20260709 12:28:14.577572 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:14.589622 22776 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:14.724488 22114 consensus_peers.cc:597] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:14.736018 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12cca886b64e4c138e59114be95a8549: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:14.771100 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:14.779695 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:14.785115 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:14.794833 22114 consensus_peers.cc:597] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:14.849121 22188 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:14.852967 20917 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:15.007154 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:15.015424 22188 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:15.090704 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:15.131278 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.152577 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:15.234922 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:15.238292 22114 consensus_peers.cc:597] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:15.256402 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.668782 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:15.840704 22188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 171382us
W20260709 12:28:15.853449 20917 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:15.878434 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:15.963781 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:15.993372 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:16.052469 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:16.053288 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:16.053750 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:16.080853 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:16.223374 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:16.240885 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:16.465878 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 58522.7us
W20260709 12:28:16.474470 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:16.489733 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:16.566517 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:16.757369 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:16.761776 22002 debug-util.cc:398] Leaking SignalData structure 0x7b08002f04a0 after lost signal to thread 20920
W20260709 12:28:16.762908 22002 debug-util.cc:398] Leaking SignalData structure 0x7b08000385e0 after lost signal to thread 22005
W20260709 12:28:16.764258 22002 debug-util.cc:398] Leaking SignalData structure 0x7b0800383c60 after lost signal to thread 22172
W20260709 12:28:16.765821 22002 debug-util.cc:398] Leaking SignalData structure 0x7b0800278680 after lost signal to thread 22246
W20260709 12:28:16.767989 22002 debug-util.cc:398] Leaking SignalData structure 0x7b08003c09e0 after lost signal to thread 22834
W20260709 12:28:16.794977 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:16.795756 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:16.846151 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:16.853955 20917 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:16.921278 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:17.010815 22776 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111) [suppressed 414 similar messages]
W20260709 12:28:17.015237 22114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 87166.4us
W20260709 12:28:17.020190 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:17.034049 22188 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:17.041033 22773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 44547.5us
W20260709 12:28:17.071201 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:17.073891 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:17.092176 22114 consensus_peers.cc:597] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:17.116297 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:17.210996 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:17.232431 22776 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:17.309417 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:17.335186 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:17.372139 22188 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:17.386638 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:17.406065 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:17.472522 22114 consensus_peers.cc:597] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:17.499994 22114 consensus_peers.cc:597] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:17.509510 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:17.553810 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:17.605611 22188 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:17.738821 22114 consensus_peers.cc:597] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:17.794927 22114 consensus_peers.cc:597] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:17.854429 20917 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 22094)
W20260709 12:28:17.915256 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a2d181824b34483d8653c405c650ec94: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:17.961174 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:17.979871 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:18.007288 22114 consensus_peers.cc:597] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:18.074536 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:18.080582 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:18.075312 22114 consensus_peers.cc:597] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:18.095522 22114 consensus_peers.cc:597] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:18.173537 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:18.247349 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:18.390188 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:18.459012 22114 consensus_peers.cc:597] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:18.462857 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:18.486559 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:18.521312 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:18.619915 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:18.626884 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:18.796922 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:18.909053 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:19.020597 22114 consensus_peers.cc:597] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:19.060674 22114 consensus_peers.cc:597] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:19.094635 22114 consensus_peers.cc:597] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:19.150102 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:19.317744 22114 consensus_peers.cc:597] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:19.332505 22114 consensus_peers.cc:597] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:19.410352 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:19.439284 22188 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:19.513578 22114 consensus_peers.cc:597] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:19.541370 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:28:19.569773 20917 tablet_server.cc:196] TabletServer@127.20.109.65:0 shutdown complete.
W20260709 12:28:19.576745 22114 consensus_peers.cc:597] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:19.602684 22114 consensus_peers.cc:597] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:19.606011 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:19.684175 22776 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:19.687951 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:19.701320 22114 consensus_peers.cc:597] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:19.740700 22114 consensus_peers.cc:597] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:19.916484 22114 consensus_peers.cc:597] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:19.928234 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:19.934994 22114 consensus_peers.cc:597] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:19.958820 22188 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:28:19.992851 20917 tablet_server.cc:179] TabletServer@127.20.109.66:0 shutting down...
W20260709 12:28:19.998574 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:20.029471 22773 consensus_peers.cc:597] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:20.062558 22114 consensus_peers.cc:597] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:20.077263 22188 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:20.095278 22185 consensus_peers.cc:597] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:20.101322 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:20.131001 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:20.132115 20917 tablet_replica.cc:333] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.133234 20917 raft_consensus.cc:2243] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.134802 20917 raft_consensus.cc:2272] T 79fd945ff0ce4fa4a9967036f06d82f7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.137898 20917 tablet_replica.cc:333] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.138792 20917 raft_consensus.cc:2243] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Raft consensus shutting down.
W20260709 12:28:20.147177 22773 consensus_peers.cc:597] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.148001 20917 raft_consensus.cc:2272] T 980127ed884f4554a2daf41b92732061 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.156008 20917 tablet_replica.cc:333] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.156955 20917 raft_consensus.cc:2243] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:20.162983 22773 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.167269 20917 raft_consensus.cc:2272] T 2772ed1f79a846e3852654dad2c86235 P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.170454 22773 consensus_peers.cc:597] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:20.176303 22773 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.170544 20917 tablet_replica.cc:333] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.180490 20917 raft_consensus.cc:2243] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.181475 20917 raft_consensus.cc:2272] T ca62bb8242354d418721b86a9b704e37 P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.184478 20917 tablet_replica.cc:333] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.185437 20917 raft_consensus.cc:2243] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.186159 20917 raft_consensus.cc:2272] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.188272 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:28:20.189556 20917 tablet_replica.cc:333] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.194707 20917 raft_consensus.cc:2243] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.196244 20917 raft_consensus.cc:2272] T 1cfcc23bf9854a5e8cf97a83c188f631 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.197872 22185 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.212386 20917 tablet_replica.cc:333] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
W20260709 12:28:20.212677 22185 consensus_peers.cc:597] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.213541 20917 raft_consensus.cc:2243] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.214484 20917 raft_consensus.cc:2272] T f3726200783e487b9963f5fc73170d31 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.217362 20917 tablet_replica.cc:333] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.227128 20917 raft_consensus.cc:2243] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.228292 20917 raft_consensus.cc:2272] T 369b15e6e4254982a559940734df1656 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.231222 20917 tablet_replica.cc:333] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.232142 20917 raft_consensus.cc:2243] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.232867 20917 raft_consensus.cc:2272] T ee09151218d04cb69512d91f7b843c32 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.236557 22185 consensus_peers.cc:597] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:20.238059 22185 consensus_peers.cc:597] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:20.238823 22773 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.237463 20917 tablet_replica.cc:333] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.246899 20917 raft_consensus.cc:2243] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.249060 20917 raft_consensus.cc:2272] T 3fd4242f251b46f1a7e47490973fd53c P 67742f291ab04f8b8335d3919cf2d1f7 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.250763 22773 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.253216 20917 tablet_replica.cc:333] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
W20260709 12:28:20.262044 22185 consensus_peers.cc:597] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:20.262786 22773 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.263641 20917 raft_consensus.cc:2243] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.264379 20917 raft_consensus.cc:2272] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.267366 20917 tablet_replica.cc:333] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.268229 20917 raft_consensus.cc:2243] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.269532 20917 raft_consensus.cc:2272] T cecfaeb2287f4f7db4bee651c8bc4a36 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.276825 22773 consensus_peers.cc:597] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:20.278860 22773 consensus_peers.cc:597] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.272189 20917 tablet_replica.cc:333] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.293084 20917 raft_consensus.cc:2243] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:28:20.300421 22185 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.303887 20917 raft_consensus.cc:2272] T 2601e033c5b34310a9d1582b3d94c3aa P 67742f291ab04f8b8335d3919cf2d1f7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.306756 20917 tablet_replica.cc:333] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.310222 20917 raft_consensus.cc:2243] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:20.314391 22185 consensus_peers.cc:597] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:20.321234 22185 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.329134 20917 raft_consensus.cc:2272] T 161e19d23ae64fb1919e4e43e3e26bd3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.336500 20917 tablet_replica.cc:333] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.337339 20917 raft_consensus.cc:2243] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.339541 20917 raft_consensus.cc:2272] T e7199ba25bca48e89b961cf6ef78ab28 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.342700 20917 tablet_replica.cc:333] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.343619 20917 raft_consensus.cc:2243] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.344306 20917 raft_consensus.cc:2272] T 4d7ac68dfb384745935240b56803f52c P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.347527 20917 tablet_replica.cc:333] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.348325 20917 raft_consensus.cc:2243] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.349160 20917 raft_consensus.cc:2272] T 4321547cceb341b9babe64debb9fb125 P 67742f291ab04f8b8335d3919cf2d1f7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.353820 20917 tablet_replica.cc:333] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.354821 20917 raft_consensus.cc:2243] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.355618 20917 raft_consensus.cc:2272] T 5b3632e739cf449a83c07dcdbce1528c P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.358420 20917 tablet_replica.cc:333] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.359369 20917 raft_consensus.cc:2243] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.361372 20917 raft_consensus.cc:2272] T 4ec6cbbf70dc43daa892eda3ef90f702 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.364126 20917 tablet_replica.cc:333] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.364964 20917 raft_consensus.cc:2243] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.366169 20917 raft_consensus.cc:2272] T 52ee10bae8ef4b668f33b9ef12e13a6a P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.368870 20917 tablet_replica.cc:333] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.369696 20917 raft_consensus.cc:2243] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.371031 20917 raft_consensus.cc:2272] T b35bc73fc9544276942bc2c3ee41e639 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.373859 20917 tablet_replica.cc:333] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.374766 20917 raft_consensus.cc:2243] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:28:20.376026 22773 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.376026 20917 raft_consensus.cc:2272] T 0a00dfd4bb864cbe94033b53b925fd76 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.380201 20917 tablet_replica.cc:333] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.381117 20917 raft_consensus.cc:2243] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.382879 20917 raft_consensus.cc:2272] T b9f4ba2e44d142d4810d14babd35c984 P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.385597 20917 tablet_replica.cc:333] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.386430 20917 raft_consensus.cc:2243] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:20.387933 22773 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.388192 20917 raft_consensus.cc:2272] T 26519f93f2144612acf259d481dc4485 P 67742f291ab04f8b8335d3919cf2d1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.393234 20917 tablet_replica.cc:333] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.394101 20917 raft_consensus.cc:2243] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.395301 20917 raft_consensus.cc:2272] T f14db25b634d44dda22c20f58ac81a55 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.409607 20917 tablet_replica.cc:333] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.410460 20917 raft_consensus.cc:2243] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.411774 20917 raft_consensus.cc:2272] T 57757a075ae444bf9e3ae62e6892f42a P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.415998 20917 tablet_replica.cc:333] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.416956 20917 raft_consensus.cc:2243] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:28:20.418146 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:28:20.418315 20917 raft_consensus.cc:2272] T cf2d9646522845819383a8daea185649 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.423471 20917 tablet_replica.cc:333] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.426546 20917 raft_consensus.cc:2243] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:20.428902 22185 consensus_peers.cc:597] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.430676 20917 raft_consensus.cc:2272] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.433704 20917 tablet_replica.cc:333] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
W20260709 12:28:20.446957 22185 consensus_peers.cc:597] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.447257 20917 raft_consensus.cc:2243] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.448551 20917 raft_consensus.cc:2272] T a2d181824b34483d8653c405c650ec94 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.452006 20917 tablet_replica.cc:333] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.452977 20917 raft_consensus.cc:2243] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.453908 20917 raft_consensus.cc:2272] T ce0cbcda6ab94ef68d36321d19671059 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.457131 20917 tablet_replica.cc:333] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.459148 20917 raft_consensus.cc:2243] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.471763 20917 raft_consensus.cc:2272] T 5dae45fb2bfa401ab5a87bc3a8672e60 P 67742f291ab04f8b8335d3919cf2d1f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.474934 20917 tablet_replica.cc:333] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.475893 20917 raft_consensus.cc:2243] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.477190 20917 raft_consensus.cc:2272] T e92d357da9e844b2ae270e73b28170db P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.480177 20917 tablet_replica.cc:333] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.481045 20917 raft_consensus.cc:2243] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.481873 20917 raft_consensus.cc:2272] T 451d96b5461b4c21aa4930657c835b50 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.482811 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:20.491700 20917 tablet_replica.cc:333] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.492534 20917 raft_consensus.cc:2243] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.498826 20917 raft_consensus.cc:2272] T 48a34f9ae8654955bc6eda7229323ca3 P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.501773 20917 tablet_replica.cc:333] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.508745 20917 raft_consensus.cc:2243] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.510022 20917 raft_consensus.cc:2272] T a71d215daee640dc8183aa5bb0a69a18 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.507526 22773 consensus_peers.cc:597] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.514039 20917 tablet_replica.cc:333] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.519497 20917 raft_consensus.cc:2243] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.520411 20917 raft_consensus.cc:2272] T f775ac681f8f42d3a3a16bf664e0bee7 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.523519 20917 tablet_replica.cc:333] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
W20260709 12:28:20.523617 22185 consensus_peers.cc:597] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.531930 20917 raft_consensus.cc:2243] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.533825 20917 raft_consensus.cc:2272] T 1c9cf5f021f44b55831f1ed964025c7e P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.536782 20917 tablet_replica.cc:333] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.539937 20917 raft_consensus.cc:2243] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.541076 20917 raft_consensus.cc:2272] T 5e537942a08e4c8fbf26a1a0084997c4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.550483 22188 consensus_peers.cc:597] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:28:20.551735 20917 tablet_replica.cc:333] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.552654 20917 raft_consensus.cc:2243] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.554347 20917 raft_consensus.cc:2272] T 754c2d759050420898a081f3dfa0a18c P 67742f291ab04f8b8335d3919cf2d1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.568148 20917 tablet_replica.cc:333] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.569088 20917 raft_consensus.cc:2243] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.570022 20917 raft_consensus.cc:2272] T 66ebd42ef0064f2489bbc02ec3e9500b P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.573606 20917 tablet_replica.cc:333] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.574405 20917 raft_consensus.cc:2243] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.575755 20917 raft_consensus.cc:2272] T 9bbdc6920d6f481f9edabac1f94774ff P 67742f291ab04f8b8335d3919cf2d1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.582473 20917 tablet_replica.cc:333] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.583608 20917 raft_consensus.cc:2243] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.592988 20917 raft_consensus.cc:2272] T 12cca886b64e4c138e59114be95a8549 P 67742f291ab04f8b8335d3919cf2d1f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.623816 20917 tablet_replica.cc:333] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.625238 20917 raft_consensus.cc:2243] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:20.625756 22114 consensus_peers.cc:597] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:28:20.633057 20917 raft_consensus.cc:2272] T 8fd1d178990d44f78512d81cdacd6b1d P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.647656 20917 tablet_replica.cc:333] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.648514 20917 raft_consensus.cc:2243] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.649190 20917 raft_consensus.cc:2272] T 6b8326670393490f9fabe3827cd6d958 P 67742f291ab04f8b8335d3919cf2d1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.652359 20917 tablet_replica.cc:333] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.653261 20917 raft_consensus.cc:2243] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.654470 20917 raft_consensus.cc:2272] T 0ae34788927d43db8e0aa62c5dae8dd9 P 67742f291ab04f8b8335d3919cf2d1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.657091 20917 tablet_replica.cc:333] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7: stopping tablet replica
I20260709 12:28:20.657832 20917 raft_consensus.cc:2243] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.659243 20917 raft_consensus.cc:2272] T 7e4753dcc01343d1b0ac9cef09e22af4 P 67742f291ab04f8b8335d3919cf2d1f7 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:20.794418 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:20.869781 22188 consensus_peers.cc:597] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:20.877581 22188 consensus_peers.cc:597] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:21.031404 22776 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:21.034758 22776 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:21.063663 22188 consensus_peers.cc:597] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:21.087842 22776 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:28:21.200393 26289 raft_consensus.cc:493] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.200997 26289 raft_consensus.cc:515] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.207595 26289 leader_election.cc:290] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.215014 22188 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:21.219527 22776 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:21.220391 22185 leader_election.cc:336] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.220889 22185 leader_election.cc:304] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.222182 26289 raft_consensus.cc:2749] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:21.262614 26272 raft_consensus.cc:493] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.263235 26272 raft_consensus.cc:515] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.265501 26272 leader_election.cc:290] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.272559 22776 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:21.276777 22773 leader_election.cc:336] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.277247 22773 leader_election.cc:304] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.278116 26284 raft_consensus.cc:2749] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:21.314767 26284 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.315382 26284 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.318225 26284 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:21.323233 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
W20260709 12:28:21.327883 22773 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.328474 22773 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:21.330538 26272 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:21.331638 22776 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.360908 26289 raft_consensus.cc:493] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.361578 26289 raft_consensus.cc:515] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.363929 26289 leader_election.cc:290] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.383224 22188 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:21.384945 22185 leader_election.cc:336] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.385380 22185 leader_election.cc:304] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.387149 26288 raft_consensus.cc:2749] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:21.439329 22776 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:21.465607 26284 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.466174 26284 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.470371 26284 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.471994 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:21.484427 22773 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.485164 22773 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.486809 26284 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:21.488744 22776 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:21.538404 26289 raft_consensus.cc:493] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.539027 26289 raft_consensus.cc:515] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.541042 26289 leader_election.cc:290] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.551124 22188 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:21.554880 22185 leader_election.cc:336] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.555326 22185 leader_election.cc:304] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.558305 26288 raft_consensus.cc:493] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.558851 26288 raft_consensus.cc:515] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.561054 26288 leader_election.cc:290] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:21.561546 26288 raft_consensus.cc:2749] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:21.580718 22188 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.608940 26289 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.609529 26289 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.611896 26289 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:21.614955 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:21.616117 26288 raft_consensus.cc:493] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.634949 26288 raft_consensus.cc:515] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.637212 26288 leader_election.cc:290] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.617657 22185 leader_election.cc:336] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.641144 22185 leader_election.cc:304] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.642350 26288 raft_consensus.cc:2749] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:21.661330 26292 raft_consensus.cc:493] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.661947 26292 raft_consensus.cc:515] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.665124 26292 leader_election.cc:290] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
I20260709 12:28:21.670442 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f4ba2e44d142d4810d14babd35c984" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:21.671219 22803 raft_consensus.cc:2468] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc1814bfd604baa9cc66be8c02c5cfa in term 4.
W20260709 12:28:21.678306 22776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:38979, user_credentials={real_user=slave}} blocked reactor thread for 48012.3us
W20260709 12:28:21.683497 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 65864.5us
I20260709 12:28:21.686515 26292 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.687124 26292 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.689936 26292 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68:41677)
W20260709 12:28:21.691754 22188 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.701763 26284 raft_consensus.cc:493] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.702325 26284 raft_consensus.cc:515] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.704200 26284 leader_election.cc:290] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.708812 22773 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.712994 26292 raft_consensus.cc:493] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.713598 26292 raft_consensus.cc:515] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.714501 26293 raft_consensus.cc:493] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.715060 26293 raft_consensus.cc:515] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.715982 26292 leader_election.cc:290] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:21.717036 26293 leader_election.cc:290] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.718652 22188 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.723388 22803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" is_pre_election: true
I20260709 12:28:21.737584 26272 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.738121 26294 raft_consensus.cc:493] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.738099 26272 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.738806 26294 raft_consensus.cc:515] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } attrs { replace: true } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.741541 26294 leader_election.cc:290] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:21.744618 26272 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:28:21.749444 22773 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
W20260709 12:28:21.750052 22773 leader_election.cc:336] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.769502 26292 raft_consensus.cc:493] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.770162 26292 raft_consensus.cc:515] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.772910 26292 leader_election.cc:290] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.777962 22776 leader_election.cc:336] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:21.779034 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:46283, user_credentials={real_user=slave}} blocked reactor thread for 44326.2us
W20260709 12:28:21.786827 22188 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.787422 22188 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.791277 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7199ba25bca48e89b961cf6ef78ab28" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:21.791983 22222 raft_consensus.cc:2468] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:28:21.793361 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" is_pre_election: true
I20260709 12:28:21.793949 22222 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 8.
I20260709 12:28:21.800411 22775 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:28:21.801926 26294 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:21.802309 26294 raft_consensus.cc:493] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.802668 26294 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:21.807184 22185 leader_election.cc:336] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.807703 22185 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, 7ff8d9fd78c1454cacc77bbc1bfb992e
I20260709 12:28:21.811429 26294 raft_consensus.cc:515] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.778436 22776 leader_election.cc:304] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.814615 26294 leader_election.cc:290] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Requested vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:21.815153 26294 raft_consensus.cc:2749] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:21.812798 20917 tablet_server.cc:196] TabletServer@127.20.109.66:0 shutdown complete.
I20260709 12:28:21.817569 22222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecfaeb2287f4f7db4bee651c8bc4a36" candidate_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa"
I20260709 12:28:21.818125 22222 raft_consensus.cc:3060] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:21.819149 22773 leader_election.cc:336] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
W20260709 12:28:21.824343 22185 leader_election.cc:336] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.825930 26289 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:21.826153 26284 raft_consensus.cc:493] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.827924 26284 raft_consensus.cc:515] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.829857 26284 leader_election.cc:290] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:21.831550 22185 leader_election.cc:304] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.832321 26289 raft_consensus.cc:2749] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:21.837361 22188 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:21.837947 22188 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.840215 22222 raft_consensus.cc:2468] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ff8d9fd78c1454cacc77bbc1bfb992e in term 9.
I20260709 12:28:21.840749 26293 raft_consensus.cc:2749] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:21.841451 22773 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.845950 26293 raft_consensus.cc:493] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.846482 26293 raft_consensus.cc:515] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.848572 26293 leader_election.cc:290] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:21.849133 26294 raft_consensus.cc:493] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.849705 26294 raft_consensus.cc:515] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.844667 22775 leader_election.cc:304] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7
I20260709 12:28:21.850857 26284 raft_consensus.cc:2804] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:21.851459 26284 raft_consensus.cc:697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: Becoming Leader. State: Replica: 7ff8d9fd78c1454cacc77bbc1bfb992e, State: Running, Role: LEADER
W20260709 12:28:21.853152 22188 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.852557 26284 consensus_queue.cc:237] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
W20260709 12:28:21.856046 22185 leader_election.cc:336] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.863837 22185 leader_election.cc:304] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.865268 26293 raft_consensus.cc:2749] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:21.861498 22776 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.867615 22776 leader_election.cc:304] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e, ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.868983 26295 raft_consensus.cc:2749] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:21.862138 26294 leader_election.cc:290] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.862628 22773 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
W20260709 12:28:21.871075 22185 leader_election.cc:336] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
W20260709 12:28:21.878926 22188 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:21.883214 22776 leader_election.cc:336] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.883702 22776 leader_election.cc:304] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.884366 26284 raft_consensus.cc:2749] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:21.885560 22185 leader_election.cc:336] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.888938 26293 raft_consensus.cc:493] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.889430 26293 raft_consensus.cc:515] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
I20260709 12:28:21.891496 26293 leader_election.cc:290] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.888473 22776 leader_election.cc:336] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.888859 21967 catalog_manager.cc:5697] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e reported cstate change: term changed from 8 to 9, leader changed from 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66) to 7ff8d9fd78c1454cacc77bbc1bfb992e (127.20.109.68). New cstate: current_term: 9 leader_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:21.885983 22185 leader_election.cc:304] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.894555 22776 leader_election.cc:304] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:28:21.896435 22188 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.899070 26293 raft_consensus.cc:2749] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:21.908564 26284 raft_consensus.cc:2749] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:21.899505 22185 leader_election.cc:336] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.909399 22185 leader_election.cc:304] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.910175 26289 raft_consensus.cc:2749] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:21.921510 22185 leader_election.cc:336] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.922091 22185 leader_election.cc:304] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.922974 26289 raft_consensus.cc:2749] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:21.939502 22185 leader_election.cc:336] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.940173 22185 leader_election.cc:304] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.941128 26289 raft_consensus.cc:2749] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:21.945896 26294 raft_consensus.cc:493] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:21.946655 26294 raft_consensus.cc:515] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:21.949200 26294 leader_election.cc:290] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:21.954483 22773 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
W20260709 12:28:21.957487 22776 leader_election.cc:336] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:21.957964 22776 leader_election.cc:304] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:28:21.958940 22776 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:28:21.959373 26294 raft_consensus.cc:2749] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:21.960830 22185 leader_election.cc:336] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:21.961336 22185 leader_election.cc:304] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:21.962234 26289 raft_consensus.cc:2749] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:22.002676 26293 raft_consensus.cc:493] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:22.003307 26293 raft_consensus.cc:515] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:28:22.014235 22773 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111) [suppressed 535 similar messages]
I20260709 12:28:22.014609 20917 tablet_server.cc:179] TabletServer@127.20.109.67:0 shutting down...
W20260709 12:28:22.019172 22188 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:22.022639 26293 leader_election.cc:290] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:22.025063 22185 leader_election.cc:336] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:22.025585 22185 leader_election.cc:304] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
W20260709 12:28:22.026839 22775 consensus_peers.cc:597] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.026841 26293 raft_consensus.cc:2749] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:22.033579 22775 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.056341 22775 consensus_peers.cc:597] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.075711 26293 raft_consensus.cc:493] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:22.076289 26293 raft_consensus.cc:515] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } }
W20260709 12:28:22.079505 22775 consensus_peers.cc:597] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.092088 22188 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:22.097306 22776 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:22.109579 26293 leader_election.cc:290] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
W20260709 12:28:22.112591 22185 leader_election.cc:336] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:22.113095 22185 leader_election.cc:304] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecc1814bfd604baa9cc66be8c02c5cfa; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:22.118034 26293 raft_consensus.cc:2749] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:22.124823 22776 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:22.124958 22775 consensus_peers.cc:597] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.127414 22775 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.130383 22775 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.141837 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:22.143713 20917 tablet_replica.cc:333] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.144594 20917 raft_consensus.cc:2243] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.145367 20917 raft_consensus.cc:2272] T 79fd945ff0ce4fa4a9967036f06d82f7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.150043 20917 tablet_replica.cc:333] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.153990 20917 raft_consensus.cc:2243] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.154882 20917 raft_consensus.cc:2272] T b9f4ba2e44d142d4810d14babd35c984 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.157678 20917 tablet_replica.cc:333] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.158581 20917 raft_consensus.cc:2243] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.159168 20917 raft_consensus.cc:2272] T 147ee46d74a94d69bbe00644cd192cc2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:22.160305 22775 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.161871 20917 tablet_replica.cc:333] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.162830 20917 raft_consensus.cc:2243] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.165073 20917 raft_consensus.cc:2272] T ca62bb8242354d418721b86a9b704e37 P ecc1814bfd604baa9cc66be8c02c5cfa [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.170929 20917 tablet_replica.cc:333] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
W20260709 12:28:22.171792 22775 consensus_peers.cc:597] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.171782 20917 raft_consensus.cc:2243] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.174664 20917 raft_consensus.cc:2272] T 980127ed884f4554a2daf41b92732061 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:22.177107 22775 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.177554 20917 tablet_replica.cc:333] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.178505 20917 raft_consensus.cc:2243] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.179523 20917 raft_consensus.cc:2272] T 2772ed1f79a846e3852654dad2c86235 P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.182443 20917 tablet_replica.cc:333] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.183290 20917 raft_consensus.cc:2243] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.184052 20917 raft_consensus.cc:2272] T 838948750f334b409ad4d7798a822e6d P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.186792 20917 tablet_replica.cc:333] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.187605 20917 raft_consensus.cc:2243] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.188323 20917 raft_consensus.cc:2272] T 369b15e6e4254982a559940734df1656 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.190992 20917 tablet_replica.cc:333] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.191982 20917 raft_consensus.cc:2243] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.192878 20917 raft_consensus.cc:2272] T 7befabab572c4ed8832b542ff35c0ee1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.195581 20917 tablet_replica.cc:333] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.196401 20917 raft_consensus.cc:2243] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.197438 20917 raft_consensus.cc:2272] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:22.202847 22776 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:28:22.204077 20917 tablet_replica.cc:333] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.204980 20917 raft_consensus.cc:2243] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.205686 20917 raft_consensus.cc:2272] T 3fd4242f251b46f1a7e47490973fd53c P ecc1814bfd604baa9cc66be8c02c5cfa [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.208390 20917 tablet_replica.cc:333] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.209299 20917 raft_consensus.cc:2243] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.210400 20917 raft_consensus.cc:2272] T ee09151218d04cb69512d91f7b843c32 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:22.210817 22775 consensus_peers.cc:597] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.213428 20917 tablet_replica.cc:333] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.214309 20917 raft_consensus.cc:2243] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.215013 20917 raft_consensus.cc:2272] T 9f20d90a634149ef85ae0b05adb8a34a P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.217985 20917 tablet_replica.cc:333] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.218847 20917 raft_consensus.cc:2243] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.219404 20917 raft_consensus.cc:2272] T cecfaeb2287f4f7db4bee651c8bc4a36 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.222360 20917 tablet_replica.cc:333] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.223197 20917 raft_consensus.cc:2243] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.223876 20917 raft_consensus.cc:2272] T b155a7c146564fdbb5330057eca55fd8 P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.226796 20917 tablet_replica.cc:333] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.227721 20917 raft_consensus.cc:2243] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.228844 20917 raft_consensus.cc:2272] T 161e19d23ae64fb1919e4e43e3e26bd3 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.231678 20917 tablet_replica.cc:333] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.232486 20917 raft_consensus.cc:2243] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.233356 20917 raft_consensus.cc:2272] T e7199ba25bca48e89b961cf6ef78ab28 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.236197 20917 tablet_replica.cc:333] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.236969 20917 raft_consensus.cc:2243] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.237916 20917 raft_consensus.cc:2272] T de6d6e7c5d4c484487206e2d8b43cebf P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.240598 20917 tablet_replica.cc:333] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.241385 20917 raft_consensus.cc:2243] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.242427 20917 raft_consensus.cc:2272] T 4d7ac68dfb384745935240b56803f52c P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.245177 20917 tablet_replica.cc:333] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.245918 20917 raft_consensus.cc:2243] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.246984 20917 raft_consensus.cc:2272] T 5b3632e739cf449a83c07dcdbce1528c P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.249758 20917 tablet_replica.cc:333] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.250557 20917 raft_consensus.cc:2243] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.252331 20917 raft_consensus.cc:2272] T 52ee10bae8ef4b668f33b9ef12e13a6a P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.255168 20917 tablet_replica.cc:333] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.255937 20917 raft_consensus.cc:2243] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.256601 20917 raft_consensus.cc:2272] T b35bc73fc9544276942bc2c3ee41e639 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.259147 20917 tablet_replica.cc:333] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.260003 20917 raft_consensus.cc:2243] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.260547 20917 raft_consensus.cc:2272] T 26519f93f2144612acf259d481dc4485 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.263006 20917 tablet_replica.cc:333] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.263739 20917 raft_consensus.cc:2243] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.264338 20917 raft_consensus.cc:2272] T f14db25b634d44dda22c20f58ac81a55 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.267293 20917 tablet_replica.cc:333] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.268018 20917 raft_consensus.cc:2243] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.268627 20917 raft_consensus.cc:2272] T cf2d9646522845819383a8daea185649 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.271142 20917 tablet_replica.cc:333] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.271921 20917 raft_consensus.cc:2243] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.273070 20917 raft_consensus.cc:2272] T ec5b05d9a0b94a05a3cdb04bbe7113b2 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.275908 20917 tablet_replica.cc:333] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.276661 20917 raft_consensus.cc:2243] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.278477 20917 raft_consensus.cc:2272] T a2d181824b34483d8653c405c650ec94 P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.281256 20917 tablet_replica.cc:333] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.282109 20917 raft_consensus.cc:2243] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.282980 20917 raft_consensus.cc:2272] T 5dae45fb2bfa401ab5a87bc3a8672e60 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.286576 20917 tablet_replica.cc:333] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
W20260709 12:28:22.286638 22775 consensus_peers.cc:597] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.287607 20917 raft_consensus.cc:2243] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.288403 20917 raft_consensus.cc:2272] T 68d18246b3984c719bedcfe7da84c5c5 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.291109 20917 tablet_replica.cc:333] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.291919 20917 raft_consensus.cc:2243] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.292538 20917 raft_consensus.cc:2272] T 66ebd42ef0064f2489bbc02ec3e9500b P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.295280 20917 tablet_replica.cc:333] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.296005 20917 raft_consensus.cc:2243] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.297111 20917 raft_consensus.cc:2272] T 754c2d759050420898a081f3dfa0a18c P ecc1814bfd604baa9cc66be8c02c5cfa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.299696 20917 tablet_replica.cc:333] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.300472 20917 raft_consensus.cc:2243] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.300992 20917 raft_consensus.cc:2272] T 953fcacc5a2943eeb23356e2f1c2cc5f P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.303428 20917 tablet_replica.cc:333] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.305948 20917 raft_consensus.cc:2243] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.306507 20917 raft_consensus.cc:2272] T 0ae34788927d43db8e0aa62c5dae8dd9 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:22.307356 22775 consensus_peers.cc:597] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.310653 20917 tablet_replica.cc:333] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.311441 20917 raft_consensus.cc:2243] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.312121 20917 raft_consensus.cc:2272] T 7e4753dcc01343d1b0ac9cef09e22af4 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.314705 20917 tablet_replica.cc:333] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.315411 20917 raft_consensus.cc:2243] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.315909 20917 raft_consensus.cc:2272] T 451d96b5461b4c21aa4930657c835b50 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.318313 20917 tablet_replica.cc:333] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.319005 20917 raft_consensus.cc:2243] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.320026 20917 raft_consensus.cc:2272] T f775ac681f8f42d3a3a16bf664e0bee7 P ecc1814bfd604baa9cc66be8c02c5cfa [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.322620 20917 tablet_replica.cc:333] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.323290 20917 raft_consensus.cc:2243] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.323858 20917 raft_consensus.cc:2272] T a71d215daee640dc8183aa5bb0a69a18 P ecc1814bfd604baa9cc66be8c02c5cfa [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.326288 20917 tablet_replica.cc:333] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.326989 20917 raft_consensus.cc:2243] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.327628 20917 raft_consensus.cc:2272] T f3c7f71fea4a4a6d815758ecce7a83cd P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.330192 20917 tablet_replica.cc:333] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.330862 20917 raft_consensus.cc:2243] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.331423 20917 raft_consensus.cc:2272] T 9bbdc6920d6f481f9edabac1f94774ff P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.333808 20917 tablet_replica.cc:333] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.334563 20917 raft_consensus.cc:2243] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.335636 20917 raft_consensus.cc:2272] T 12cca886b64e4c138e59114be95a8549 P ecc1814bfd604baa9cc66be8c02c5cfa [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.338047 20917 tablet_replica.cc:333] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.338797 20917 raft_consensus.cc:2243] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.339742 20917 raft_consensus.cc:2272] T 8fd1d178990d44f78512d81cdacd6b1d P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.342103 20917 tablet_replica.cc:333] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.342798 20917 raft_consensus.cc:2243] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.343410 20917 raft_consensus.cc:2272] T 1cfcc23bf9854a5e8cf97a83c188f631 P ecc1814bfd604baa9cc66be8c02c5cfa [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.346026 20917 tablet_replica.cc:333] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.346849 20917 raft_consensus.cc:2243] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.347941 20917 raft_consensus.cc:2272] T f3726200783e487b9963f5fc73170d31 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:22.348021 22775 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.351105 20917 tablet_replica.cc:333] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.351830 20917 raft_consensus.cc:2243] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.352367 20917 raft_consensus.cc:2272] T 1c9cf5f021f44b55831f1ed964025c7e P ecc1814bfd604baa9cc66be8c02c5cfa [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.354967 20917 tablet_replica.cc:333] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.355674 20917 raft_consensus.cc:2243] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.356549 20917 raft_consensus.cc:2272] T 9360ea2e8bd04bd899235529e921b05d P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.359251 20917 tablet_replica.cc:333] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.359885 20917 raft_consensus.cc:2243] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:22.360548 20917 raft_consensus.cc:2272] T 0007b92daafb42eda8843693014ea1d1 P ecc1814bfd604baa9cc66be8c02c5cfa [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:22.363121 20917 tablet_replica.cc:333] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa: stopping tablet replica
I20260709 12:28:22.363715 20917 raft_consensus.cc:2243] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:22.364797 20917 raft_consensus.cc:2272] T 03eee184731a4ec1bf7ba98505a56567 P ecc1814bfd604baa9cc66be8c02c5cfa [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:22.370764 22776 consensus_peers.cc:597] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:22.393445 22775 consensus_peers.cc:597] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.423722 22775 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.424914 22776 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:22.447018 22775 consensus_peers.cc:597] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.449376 22773 consensus_peers.cc:597] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.455834 22775 consensus_peers.cc:597] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.502861 22775 consensus_peers.cc:597] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.67:37787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.514326 22775 consensus_peers.cc:597] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Couldn't send request to peer ecc1814bfd604baa9cc66be8c02c5cfa. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.67:37787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.518739 22773 consensus_peers.cc:597] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.595315 22776 consensus_peers.cc:597] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:22.632609 22773 consensus_peers.cc:597] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.701910 22773 consensus_peers.cc:597] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.736456 22773 consensus_peers.cc:597] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.737569 22773 consensus_peers.cc:597] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.750877 22776 consensus_peers.cc:597] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:28:22.753671 22776 consensus_peers.cc:597] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:28:22.819474 22773 consensus_peers.cc:597] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.837952 22773 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.865916 22773 consensus_peers.cc:597] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.873122 22773 consensus_peers.cc:597] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.885481 22773 consensus_peers.cc:597] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.903564 22773 consensus_peers.cc:597] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.905543 22773 consensus_peers.cc:597] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:22.950551 22776 consensus_peers.cc:597] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:22.958382 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12cca886b64e4c138e59114be95a8549: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:22.984009 22773 consensus_peers.cc:597] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Couldn't send request to peer 67742f291ab04f8b8335d3919cf2d1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:23.154115 20917 tablet_server.cc:196] TabletServer@127.20.109.67:0 shutdown complete.
I20260709 12:28:23.221810 26294 raft_consensus.cc:493] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:23.223011 26294 raft_consensus.cc:515] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:23.226823 26301 raft_consensus.cc:493] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:23.227448 26301 raft_consensus.cc:515] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:23.228605 26294 leader_election.cc:290] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:23.229831 26301 leader_election.cc:290] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
W20260709 12:28:23.231158 22773 leader_election.cc:336] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
W20260709 12:28:23.234426 22773 leader_election.cc:336] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
W20260709 12:28:23.236013 22775 leader_election.cc:336] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Network error: Client connection negotiation failed: client connection to 127.20.109.67:37787: connect: Connection refused (error 111)
I20260709 12:28:23.236500 22775 leader_election.cc:304] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
W20260709 12:28:23.238298 22775 leader_election.cc:336] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Network error: Client connection negotiation failed: client connection to 127.20.109.67:37787: connect: Connection refused (error 111)
I20260709 12:28:23.238732 22775 leader_election.cc:304] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:23.239436 26295 raft_consensus.cc:2749] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:23.240096 26295 raft_consensus.cc:2749] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:23.245577 22776 consensus_peers.cc:597] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:23.285038 22776 consensus_peers.cc:597] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e -> Peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Couldn't send request to peer d465f3cb42174eb89615dcd747f9e682. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:28:23.293301 20917 tablet_server.cc:179] TabletServer@127.20.109.68:0 shutting down...
I20260709 12:28:23.350471 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:23.352015 20917 tablet_replica.cc:333] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.353986 20917 raft_consensus.cc:2243] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.354818 20917 raft_consensus.cc:2272] T b9f4ba2e44d142d4810d14babd35c984 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.357963 20917 tablet_replica.cc:333] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.358883 20917 raft_consensus.cc:2243] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.359465 26301 raft_consensus.cc:493] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 67742f291ab04f8b8335d3919cf2d1f7)
I20260709 12:28:23.359570 20917 raft_consensus.cc:2272] T 4d7ac68dfb384745935240b56803f52c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.359984 26301 raft_consensus.cc:515] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d465f3cb42174eb89615dcd747f9e682" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 38979 } } peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:23.362885 20917 tablet_replica.cc:333] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.363853 20917 raft_consensus.cc:2243] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.365197 20917 raft_consensus.cc:2272] T f3c7f71fea4a4a6d815758ecce7a83cd P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:23.366344 22776 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:23.367977 20917 tablet_replica.cc:333] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
W20260709 12:28:23.368332 22773 leader_election.cc:336] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:23.368762 22773 leader_election.cc:304] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, d465f3cb42174eb89615dcd747f9e682
I20260709 12:28:23.368899 20917 raft_consensus.cc:2243] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.369632 26294 raft_consensus.cc:2749] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:23.370368 20917 raft_consensus.cc:2272] T 4321547cceb341b9babe64debb9fb125 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.370672 26301 leader_election.cc:290] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979), 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283)
I20260709 12:28:23.373268 20917 tablet_replica.cc:333] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.374157 20917 raft_consensus.cc:2243] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.375212 20917 raft_consensus.cc:2272] T a2d181824b34483d8653c405c650ec94 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.377908 20917 tablet_replica.cc:333] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.378762 20917 raft_consensus.cc:2243] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.379834 20917 raft_consensus.cc:2272] T ce0cbcda6ab94ef68d36321d19671059 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.382580 20917 tablet_replica.cc:333] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.383358 20917 raft_consensus.cc:2243] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.384533 20917 raft_consensus.cc:2272] T 68d18246b3984c719bedcfe7da84c5c5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.387195 20917 tablet_replica.cc:333] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.387971 20917 raft_consensus.cc:2243] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.389019 20917 pending_rounds.cc:70] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Trying to abort 1 pending ops.
I20260709 12:28:23.389333 20917 pending_rounds.cc:77] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e: Aborting op as it isn't in flight: id { term: 9 index: 9 } timestamp: 7305626017238585344 op_type: NO_OP noop_request { }
I20260709 12:28:23.389778 20917 raft_consensus.cc:2889] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:28:23.390118 20917 raft_consensus.cc:2272] T cecfaeb2287f4f7db4bee651c8bc4a36 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.392704 20917 tablet_replica.cc:333] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.393483 20917 raft_consensus.cc:2243] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.394624 20917 raft_consensus.cc:2272] T de6d6e7c5d4c484487206e2d8b43cebf P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.397286 20917 tablet_replica.cc:333] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.398038 20917 raft_consensus.cc:2243] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.398739 20917 raft_consensus.cc:2272] T e7199ba25bca48e89b961cf6ef78ab28 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.401453 20917 tablet_replica.cc:333] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.402223 20917 raft_consensus.cc:2243] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.402812 20917 raft_consensus.cc:2272] T 161e19d23ae64fb1919e4e43e3e26bd3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.405543 20917 tablet_replica.cc:333] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.406339 20917 raft_consensus.cc:2243] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.407269 20917 raft_consensus.cc:2272] T 2601e033c5b34310a9d1582b3d94c3aa P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.409623 20917 tablet_replica.cc:333] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.410279 20917 raft_consensus.cc:2243] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.411347 20917 raft_consensus.cc:2272] T 12cca886b64e4c138e59114be95a8549 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.413678 20917 tablet_replica.cc:333] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.413785 26301 raft_consensus.cc:493] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecc1814bfd604baa9cc66be8c02c5cfa)
I20260709 12:28:23.414296 20917 raft_consensus.cc:2243] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.414346 26301 raft_consensus.cc:515] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "67742f291ab04f8b8335d3919cf2d1f7" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 46283 } } peers { permanent_uuid: "ecc1814bfd604baa9cc66be8c02c5cfa" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37787 } } peers { permanent_uuid: "7ff8d9fd78c1454cacc77bbc1bfb992e" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41677 } attrs { promote: false } }
I20260709 12:28:23.415513 20917 raft_consensus.cc:2272] T 6b8326670393490f9fabe3827cd6d958 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.418071 20917 tablet_replica.cc:333] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.419018 20917 raft_consensus.cc:2243] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.416755 26301 leader_election.cc:290] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283), ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787)
I20260709 12:28:23.420198 20917 raft_consensus.cc:2272] T b155a7c146564fdbb5330057eca55fd8 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:23.421365 22775 leader_election.cc:336] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ecc1814bfd604baa9cc66be8c02c5cfa (127.20.109.67:37787): Network error: Client connection negotiation failed: client connection to 127.20.109.67:37787: connect: Connection refused (error 111)
W20260709 12:28:23.422610 22773 leader_election.cc:336] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 67742f291ab04f8b8335d3919cf2d1f7 (127.20.109.66:46283): Network error: Client connection negotiation failed: client connection to 127.20.109.66:46283: connect: Connection refused (error 111)
I20260709 12:28:23.422781 20917 tablet_replica.cc:333] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.423030 22773 leader_election.cc:304] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ff8d9fd78c1454cacc77bbc1bfb992e; no voters: 67742f291ab04f8b8335d3919cf2d1f7, ecc1814bfd604baa9cc66be8c02c5cfa
I20260709 12:28:23.423621 20917 raft_consensus.cc:2243] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.423729 26301 raft_consensus.cc:2749] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:23.424702 20917 raft_consensus.cc:2272] T 953fcacc5a2943eeb23356e2f1c2cc5f P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.426827 20917 tablet_replica.cc:333] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.427364 20917 raft_consensus.cc:2243] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.427985 20917 raft_consensus.cc:2272] T 5b3632e739cf449a83c07dcdbce1528c P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.429978 20917 tablet_replica.cc:333] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.430523 20917 raft_consensus.cc:2243] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.431430 20917 raft_consensus.cc:2272] T 26519f93f2144612acf259d481dc4485 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.433347 20917 tablet_replica.cc:333] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.433892 20917 raft_consensus.cc:2243] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.434456 20917 raft_consensus.cc:2272] T 0a00dfd4bb864cbe94033b53b925fd76 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.436596 20917 tablet_replica.cc:333] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.437211 20917 raft_consensus.cc:2243] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.437644 20917 raft_consensus.cc:2272] T 57757a075ae444bf9e3ae62e6892f42a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.439576 20917 tablet_replica.cc:333] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.440091 20917 raft_consensus.cc:2243] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.440548 20917 raft_consensus.cc:2272] T 03eee184731a4ec1bf7ba98505a56567 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.442526 20917 tablet_replica.cc:333] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.443090 20917 raft_consensus.cc:2243] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.443887 20917 raft_consensus.cc:2272] T 9360ea2e8bd04bd899235529e921b05d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.445712 20917 tablet_replica.cc:333] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.446233 20917 raft_consensus.cc:2243] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.447012 20917 raft_consensus.cc:2272] T 451d96b5461b4c21aa4930657c835b50 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.448884 20917 tablet_replica.cc:333] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.449477 20917 raft_consensus.cc:2243] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.449949 20917 raft_consensus.cc:2272] T f775ac681f8f42d3a3a16bf664e0bee7 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.451748 20917 tablet_replica.cc:333] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.452270 20917 raft_consensus.cc:2243] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.453128 20917 raft_consensus.cc:2272] T 43ce66af87f04e5db12d1d3b0ed6ffd5 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.455101 20917 tablet_replica.cc:333] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.455648 20917 raft_consensus.cc:2243] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.456629 20917 raft_consensus.cc:2272] T 39f024f1dc1c4aaaa8094ad37822a6e1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.459358 20917 tablet_replica.cc:333] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.460111 20917 raft_consensus.cc:2243] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.460659 20917 raft_consensus.cc:2272] T ee09151218d04cb69512d91f7b843c32 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.463426 20917 tablet_replica.cc:333] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.464134 20917 raft_consensus.cc:2243] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.465113 20917 raft_consensus.cc:2272] T 9f20d90a634149ef85ae0b05adb8a34a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.467588 20917 tablet_replica.cc:333] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.468302 20917 raft_consensus.cc:2243] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.469292 20917 raft_consensus.cc:2272] T 369b15e6e4254982a559940734df1656 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.471800 20917 tablet_replica.cc:333] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.472529 20917 raft_consensus.cc:2243] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.473606 20917 raft_consensus.cc:2272] T 6b1a99afb1f741bf8a2d6318f0ca4e2b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.476078 20917 tablet_replica.cc:333] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.476796 20917 raft_consensus.cc:2243] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.477844 20917 raft_consensus.cc:2272] T 7befabab572c4ed8832b542ff35c0ee1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.480502 20917 tablet_replica.cc:333] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.481299 20917 raft_consensus.cc:2243] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.482384 20917 raft_consensus.cc:2272] T 5e537942a08e4c8fbf26a1a0084997c4 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.485114 20917 tablet_replica.cc:333] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.485822 20917 raft_consensus.cc:2243] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.486402 20917 raft_consensus.cc:2272] T 2772ed1f79a846e3852654dad2c86235 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.488915 20917 tablet_replica.cc:333] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.489588 20917 raft_consensus.cc:2243] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.490540 20917 raft_consensus.cc:2272] T 1c9cf5f021f44b55831f1ed964025c7e P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.493007 20917 tablet_replica.cc:333] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.493757 20917 raft_consensus.cc:2243] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.494378 20917 raft_consensus.cc:2272] T 52ee10bae8ef4b668f33b9ef12e13a6a P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.496948 20917 tablet_replica.cc:333] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.497605 20917 raft_consensus.cc:2243] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.498136 20917 raft_consensus.cc:2272] T 4ec6cbbf70dc43daa892eda3ef90f702 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.500588 20917 tablet_replica.cc:333] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.501310 20917 raft_consensus.cc:2243] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.502282 20917 raft_consensus.cc:2272] T 838948750f334b409ad4d7798a822e6d P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.504722 20917 tablet_replica.cc:333] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.505453 20917 raft_consensus.cc:2243] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.506436 20917 raft_consensus.cc:2272] T 147ee46d74a94d69bbe00644cd192cc2 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.508879 20917 tablet_replica.cc:333] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.509574 20917 raft_consensus.cc:2243] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.510550 20917 raft_consensus.cc:2272] T 0007b92daafb42eda8843693014ea1d1 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.513118 20917 tablet_replica.cc:333] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.513808 20917 raft_consensus.cc:2243] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.514371 20917 raft_consensus.cc:2272] T 48a34f9ae8654955bc6eda7229323ca3 P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.516785 20917 tablet_replica.cc:333] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.517439 20917 raft_consensus.cc:2243] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:23.517982 20917 raft_consensus.cc:2272] T e92d357da9e844b2ae270e73b28170db P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.520471 20917 tablet_replica.cc:333] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e: stopping tablet replica
I20260709 12:28:23.521008 20917 raft_consensus.cc:2243] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:23.521963 20917 raft_consensus.cc:2272] T 66ebd42ef0064f2489bbc02ec3e9500b P 7ff8d9fd78c1454cacc77bbc1bfb992e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:23.968401 20917 tablet_server.cc:196] TabletServer@127.20.109.68:0 shutdown complete.
I20260709 12:28:24.038056 20917 master.cc:562] Master@127.20.109.126:41439 shutting down...
W20260709 12:28:24.067062 22019 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:28:24.067378 22019 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:28:24.067569 22019 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:28:34.346979 21958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111) [suppressed 171 similar messages]
W20260709 12:28:34.350739 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a2d181824b34483d8653c405c650ec94: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:39.386564 21958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
W20260709 12:28:39.390358 21958 catalog_manager.cc:4755] TS d465f3cb42174eb89615dcd747f9e682 (127.20.109.65:38979): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12cca886b64e4c138e59114be95a8549: Network error: Client connection negotiation failed: client connection to 127.20.109.65:38979: connect: Connection refused (error 111)
I20260709 12:28:41.077975 20917 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.079077 20917 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.079461 20917 tablet_replica.cc:333] T 00000000000000000000000000000000 P 338e7fd7f8b642b4a2b24f544ca70832: stopping tablet replica
I20260709 12:28:41.275665 20917 master.cc:584] Master@127.20.109.126:41439 shutdown complete.
I20260709 12:28:41.326570 20917 test_util.cc:182] -----------------------------------------------
I20260709 12:28:41.326824 20917 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893634731-20917-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (166765 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:28:41.330199 20917 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.109.126:41885
I20260709 12:28:41.331321 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:41.336977 26312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.337033 26311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.338660 26314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.339449 20917 server_base.cc:1061] running on GCE node
I20260709 12:28:41.341632 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:41.341830 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:41.341976 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600121341959 us; error 0 us; skew 500 ppm
I20260709 12:28:41.342471 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:41.345104 20917 webserver.cc:533] Webserver started at http://127.20.109.126:39465/ using document root <none> and password file <none>
I20260709 12:28:41.345630 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:41.345810 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:41.346066 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:41.347353 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/master-0-root/instance:
uuid: "c1f77ce91dcd42a18ee69e76f6c05165"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.351886 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:28:41.355228 26319 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.355907 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:41.356185 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/master-0-root
uuid: "c1f77ce91dcd42a18ee69e76f6c05165"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.356457 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:41.376937 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:41.378201 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:41.418392 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.126:41885
I20260709 12:28:41.418502 26370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.126:41885 every 8 connection(s)
I20260709 12:28:41.422675 26371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:41.434295 26371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165: Bootstrap starting.
I20260709 12:28:41.440142 26371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:41.444510 26371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165: No bootstrap required, opened a new log
I20260709 12:28:41.446908 26371 raft_consensus.cc:359] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f77ce91dcd42a18ee69e76f6c05165" member_type: VOTER }
I20260709 12:28:41.447378 26371 raft_consensus.cc:385] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:41.447566 26371 raft_consensus.cc:740] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f77ce91dcd42a18ee69e76f6c05165, State: Initialized, Role: FOLLOWER
I20260709 12:28:41.448081 26371 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f77ce91dcd42a18ee69e76f6c05165" member_type: VOTER }
I20260709 12:28:41.448555 26371 raft_consensus.cc:399] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:41.448762 26371 raft_consensus.cc:493] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:41.448987 26371 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:41.453920 26371 raft_consensus.cc:515] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f77ce91dcd42a18ee69e76f6c05165" member_type: VOTER }
I20260709 12:28:41.454452 26371 leader_election.cc:304] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1f77ce91dcd42a18ee69e76f6c05165; no voters: 
I20260709 12:28:41.456040 26371 leader_election.cc:290] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:41.456333 26374 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:41.457877 26374 raft_consensus.cc:697] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 1 LEADER]: Becoming Leader. State: Replica: c1f77ce91dcd42a18ee69e76f6c05165, State: Running, Role: LEADER
I20260709 12:28:41.458743 26374 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f77ce91dcd42a18ee69e76f6c05165" member_type: VOTER }
I20260709 12:28:41.459882 26371 sys_catalog.cc:565] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:41.465338 26376 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1f77ce91dcd42a18ee69e76f6c05165. Latest consensus state: current_term: 1 leader_uuid: "c1f77ce91dcd42a18ee69e76f6c05165" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f77ce91dcd42a18ee69e76f6c05165" member_type: VOTER } }
I20260709 12:28:41.465626 26375 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1f77ce91dcd42a18ee69e76f6c05165" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f77ce91dcd42a18ee69e76f6c05165" member_type: VOTER } }
I20260709 12:28:41.466090 26376 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:41.466199 26375 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:41.468137 26381 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:41.473290 26381 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:41.477820 20917 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:41.483536 26381 catalog_manager.cc:1383] Generated new cluster ID: 6e78924a46f74faaa0c471867fe23e4a
I20260709 12:28:41.483861 26381 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:41.519461 26381 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:41.520834 26381 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:41.532557 26381 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165: Generated new TSK 0
I20260709 12:28:41.533214 26381 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:41.544925 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:41.551321 26392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.552103 26393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.553812 26395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.554801 20917 server_base.cc:1061] running on GCE node
I20260709 12:28:41.556758 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:41.556970 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:41.557142 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600121557121 us; error 0 us; skew 500 ppm
I20260709 12:28:41.557706 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:41.560583 20917 webserver.cc:533] Webserver started at http://127.20.109.65:38337/ using document root <none> and password file <none>
I20260709 12:28:41.561090 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:41.561273 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:41.561574 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:41.562902 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/instance:
uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.567782 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:28:41.571434 26400 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.572368 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:28:41.572700 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.572999 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:41.592505 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:41.593840 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:41.595781 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:41.598366 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:41.598583 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.598874 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:41.599066 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.642753 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:39541
I20260709 12:28:41.642858 26462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:39541 every 8 connection(s)
I20260709 12:28:41.648182 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:41.655915 26467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.658131 26468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.663010 20917 server_base.cc:1061] running on GCE node
W20260709 12:28:41.663335 26471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.665407 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:41.665707 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:41.665917 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600121665896 us; error 0 us; skew 500 ppm
I20260709 12:28:41.666649 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:41.669085 26463 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41885
I20260709 12:28:41.669466 26463 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:41.669658 20917 webserver.cc:533] Webserver started at http://127.20.109.66:36357/ using document root <none> and password file <none>
I20260709 12:28:41.670277 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:41.670456 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:41.670765 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:41.670495 26463 heartbeater.cc:507] Master 127.20.109.126:41885 requested a full tablet report, sending...
I20260709 12:28:41.672516 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/instance:
uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.673928 26336 ts_manager.cc:194] Registered new tserver with Master: baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:41.676543 26336 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45812
I20260709 12:28:41.678277 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:28:41.682893 26475 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.684016 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:28:41.684383 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-1-root
uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.684706 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:41.694905 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:41.696275 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:41.697824 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:41.700361 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:41.700577 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.700837 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:41.700990 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.743501 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.66:34053
I20260709 12:28:41.743637 26537 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.66:34053 every 8 connection(s)
I20260709 12:28:41.748816 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:41.757033 26541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.759234 26542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.762727 20917 server_base.cc:1061] running on GCE node
I20260709 12:28:41.763247 26538 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41885
I20260709 12:28:41.763713 26538 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:41.764545 26538 heartbeater.cc:507] Master 127.20.109.126:41885 requested a full tablet report, sending...
W20260709 12:28:41.764624 26544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.765801 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:41.766032 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:41.766216 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600121766194 us; error 0 us; skew 500 ppm
I20260709 12:28:41.766844 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:41.766935 26336 ts_manager.cc:194] Registered new tserver with Master: 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:41.768733 26336 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45818
I20260709 12:28:41.769663 20917 webserver.cc:533] Webserver started at http://127.20.109.67:40093/ using document root <none> and password file <none>
I20260709 12:28:41.770268 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:41.770462 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:41.770758 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:41.772136 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/instance:
uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.777007 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:28:41.781490 26549 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.782392 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:28:41.782747 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-2-root
uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.783077 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:41.801833 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:41.803259 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:41.804853 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:41.807379 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:41.807606 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.807842 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:41.807996 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.852103 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.67:38163
I20260709 12:28:41.852200 26611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.67:38163 every 8 connection(s)
I20260709 12:28:41.857043 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:41.865314 26615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.865962 26616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.869308 20917 server_base.cc:1061] running on GCE node
W20260709 12:28:41.870173 26618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.871536 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:41.871788 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:41.872016 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600121871994 us; error 0 us; skew 500 ppm
I20260709 12:28:41.872124 26612 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41885
I20260709 12:28:41.872556 26612 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:41.872759 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:41.873420 26612 heartbeater.cc:507] Master 127.20.109.126:41885 requested a full tablet report, sending...
I20260709 12:28:41.875855 20917 webserver.cc:533] Webserver started at http://127.20.109.68:36441/ using document root <none> and password file <none>
I20260709 12:28:41.875976 26336 ts_manager.cc:194] Registered new tserver with Master: 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:41.876427 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:41.876672 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:41.876945 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:41.877619 26336 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45822
I20260709 12:28:41.878163 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-3-root/instance:
uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.883632 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:41.887537 26623 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.888381 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:28:41.888703 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-3-root
uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:41.888998 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:41.934212 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:41.935648 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:41.937332 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:41.939888 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:41.940151 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.940392 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:41.940548 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.987771 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.68:41855
I20260709 12:28:41.987871 26685 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.68:41855 every 8 connection(s)
I20260709 12:28:42.003018 26686 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41885
I20260709 12:28:42.003636 26686 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:42.004567 26686 heartbeater.cc:507] Master 127.20.109.126:41885 requested a full tablet report, sending...
I20260709 12:28:42.006714 26336 ts_manager.cc:194] Registered new tserver with Master: 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:42.007514 20917 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016486552s
I20260709 12:28:42.008337 26336 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45824
I20260709 12:28:42.037988 26336 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45826:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:28:42.297984 26650 tablet_service.cc:1511] Processing CreateTablet for tablet be63fec868ca40ea8667c7fac2c3c613 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:42.299743 26649 tablet_service.cc:1511] Processing CreateTablet for tablet a2acc4a4b3b54b9381d3203a4023ba71 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:42.302209 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 90f36d35c0b94881b6f8db11a1caa351 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:42.303287 26577 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2a8cf91f76492d8418cba471ffe78e (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:42.304158 26651 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2a8cf91f76492d8418cba471ffe78e (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:42.305032 26577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2a8cf91f76492d8418cba471ffe78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.299762 26650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be63fec868ca40ea8667c7fac2c3c613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.306998 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2acc4a4b3b54b9381d3203a4023ba71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.307869 26576 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2846cdd8904c908b6cb1a8f6e42aaf (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:42.309404 26576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2846cdd8904c908b6cb1a8f6e42aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.310176 26503 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2846cdd8904c908b6cb1a8f6e42aaf (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:42.311777 26503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2846cdd8904c908b6cb1a8f6e42aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.311991 26651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2a8cf91f76492d8418cba471ffe78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.311911 26575 tablet_service.cc:1511] Processing CreateTablet for tablet a2acc4a4b3b54b9381d3203a4023ba71 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:42.313586 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2acc4a4b3b54b9381d3203a4023ba71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.315094 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f36d35c0b94881b6f8db11a1caa351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.315842 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 90f36d35c0b94881b6f8db11a1caa351 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:42.316390 26500 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca98a19b190437eafaa2f7cd74e53df (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:42.315147 26501 tablet_service.cc:1511] Processing CreateTablet for tablet a2acc4a4b3b54b9381d3203a4023ba71 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:42.318945 26498 tablet_service.cc:1511] Processing CreateTablet for tablet 98f2bb8815884926800b1e9c023f2897 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:42.320928 26574 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca98a19b190437eafaa2f7cd74e53df (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:42.321512 26497 tablet_service.cc:1511] Processing CreateTablet for tablet b75ba30f9857421393dc3f00cdf47f21 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:42.322986 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2acc4a4b3b54b9381d3203a4023ba71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.324107 26500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca98a19b190437eafaa2f7cd74e53df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.323844 26573 tablet_service.cc:1511] Processing CreateTablet for tablet 6aefe5d0dc7846ca9db57012baae4777 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:42.325850 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75ba30f9857421393dc3f00cdf47f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.319519 26571 tablet_service.cc:1511] Processing CreateTablet for tablet b75ba30f9857421393dc3f00cdf47f21 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:42.326376 26572 tablet_service.cc:1511] Processing CreateTablet for tablet 98f2bb8815884926800b1e9c023f2897 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:42.313223 26502 tablet_service.cc:1511] Processing CreateTablet for tablet be63fec868ca40ea8667c7fac2c3c613 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:42.330367 26502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be63fec868ca40ea8667c7fac2c3c613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.333586 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f36d35c0b94881b6f8db11a1caa351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.335764 26647 tablet_service.cc:1511] Processing CreateTablet for tablet 6aefe5d0dc7846ca9db57012baae4777 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:42.337581 26647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aefe5d0dc7846ca9db57012baae4777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.338910 26495 tablet_service.cc:1511] Processing CreateTablet for tablet cc8bb74cfe63435e983f2e9258c229ba (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:42.339184 26646 tablet_service.cc:1511] Processing CreateTablet for tablet 98f2bb8815884926800b1e9c023f2897 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:42.339666 26643 tablet_service.cc:1511] Processing CreateTablet for tablet cc8bb74cfe63435e983f2e9258c229ba (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:42.340188 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f2bb8815884926800b1e9c023f2897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.340759 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f2bb8815884926800b1e9c023f2897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.336076 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 247d4b40ff7f4c7ca1055cb3856c254d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:42.335805 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 247d4b40ff7f4c7ca1055cb3856c254d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:42.342226 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8bb74cfe63435e983f2e9258c229ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.342290 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247d4b40ff7f4c7ca1055cb3856c254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.343428 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247d4b40ff7f4c7ca1055cb3856c254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.344264 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8bb74cfe63435e983f2e9258c229ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.337154 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 98dacc178cef46228ca27e7e2085dd8a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:42.345490 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dacc178cef46228ca27e7e2085dd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.322503 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca98a19b190437eafaa2f7cd74e53df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.348099 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aefe5d0dc7846ca9db57012baae4777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.348850 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 488122ee22144275b3f537809a55060d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:42.349435 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f2bb8815884926800b1e9c023f2897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.350585 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488122ee22144275b3f537809a55060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.351012 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75ba30f9857421393dc3f00cdf47f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.364881 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 32ca6dc5d4574e99b2919d9261d9cb28 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:42.366889 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ca6dc5d4574e99b2919d9261d9cb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.367686 26570 tablet_service.cc:1511] Processing CreateTablet for tablet 98dacc178cef46228ca27e7e2085dd8a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:42.369297 26570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dacc178cef46228ca27e7e2085dd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.388725 26569 tablet_service.cc:1511] Processing CreateTablet for tablet cc8bb74cfe63435e983f2e9258c229ba (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:42.390267 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8bb74cfe63435e983f2e9258c229ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.394820 26428 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2a8cf91f76492d8418cba471ffe78e (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:42.396404 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2a8cf91f76492d8418cba471ffe78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.399895 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2846cdd8904c908b6cb1a8f6e42aaf (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:42.401491 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2846cdd8904c908b6cb1a8f6e42aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.403954 26426 tablet_service.cc:1511] Processing CreateTablet for tablet be63fec868ca40ea8667c7fac2c3c613 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:42.405582 26426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be63fec868ca40ea8667c7fac2c3c613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.407904 26425 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca98a19b190437eafaa2f7cd74e53df (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:42.410465 26424 tablet_service.cc:1511] Processing CreateTablet for tablet 90f36d35c0b94881b6f8db11a1caa351 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:42.413173 26423 tablet_service.cc:1511] Processing CreateTablet for tablet 6aefe5d0dc7846ca9db57012baae4777 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:42.415884 26568 tablet_service.cc:1511] Processing CreateTablet for tablet 488122ee22144275b3f537809a55060d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:42.417378 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488122ee22144275b3f537809a55060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.424401 26421 tablet_service.cc:1511] Processing CreateTablet for tablet 247d4b40ff7f4c7ca1055cb3856c254d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:42.422160 26422 tablet_service.cc:1511] Processing CreateTablet for tablet b75ba30f9857421393dc3f00cdf47f21 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:42.427546 26420 tablet_service.cc:1511] Processing CreateTablet for tablet 98dacc178cef46228ca27e7e2085dd8a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:42.429999 26419 tablet_service.cc:1511] Processing CreateTablet for tablet 488122ee22144275b3f537809a55060d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:42.456154 26707 tablet_bootstrap.cc:492] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:42.457587 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca98a19b190437eafaa2f7cd74e53df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:42.474897 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:42.475855 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f36d35c0b94881b6f8db11a1caa351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.477442 26419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488122ee22144275b3f537809a55060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.478431 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247d4b40ff7f4c7ca1055cb3856c254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.482689 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75ba30f9857421393dc3f00cdf47f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.495651 26643 tablet_service.cc:1511] Processing CreateTablet for tablet fdb336eb1945459da39038940beae620 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:42.497155 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb336eb1945459da39038940beae620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.500360 26577 tablet_service.cc:1511] Processing CreateTablet for tablet fdb336eb1945459da39038940beae620 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:42.501847 26577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb336eb1945459da39038940beae620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.508936 26501 tablet_service.cc:1511] Processing CreateTablet for tablet 32ca6dc5d4574e99b2919d9261d9cb28 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:42.510440 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ca6dc5d4574e99b2919d9261d9cb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.520612 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 57aa38006440444a86a6ec5138a99183 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:42.521224 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 57aa38006440444a86a6ec5138a99183 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:42.522104 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57aa38006440444a86a6ec5138a99183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.522555 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57aa38006440444a86a6ec5138a99183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.531574 26708 tablet_bootstrap.cc:492] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:42.543133 26706 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:42.544726 26708 tablet_bootstrap.cc:654] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.547443 26420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dacc178cef46228ca27e7e2085dd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.551036 26423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aefe5d0dc7846ca9db57012baae4777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.554522 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 57aa38006440444a86a6ec5138a99183 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:42.556102 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57aa38006440444a86a6ec5138a99183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.577517 26706 tablet_bootstrap.cc:654] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.580387 26707 tablet_bootstrap.cc:654] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.634470 26706 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:42.635053 26706 ts_tablet_manager.cc:1403] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.008s
I20260709 12:28:42.635480 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca2070ba0446fd83db9a1ac2b7f3b8 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:42.637080 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca2070ba0446fd83db9a1ac2b7f3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.642700 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca2070ba0446fd83db9a1ac2b7f3b8 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:42.644201 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca2070ba0446fd83db9a1ac2b7f3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.643348 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf8f563ecd14874baedead593c9a98a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:42.647185 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf8f563ecd14874baedead593c9a98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.655638 26709 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:42.674482 26708 tablet_bootstrap.cc:492] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:42.675180 26708 ts_tablet_manager.cc:1403] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.144s	user 0.022s	sys 0.000s
I20260709 12:28:42.678587 26706 raft_consensus.cc:359] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:42.679493 26706 raft_consensus.cc:385] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.679808 26706 raft_consensus.cc:740] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.680394 26463 heartbeater.cc:499] Master 127.20.109.126:41885 was elected leader, sending a full tablet report...
I20260709 12:28:42.681089 26706 consensus_queue.cc:260] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:42.679867 26425 tablet_service.cc:1511] Processing CreateTablet for tablet 32ca6dc5d4574e99b2919d9261d9cb28 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:42.684872 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ca6dc5d4574e99b2919d9261d9cb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.679982 26707 tablet_bootstrap.cc:492] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:42.691388 26707 ts_tablet_manager.cc:1403] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.005s
I20260709 12:28:42.689235 26503 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf8f563ecd14874baedead593c9a98a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:42.689756 26709 tablet_bootstrap.cc:654] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.711445 26503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf8f563ecd14874baedead593c9a98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.695736 26707 raft_consensus.cc:359] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.714054 26707 raft_consensus.cc:385] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.707602 26577 tablet_service.cc:1511] Processing CreateTablet for tablet 1a863d2269ed4c85b7844c44d071ef2f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:42.708868 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 1a863d2269ed4c85b7844c44d071ef2f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:42.715603 26577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a863d2269ed4c85b7844c44d071ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.716846 26428 tablet_service.cc:1511] Processing CreateTablet for tablet fdb336eb1945459da39038940beae620 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:42.715703 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a863d2269ed4c85b7844c44d071ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.714465 26707 raft_consensus.cc:740] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.723268 26707 consensus_queue.cc:260] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.723793 26421 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf8f563ecd14874baedead593c9a98a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:42.723927 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca2070ba0446fd83db9a1ac2b7f3b8 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:42.718313 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb336eb1945459da39038940beae620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.730477 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca2070ba0446fd83db9a1ac2b7f3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.731191 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf8f563ecd14874baedead593c9a98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.750339 26706 ts_tablet_manager.cc:1434] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.010s
I20260709 12:28:42.756196 26612 heartbeater.cc:499] Master 127.20.109.126:41885 was elected leader, sending a full tablet report...
I20260709 12:28:42.756321 26706 tablet_bootstrap.cc:492] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:42.761462 26644 tablet_service.cc:1511] Processing CreateTablet for tablet a00d7cbf01954fb19c18146550c0ca07 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:42.763015 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a00d7cbf01954fb19c18146550c0ca07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.763579 26686 heartbeater.cc:499] Master 127.20.109.126:41885 was elected leader, sending a full tablet report...
I20260709 12:28:42.764241 26501 tablet_service.cc:1511] Processing CreateTablet for tablet a00d7cbf01954fb19c18146550c0ca07 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:42.765683 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a00d7cbf01954fb19c18146550c0ca07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.771890 26709 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:42.772503 26709 ts_tablet_manager.cc:1403] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.004s
I20260709 12:28:42.772526 26538 heartbeater.cc:499] Master 127.20.109.126:41885 was elected leader, sending a full tablet report...
I20260709 12:28:42.778286 26715 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.778998 26715 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.780771 26707 ts_tablet_manager.cc:1434] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.009s
I20260709 12:28:42.782084 26495 tablet_service.cc:1511] Processing CreateTablet for tablet fb27c0ed64f74c578dbcd030e17d00a4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:42.802742 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb27c0ed64f74c578dbcd030e17d00a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.802772 26707 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:42.783360 26422 tablet_service.cc:1511] Processing CreateTablet for tablet 1a863d2269ed4c85b7844c44d071ef2f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:42.809437 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a863d2269ed4c85b7844c44d071ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.782182 26424 tablet_service.cc:1511] Processing CreateTablet for tablet fb27c0ed64f74c578dbcd030e17d00a4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:42.810329 26715 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:42.811514 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb27c0ed64f74c578dbcd030e17d00a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.750339 26708 raft_consensus.cc:359] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.812525 26708 raft_consensus.cc:385] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.812866 26708 raft_consensus.cc:740] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.813676 26708 consensus_queue.cc:260] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.784364 26713 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.815109 26713 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:42.798687 26569 tablet_service.cc:1511] Processing CreateTablet for tablet fb27c0ed64f74c578dbcd030e17d00a4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:42.800825 26709 raft_consensus.cc:359] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:42.819926 26709 raft_consensus.cc:385] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.820315 26709 raft_consensus.cc:740] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.820574 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb27c0ed64f74c578dbcd030e17d00a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.784504 26575 tablet_service.cc:1511] Processing CreateTablet for tablet a00d7cbf01954fb19c18146550c0ca07 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:42.821208 26709 consensus_queue.cc:260] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:42.786188 26706 tablet_bootstrap.cc:654] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.827057 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a00d7cbf01954fb19c18146550c0ca07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.834444 26648 tablet_service.cc:1511] Processing CreateTablet for tablet ede359b4a846419ca0057e565814c444 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:42.836004 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede359b4a846419ca0057e565814c444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.836432 26502 tablet_service.cc:1511] Processing CreateTablet for tablet d32ec030f9c24f4591d2794595b4bd1c (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:28:42.837918 26502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d32ec030f9c24f4591d2794595b4bd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.841773 26713 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:42.844090 26645 tablet_service.cc:1511] Processing CreateTablet for tablet d32ec030f9c24f4591d2794595b4bd1c (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:28:42.844614 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 22f24da90c1944079124e5b4c1ba4733 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:42.847744 26425 tablet_service.cc:1511] Processing CreateTablet for tablet ede359b4a846419ca0057e565814c444 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:42.858768 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f24da90c1944079124e5b4c1ba4733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.859089 26709 ts_tablet_manager.cc:1434] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.005s
I20260709 12:28:42.859587 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede359b4a846419ca0057e565814c444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.860261 26709 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:42.868391 26428 tablet_service.cc:1511] Processing CreateTablet for tablet d32ec030f9c24f4591d2794595b4bd1c (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:28:42.855847 26707 tablet_bootstrap.cc:654] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:42.857060 26613 tablet.cc:2406] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:42.858768 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d32ec030f9c24f4591d2794595b4bd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.879967 26708 ts_tablet_manager.cc:1434] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.204s	user 0.010s	sys 0.004s
I20260709 12:28:42.881091 26708 tablet_bootstrap.cc:492] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:42.883236 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d32ec030f9c24f4591d2794595b4bd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.889067 26577 tablet_service.cc:1511] Processing CreateTablet for tablet ede359b4a846419ca0057e565814c444 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:42.898767 26577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede359b4a846419ca0057e565814c444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.900507 26706 tablet_bootstrap.cc:492] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:42.901140 26706 ts_tablet_manager.cc:1403] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.006s
I20260709 12:28:42.909686 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:42.918258 26709 tablet_bootstrap.cc:654] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.924168 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:42.925707 26706 raft_consensus.cc:359] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.928117 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:28:42.930444 26625 leader_election.cc:343] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:42.935199 26706 raft_consensus.cc:385] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:28:42.935354 26550 leader_election.cc:343] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:42.935633 26706 raft_consensus.cc:740] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.936471 26706 consensus_queue.cc:260] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.937417 26587 raft_consensus.cc:2468] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:42.941017 26625 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:42.942724 26715 raft_consensus.cc:2804] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:42.943145 26715 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.943424 26708 tablet_bootstrap.cc:654] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.943771 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 828700bf20fa4c988e072c6d158102fc (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:42.943508 26715 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.945314 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828700bf20fa4c988e072c6d158102fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.946237 26571 tablet_service.cc:1511] Processing CreateTablet for tablet 22f24da90c1944079124e5b4c1ba4733 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:42.947798 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f24da90c1944079124e5b4c1ba4733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.951122 26706 ts_tablet_manager.cc:1434] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.002s
I20260709 12:28:42.952394 26706 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:42.959067 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:42.959952 26438 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:42.961993 26551 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:42.963231 26713 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:42.963673 26713 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.964041 26713 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.965332 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 22f24da90c1944079124e5b4c1ba4733 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:42.968214 26720 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.968737 26720 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.971658 26720 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:42.982825 26715 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:42.983029 26713 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:42.985634 26713 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:42.987489 26709 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:42.987895 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:42.988495 26709 ts_tablet_manager.cc:1403] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.004s
W20260709 12:28:42.989699 26550 leader_election.cc:343] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:42.995844 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:42.996565 26438 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.996719 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 828700bf20fa4c988e072c6d158102fc (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:42.998381 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828700bf20fa4c988e072c6d158102fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.002974 26715 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:43.004231 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:43.004949 26587 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.966251 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 828700bf20fa4c988e072c6d158102fc (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:43.007488 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828700bf20fa4c988e072c6d158102fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.008697 26709 raft_consensus.cc:359] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.011605 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:43.013177 26709 raft_consensus.cc:385] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.014947 26709 raft_consensus.cc:740] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
W20260709 12:28:43.015027 26625 leader_election.cc:343] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.015153 26422 tablet_service.cc:1511] Processing CreateTablet for tablet b6201f65047045ac9ae106afdade627d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:43.017035 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6201f65047045ac9ae106afdade627d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.017815 26707 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:43.018450 26707 ts_tablet_manager.cc:1403] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.216s	user 0.008s	sys 0.015s
I20260709 12:28:43.020459 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 102123f032ed4637895154c8d3cfe658 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:43.021667 26707 raft_consensus.cc:359] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:43.015960 26709 consensus_queue.cc:260] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.017895 26587 raft_consensus.cc:2468] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:43.030409 26625 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:43.030725 26438 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:43.031473 26715 raft_consensus.cc:2804] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.032312 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f24da90c1944079124e5b4c1ba4733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.032922 26715 raft_consensus.cc:697] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:43.033440 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102123f032ed4637895154c8d3cfe658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.034102 26715 consensus_queue.cc:237] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.035648 26502 tablet_service.cc:1511] Processing CreateTablet for tablet b6201f65047045ac9ae106afdade627d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:43.038825 26502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6201f65047045ac9ae106afdade627d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.039803 26709 ts_tablet_manager.cc:1434] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 12:28:43.040952 26709 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:43.036478 26551 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:43.032534 26645 tablet_service.cc:1511] Processing CreateTablet for tablet b6201f65047045ac9ae106afdade627d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:43.046891 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6201f65047045ac9ae106afdade627d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.049906 26424 tablet_service.cc:1511] Processing CreateTablet for tablet 102123f032ed4637895154c8d3cfe658 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:43.043557 26713 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.051075 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 734b294b669c4944aaabdb8977f85fc2 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:43.031684 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 102123f032ed4637895154c8d3cfe658 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:43.022464 26707 raft_consensus.cc:385] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.042959 26706 tablet_bootstrap.cc:654] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.052968 26571 tablet_service.cc:1511] Processing CreateTablet for tablet 734b294b669c4944aaabdb8977f85fc2 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:43.056062 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102123f032ed4637895154c8d3cfe658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.056473 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:28:43.058424 26477 leader_election.cc:343] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.058537 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734b294b669c4944aaabdb8977f85fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.070402 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 734b294b669c4944aaabdb8977f85fc2 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:43.071854 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734b294b669c4944aaabdb8977f85fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.054684 26707 raft_consensus.cc:740] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.075646 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734b294b669c4944aaabdb8977f85fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.076246 26708 tablet_bootstrap.cc:492] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:43.070298 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102123f032ed4637895154c8d3cfe658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.076823 26708 ts_tablet_manager.cc:1403] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.000s
I20260709 12:28:43.079087 26707 consensus_queue.cc:260] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:43.081347 26708 raft_consensus.cc:359] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.082124 26708 raft_consensus.cc:385] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.082433 26708 raft_consensus.cc:740] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.088441 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:43.083807 26713 raft_consensus.cc:697] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
W20260709 12:28:43.093114 26476 leader_election.cc:343] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.093649 26476 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:43.093542 26713 consensus_queue.cc:237] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.095038 26720 raft_consensus.cc:2749] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.104228 26708 consensus_queue.cc:260] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.106976 26708 ts_tablet_manager.cc:1434] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:28:43.106568 26428 tablet_service.cc:1511] Processing CreateTablet for tablet eac3baa350f54fe492420693918644a7 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:43.108291 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac3baa350f54fe492420693918644a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.110746 26709 tablet_bootstrap.cc:654] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.108359 26708 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:43.121351 26707 ts_tablet_manager.cc:1434] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
I20260709 12:28:43.133455 26706 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:43.134086 26706 ts_tablet_manager.cc:1403] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.182s	user 0.017s	sys 0.006s
I20260709 12:28:43.136664 26335 catalog_manager.cc:5697] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:43.139204 26707 tablet_bootstrap.cc:492] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:43.143761 26502 tablet_service.cc:1511] Processing CreateTablet for tablet eac3baa350f54fe492420693918644a7 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:43.145308 26502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac3baa350f54fe492420693918644a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.156399 26569 tablet_service.cc:1511] Processing CreateTablet for tablet eac3baa350f54fe492420693918644a7 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:43.161228 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac3baa350f54fe492420693918644a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.146404 26706 raft_consensus.cc:359] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.182160 26422 tablet_service.cc:1511] Processing CreateTablet for tablet 207cf65124de4fd1a9e0f6f3332bd1c3 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:28:43.182057 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 207cf65124de4fd1a9e0f6f3332bd1c3 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:28:43.183813 26709 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:43.184396 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207cf65124de4fd1a9e0f6f3332bd1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.184430 26709 ts_tablet_manager.cc:1403] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.013s
I20260709 12:28:43.188405 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 486de29ef17f4eb9aa01601103eaf921 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:43.189879 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486de29ef17f4eb9aa01601103eaf921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.190282 26495 tablet_service.cc:1511] Processing CreateTablet for tablet f373d8db1e3349c48d8c4dfcdada9e41 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:43.191684 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f373d8db1e3349c48d8c4dfcdada9e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.191944 26571 tablet_service.cc:1511] Processing CreateTablet for tablet 486de29ef17f4eb9aa01601103eaf921 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:43.191758 26577 tablet_service.cc:1511] Processing CreateTablet for tablet f373d8db1e3349c48d8c4dfcdada9e41 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:43.193392 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486de29ef17f4eb9aa01601103eaf921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.194052 26577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f373d8db1e3349c48d8c4dfcdada9e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.195295 26334 catalog_manager.cc:5697] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 1 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.190876 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207cf65124de4fd1a9e0f6f3332bd1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.199056 26424 tablet_service.cc:1511] Processing CreateTablet for tablet 486de29ef17f4eb9aa01601103eaf921 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:43.200613 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486de29ef17f4eb9aa01601103eaf921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.204244 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 207cf65124de4fd1a9e0f6f3332bd1c3 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:28:43.205783 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207cf65124de4fd1a9e0f6f3332bd1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.206729 26642 tablet_service.cc:1511] Processing CreateTablet for tablet f373d8db1e3349c48d8c4dfcdada9e41 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:43.208194 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f373d8db1e3349c48d8c4dfcdada9e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.209178 26709 raft_consensus.cc:359] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.209949 26709 raft_consensus.cc:385] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.210273 26709 raft_consensus.cc:740] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.213151 26708 tablet_bootstrap.cc:654] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.175014 26706 raft_consensus.cc:385] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.214840 26706 raft_consensus.cc:740] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.211122 26709 consensus_queue.cc:260] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.216915 26723 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.217460 26723 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.218163 26707 tablet_bootstrap.cc:654] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.215833 26706 consensus_queue.cc:260] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.220585 26723 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:43.236735 26706 ts_tablet_manager.cc:1434] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.003s
I20260709 12:28:43.237111 26501 tablet_service.cc:1511] Processing CreateTablet for tablet 325ddf3240694c36a217b486f7f82472 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:43.237946 26706 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:43.238739 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325ddf3240694c36a217b486f7f82472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.272243 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 6180fe8f3be6486d829a4b44cc3c7f9d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:28:43.273833 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6180fe8f3be6486d829a4b44cc3c7f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.275674 26568 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5a23561d854cb098b5ecc2eec7f3b4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:43.277208 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5a23561d854cb098b5ecc2eec7f3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.277702 26643 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5a23561d854cb098b5ecc2eec7f3b4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:43.272241 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 325ddf3240694c36a217b486f7f82472 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:43.279949 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325ddf3240694c36a217b486f7f82472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.275674 26503 tablet_service.cc:1511] Processing CreateTablet for tablet 6180fe8f3be6486d829a4b44cc3c7f9d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:28:43.283259 26706 tablet_bootstrap.cc:654] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.284989 26503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6180fe8f3be6486d829a4b44cc3c7f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.279188 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5a23561d854cb098b5ecc2eec7f3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.299011 26709 ts_tablet_manager.cc:1434] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.015s
I20260709 12:28:43.300348 26709 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:43.320362 26708 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:43.321040 26708 ts_tablet_manager.cc:1403] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.213s	user 0.011s	sys 0.007s
I20260709 12:28:43.322646 26707 tablet_bootstrap.cc:492] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:43.323289 26707 ts_tablet_manager.cc:1403] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.184s	user 0.019s	sys 0.010s
I20260709 12:28:43.324532 26708 raft_consensus.cc:359] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.325358 26708 raft_consensus.cc:385] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.325676 26708 raft_consensus.cc:740] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.326465 26708 consensus_queue.cc:260] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.326927 26502 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab5bed2ac8d429cbf2b3802b44b7888 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:43.329002 26708 ts_tablet_manager.cc:1434] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:43.330204 26708 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:43.341630 26706 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:43.342057 26502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab5bed2ac8d429cbf2b3802b44b7888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.342276 26706 ts_tablet_manager.cc:1403] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.006s
I20260709 12:28:43.326422 26707 raft_consensus.cc:359] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.343614 26708 tablet_bootstrap.cc:654] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.347585 26707 raft_consensus.cc:385] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.348001 26707 raft_consensus.cc:740] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.348827 26707 consensus_queue.cc:260] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.355197 26706 raft_consensus.cc:359] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.356083 26706 raft_consensus.cc:385] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.356392 26706 raft_consensus.cc:740] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.362779 26571 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab5bed2ac8d429cbf2b3802b44b7888 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:43.363240 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab5bed2ac8d429cbf2b3802b44b7888 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:43.364367 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab5bed2ac8d429cbf2b3802b44b7888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.364673 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab5bed2ac8d429cbf2b3802b44b7888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.371742 26569 tablet_service.cc:1511] Processing CreateTablet for tablet ea21ef264e8c4b2d982ec57324d121ff (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:43.373238 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea21ef264e8c4b2d982ec57324d121ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.378149 26709 tablet_bootstrap.cc:654] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.389345 26422 tablet_service.cc:1511] Processing CreateTablet for tablet 325ddf3240694c36a217b486f7f82472 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:43.389945 26428 tablet_service.cc:1511] Processing CreateTablet for tablet 6180fe8f3be6486d829a4b44cc3c7f9d (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:28:43.391376 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325ddf3240694c36a217b486f7f82472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.391186 26503 tablet_service.cc:1511] Processing CreateTablet for tablet ea21ef264e8c4b2d982ec57324d121ff (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:43.391608 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5a23561d854cb098b5ecc2eec7f3b4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:43.392584 26503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea21ef264e8c4b2d982ec57324d121ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.393244 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:43.392084 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6180fe8f3be6486d829a4b44cc3c7f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.402197 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5a23561d854cb098b5ecc2eec7f3b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:43.404045 26402 leader_election.cc:343] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.407733 26741 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.408299 26741 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.410764 26715 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.411322 26715 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.415577 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:43.416229 26715 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:43.417754 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:43.420217 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:43.420956 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:43.421754 26513 raft_consensus.cc:2468] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
W20260709 12:28:43.422106 26402 leader_election.cc:343] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.422708 26720 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.423317 26720 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.423830 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 958b4fe6e86040349d99c54da8473245 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:43.425830 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958b4fe6e86040349d99c54da8473245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.438863 26741 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:43.444926 26625 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
W20260709 12:28:43.446048 26625 leader_election.cc:343] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.447734 26715 raft_consensus.cc:2804] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.448196 26715 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.448496 26720 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:43.448602 26715 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.390219 26425 tablet_service.cc:1511] Processing CreateTablet for tablet ea21ef264e8c4b2d982ec57324d121ff (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:43.450007 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea21ef264e8c4b2d982ec57324d121ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.451191 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:43.456941 26715 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.457782 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:43.458678 26586 raft_consensus.cc:2393] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 1: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:43.460233 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:43.460650 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:43.460950 26512 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.463131 26716 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.463713 26716 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:43.468910 26643 tablet_service.cc:1511] Processing CreateTablet for tablet d55bc7c762df41c8b7c71ed2384f9fcb (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:28:43.464296 26421 tablet_service.cc:1511] Processing CreateTablet for tablet d55bc7c762df41c8b7c71ed2384f9fcb (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:28:43.466877 26716 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:43.470432 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55bc7c762df41c8b7c71ed2384f9fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.473017 26477 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:43.473757 26501 tablet_service.cc:1511] Processing CreateTablet for tablet d55bc7c762df41c8b7c71ed2384f9fcb (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:28:43.474431 26720 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.475278 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55bc7c762df41c8b7c71ed2384f9fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.477082 26512 raft_consensus.cc:2468] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:43.478833 26715 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:28:43.481343 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:43.483639 26707 ts_tablet_manager.cc:1434] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.160s	user 0.004s	sys 0.005s
I20260709 12:28:43.487802 26707 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:43.492786 26713 consensus_queue.cc:1048] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:43.376331 26706 consensus_queue.cc:260] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.503271 26587 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:43.507359 26706 ts_tablet_manager.cc:1434] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.162s	user 0.007s	sys 0.001s
I20260709 12:28:43.508635 26706 tablet_bootstrap.cc:492] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:43.470432 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55bc7c762df41c8b7c71ed2384f9fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.521723 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 958b4fe6e86040349d99c54da8473245 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:43.523483 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958b4fe6e86040349d99c54da8473245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.545573 26503 tablet_service.cc:1511] Processing CreateTablet for tablet d97898f8f78e456084abffdb741c2b01 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:28:43.547267 26503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97898f8f78e456084abffdb741c2b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.551469 26571 tablet_service.cc:1511] Processing CreateTablet for tablet d97898f8f78e456084abffdb741c2b01 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:28:43.552918 26708 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:43.553541 26708 ts_tablet_manager.cc:1403] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.224s	user 0.029s	sys 0.019s
I20260709 12:28:43.557284 26707 tablet_bootstrap.cc:654] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.558568 26708 raft_consensus.cc:359] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.561270 26708 raft_consensus.cc:385] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.561625 26708 raft_consensus.cc:740] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.562412 26708 consensus_queue.cc:260] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.566777 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97898f8f78e456084abffdb741c2b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.569785 26648 tablet_service.cc:1511] Processing CreateTablet for tablet d97898f8f78e456084abffdb741c2b01 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:28:43.571492 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97898f8f78e456084abffdb741c2b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.573342 26720 raft_consensus.cc:2749] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.562938 26709 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:43.578495 26709 ts_tablet_manager.cc:1403] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.278s	user 0.027s	sys 0.030s
I20260709 12:28:43.580343 26421 tablet_service.cc:1511] Processing CreateTablet for tablet 958b4fe6e86040349d99c54da8473245 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:43.581806 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958b4fe6e86040349d99c54da8473245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.582857 26402 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:43.585556 26741 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.586031 26741 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.586392 26741 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.588707 26706 tablet_bootstrap.cc:654] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.594967 26741 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.597306 26741 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:43.581979 26709 raft_consensus.cc:359] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:43.608577 26709 raft_consensus.cc:385] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.608989 26709 raft_consensus.cc:740] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.609831 26709 consensus_queue.cc:260] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:43.620332 26709 ts_tablet_manager.cc:1434] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:28:43.621289 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 1482f526e3e847889ab33113a4254db7 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:43.624850 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:43.625017 26501 tablet_service.cc:1511] Processing CreateTablet for tablet 579a9b2cdca24a6a95444e424f03a551 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:43.626434 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579a9b2cdca24a6a95444e424f03a551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.626735 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1482f526e3e847889ab33113a4254db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.627794 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 579a9b2cdca24a6a95444e424f03a551 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:43.629321 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579a9b2cdca24a6a95444e424f03a551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.646070 26709 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
W20260709 12:28:43.613736 26402 leader_election.cc:343] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.660746 26402 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:43.661836 26723 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:43.662055 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 50741us
I20260709 12:28:43.664688 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:43.665323 26587 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.665808 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:43.675277 26709 tablet_bootstrap.cc:654] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.692210 26425 tablet_service.cc:1511] Processing CreateTablet for tablet 579a9b2cdca24a6a95444e424f03a551 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:43.693367 26501 tablet_service.cc:1511] Processing CreateTablet for tablet 1482f526e3e847889ab33113a4254db7 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:43.694834 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1482f526e3e847889ab33113a4254db7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:43.697628 26402 leader_election.cc:343] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.697749 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 1482f526e3e847889ab33113a4254db7 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:43.693889 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579a9b2cdca24a6a95444e424f03a551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.702440 26587 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:43.703377 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1482f526e3e847889ab33113a4254db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.707232 26402 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:43.708631 26741 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.713873 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 001d53e77bda4b339dbb0c3b7e65eef3 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:28:43.715462 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001d53e77bda4b339dbb0c3b7e65eef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.716082 26625 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:43.717067 26715 raft_consensus.cc:2804] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:43.717140 26625 leader_election.cc:343] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.717677 26715 raft_consensus.cc:697] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
W20260709 12:28:43.718391 26550 consensus_peers.cc:597] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Couldn't send request to peer 4b371ddb5e924d6e8b56b476a69a27d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:43.718634 26715 consensus_queue.cc:237] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.720155 26708 ts_tablet_manager.cc:1434] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.166s	user 0.019s	sys 0.025s
I20260709 12:28:43.723805 26708 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:43.727610 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 001d53e77bda4b339dbb0c3b7e65eef3 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:28:43.729453 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001d53e77bda4b339dbb0c3b7e65eef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.710908 26741 raft_consensus.cc:697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:43.735054 26716 consensus_queue.cc:1048] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.736272 26707 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:43.736007 26741 consensus_queue.cc:237] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.736862 26707 ts_tablet_manager.cc:1403] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.249s	user 0.012s	sys 0.014s
I20260709 12:28:43.736531 26421 tablet_service.cc:1511] Processing CreateTablet for tablet 001d53e77bda4b339dbb0c3b7e65eef3 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:28:43.738102 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001d53e77bda4b339dbb0c3b7e65eef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.732499 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:43.751787 26751 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.752751 26751 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.756587 26707 raft_consensus.cc:359] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.757493 26707 raft_consensus.cc:385] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.757850 26707 raft_consensus.cc:740] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.768404 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:43.769125 26713 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.769690 26713 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.783388 26716 consensus_queue.cc:1048] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:28:43.788368 26751 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:43.792685 26706 tablet_bootstrap.cc:492] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:43.793257 26706 ts_tablet_manager.cc:1403] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.285s	user 0.011s	sys 0.003s
I20260709 12:28:43.793541 26503 tablet_service.cc:1511] Processing CreateTablet for tablet caf253f7acbf409180c569cd29f50cee (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:43.784762 26707 consensus_queue.cc:260] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.802350 26713 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:43.803153 26707 ts_tablet_manager.cc:1434] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.001s
I20260709 12:28:43.808210 26645 tablet_service.cc:1511] Processing CreateTablet for tablet caf253f7acbf409180c569cd29f50cee (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:43.809808 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf253f7acbf409180c569cd29f50cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.812199 26706 raft_consensus.cc:359] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.813069 26706 raft_consensus.cc:385] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.812500 26334 catalog_manager.cc:5697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.814697 26708 tablet_bootstrap.cc:654] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.813397 26706 raft_consensus.cc:740] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.817621 26709 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:43.818225 26709 ts_tablet_manager.cc:1403] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.173s	user 0.012s	sys 0.014s
I20260709 12:28:43.818989 26707 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:43.821527 26706 consensus_queue.cc:260] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
W20260709 12:28:43.799595 26625 leader_election.cc:343] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.823380 26751 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:43.823801 26625 leader_election.cc:343] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.824324 26706 ts_tablet_manager.cc:1434] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 12:28:43.823943 26751 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:43.826227 26751 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:43.827893 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:43.831326 26571 tablet_service.cc:1511] Processing CreateTablet for tablet caf253f7acbf409180c569cd29f50cee (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:43.837664 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf253f7acbf409180c569cd29f50cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.839485 26707 tablet_bootstrap.cc:654] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.840220 26709 raft_consensus.cc:359] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.841172 26709 raft_consensus.cc:385] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.841464 26709 raft_consensus.cc:740] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.842311 26709 consensus_queue.cc:260] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.844549 26709 ts_tablet_manager.cc:1434] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:28:43.845759 26709 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:43.832759 26625 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:28:43.852888 26756 log.cc:927] Time spent T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:28:43.855330 26716 raft_consensus.cc:2749] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.856884 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:43.852895 26503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf253f7acbf409180c569cd29f50cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.858532 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 71d43124d4854915a84f60d5a8d16915 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:43.860001 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d43124d4854915a84f60d5a8d16915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.859604 26332 catalog_manager.cc:5697] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:43.863544 26741 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.864163 26741 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:43.865705 26723 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.866261 26723 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:43.866806 26741 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:43.868535 26723 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:28:43.849458 26551 leader_election.cc:343] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:43.881086 26550 leader_election.cc:343] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.895561 26643 tablet_service.cc:1511] Processing CreateTablet for tablet afa1d77d71ae4c8993d446d81e4c1e5f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:43.897229 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa1d77d71ae4c8993d446d81e4c1e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.901211 26422 tablet_service.cc:1511] Processing CreateTablet for tablet afa1d77d71ae4c8993d446d81e4c1e5f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:43.904600 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa1d77d71ae4c8993d446d81e4c1e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.908010 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 71d43124d4854915a84f60d5a8d16915 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:43.909420 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d43124d4854915a84f60d5a8d16915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.919427 26550 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:43.920650 26762 raft_consensus.cc:2749] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.924921 26706 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
W20260709 12:28:43.920691 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 55978.1us
I20260709 12:28:43.934695 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:43.935770 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:28:43.936105 26402 leader_election.cc:343] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.937083 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:43.937687 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:43.938781 26502 tablet_service.cc:1511] Processing CreateTablet for tablet 71d43124d4854915a84f60d5a8d16915 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:43.941502 26502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d43124d4854915a84f60d5a8d16915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.942876 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 71584399dd7f43d8950539126b066e37 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:43.943820 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 71584399dd7f43d8950539126b066e37 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:43.944674 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71584399dd7f43d8950539126b066e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.946938 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71584399dd7f43d8950539126b066e37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:43.951458 26402 leader_election.cc:343] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.952747 26708 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:43.953354 26708 ts_tablet_manager.cc:1403] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.230s	user 0.011s	sys 0.010s
I20260709 12:28:43.954209 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:43.956744 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:43.952654 26501 tablet_service.cc:1511] Processing CreateTablet for tablet afa1d77d71ae4c8993d446d81e4c1e5f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:43.971693 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa1d77d71ae4c8993d446d81e4c1e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.972187 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:43.974015 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:43.974720 26762 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.975245 26762 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:43.976493 26424 tablet_service.cc:1511] Processing CreateTablet for tablet 71584399dd7f43d8950539126b066e37 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:43.977756 26762 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:43.977890 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71584399dd7f43d8950539126b066e37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:43.979967 26401 leader_election.cc:343] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.980497 26401 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:28:43.981752 26401 leader_election.cc:343] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.982048 26709 tablet_bootstrap.cc:654] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:43.958766 26477 leader_election.cc:343] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.982487 26723 raft_consensus.cc:2749] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:43.983268 26477 leader_election.cc:343] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:43.984078 26477 leader_election.cc:343] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.984182 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:43.984670 26477 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:43.982189 26401 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:43.988855 26751 raft_consensus.cc:2749] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:43.990181 26477 leader_election.cc:343] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.990671 26477 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:43.991415 26751 raft_consensus.cc:2749] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.994993 26723 raft_consensus.cc:2749] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.001994 26707 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:44.004578 26708 raft_consensus.cc:359] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.005420 26708 raft_consensus.cc:385] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.005746 26708 raft_consensus.cc:740] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.006538 26708 consensus_queue.cc:260] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.015596 26706 tablet_bootstrap.cc:654] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.015168 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 62cf18772950487998aeb7a43530703f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:44.016897 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf18772950487998aeb7a43530703f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.024200 26421 tablet_service.cc:1511] Processing CreateTablet for tablet 91df34303a124f3eb4e5103bd9254c6a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:28:44.025619 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91df34303a124f3eb4e5103bd9254c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.012378 26707 ts_tablet_manager.cc:1403] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.022s
I20260709 12:28:44.067847 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 62cf18772950487998aeb7a43530703f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:44.069546 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf18772950487998aeb7a43530703f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.072353 26708 ts_tablet_manager.cc:1434] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.000s
I20260709 12:28:44.074818 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 91df34303a124f3eb4e5103bd9254c6a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:28:44.066082 26707 raft_consensus.cc:359] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.090618 26708 tablet_bootstrap.cc:492] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:44.087114 26707 raft_consensus.cc:385] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.100239 26707 raft_consensus.cc:740] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.107591 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 62cf18772950487998aeb7a43530703f (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:44.109216 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf18772950487998aeb7a43530703f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.115774 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91df34303a124f3eb4e5103bd9254c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.121001 26645 tablet_service.cc:1511] Processing CreateTablet for tablet b867f2d6360645d4a8c7a56339b7ef56 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:44.122529 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b867f2d6360645d4a8c7a56339b7ef56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.107414 26707 consensus_queue.cc:260] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.136076 26779 consensus_queue.cc:1048] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.141983 26503 tablet_service.cc:1511] Processing CreateTablet for tablet b867f2d6360645d4a8c7a56339b7ef56 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:44.143748 26503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b867f2d6360645d4a8c7a56339b7ef56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.143370 26424 tablet_service.cc:1511] Processing CreateTablet for tablet b867f2d6360645d4a8c7a56339b7ef56 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:44.144793 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b867f2d6360645d4a8c7a56339b7ef56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.150341 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 91df34303a124f3eb4e5103bd9254c6a (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:28:44.151564 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91df34303a124f3eb4e5103bd9254c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.153417 26587 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.154377 26708 tablet_bootstrap.cc:654] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.155603 26645 tablet_service.cc:1511] Processing CreateTablet for tablet eee116af186a4716920d4630b13d5b51 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:44.156841 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee116af186a4716920d4630b13d5b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.157614 26709 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:44.162457 26571 tablet_service.cc:1511] Processing CreateTablet for tablet eee116af186a4716920d4630b13d5b51 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:44.162988 26422 tablet_service.cc:1511] Processing CreateTablet for tablet eee116af186a4716920d4630b13d5b51 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:44.163277 26568 tablet_service.cc:1511] Processing CreateTablet for tablet 2f18e20a50264529b43abc6da23a41db (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:44.163962 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee116af186a4716920d4630b13d5b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.164463 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee116af186a4716920d4630b13d5b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.164721 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f18e20a50264529b43abc6da23a41db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.165413 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:44.166262 26512 raft_consensus.cc:2393] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:44.166682 26709 ts_tablet_manager.cc:1403] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.321s	user 0.013s	sys 0.019s
I20260709 12:28:44.168691 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 2f18e20a50264529b43abc6da23a41db (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:44.169941 26709 raft_consensus.cc:359] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.169947 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f18e20a50264529b43abc6da23a41db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.171489 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 22fcb1f4dc2c4377a60316fa1c70a8b4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:44.173069 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22fcb1f4dc2c4377a60316fa1c70a8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.172895 26551 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:44.183975 26762 raft_consensus.cc:2749] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.158900 26707 ts_tablet_manager.cc:1434] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.004s
I20260709 12:28:44.189870 26709 raft_consensus.cc:385] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.192582 26709 raft_consensus.cc:740] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.193231 26751 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.193749 26751 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.194532 26643 tablet_service.cc:1511] Processing CreateTablet for tablet 36b9151618004ebba90012bfc0c4c39b (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:44.203828 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b9151618004ebba90012bfc0c4c39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.203594 26723 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.205683 26751 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.191387 26779 consensus_queue.cc:1048] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:28:44.208982 26707 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:44.210465 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:44.220747 26438 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:44.205585 26577 tablet_service.cc:1511] Processing CreateTablet for tablet 22fcb1f4dc2c4377a60316fa1c70a8b4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:44.223328 26477 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:44.224277 26751 raft_consensus.cc:2804] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.224603 26751 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.212589 26709 consensus_queue.cc:260] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.213467 26421 tablet_service.cc:1511] Processing CreateTablet for tablet 36b9151618004ebba90012bfc0c4c39b (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:44.215014 26501 tablet_service.cc:1511] Processing CreateTablet for tablet 22fcb1f4dc2c4377a60316fa1c70a8b4 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:44.224890 26751 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.226035 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22fcb1f4dc2c4377a60316fa1c70a8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.227969 26779 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.228618 26779 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.222826 26577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22fcb1f4dc2c4377a60316fa1c70a8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.222688 26706 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:44.244146 26709 ts_tablet_manager.cc:1434] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.003s
I20260709 12:28:44.248972 26502 tablet_service.cc:1511] Processing CreateTablet for tablet 36b9151618004ebba90012bfc0c4c39b (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:44.249897 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b9151618004ebba90012bfc0c4c39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.242457 26707 tablet_bootstrap.cc:654] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.242825 26706 ts_tablet_manager.cc:1403] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.318s	user 0.026s	sys 0.001s
I20260709 12:28:44.256340 26502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b9151618004ebba90012bfc0c4c39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.257530 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:28:44.259598 26625 leader_election.cc:343] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:44.270803 26709 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:44.277848 26709 tablet_bootstrap.cc:654] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.280678 26648 tablet_service.cc:1511] Processing CreateTablet for tablet e346f965eb91472e99c529ad927e2636 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:44.282251 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e346f965eb91472e99c529ad927e2636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.288741 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:44.294636 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 2f18e20a50264529b43abc6da23a41db (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:44.296178 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f18e20a50264529b43abc6da23a41db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.296334 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:44.288260 26779 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:28:44.299705 26625 leader_election.cc:343] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:44.300310 26625 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:44.301682 26779 raft_consensus.cc:2749] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.304623 26706 raft_consensus.cc:359] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.304890 26425 tablet_service.cc:1511] Processing CreateTablet for tablet e346f965eb91472e99c529ad927e2636 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:44.306450 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e346f965eb91472e99c529ad927e2636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.293740 26575 tablet_service.cc:1511] Processing CreateTablet for tablet e346f965eb91472e99c529ad927e2636 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:44.305531 26706 raft_consensus.cc:385] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.307818 26706 raft_consensus.cc:740] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.306457 26501 tablet_service.cc:1511] Processing CreateTablet for tablet fec4b7b54d6547299b2a1a4c618afcde (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:28:44.312148 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec4b7b54d6547299b2a1a4c618afcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.311903 26706 consensus_queue.cc:260] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.307945 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e346f965eb91472e99c529ad927e2636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.318734 26779 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.319367 26779 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.321563 26779 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.323158 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:44.323604 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:44.323890 26586 raft_consensus.cc:2468] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:44.324828 26437 raft_consensus.cc:2468] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:44.327419 26625 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:44.328434 26706 ts_tablet_manager.cc:1434] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 12:28:44.328945 26715 raft_consensus.cc:2804] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.329422 26715 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.329775 26715 raft_consensus.cc:3060] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:44.334784 26402 consensus_peers.cc:597] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:44.329648 26706 tablet_bootstrap.cc:492] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:44.349367 26643 tablet_service.cc:1511] Processing CreateTablet for tablet fec4b7b54d6547299b2a1a4c618afcde (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:28:44.353101 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec4b7b54d6547299b2a1a4c618afcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.354449 26428 tablet_service.cc:1511] Processing CreateTablet for tablet ddef97e10ce649ae82d02133a094f7ff (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:44.355839 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddef97e10ce649ae82d02133a094f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.353236 26495 tablet_service.cc:1511] Processing CreateTablet for tablet ddef97e10ce649ae82d02133a094f7ff (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:44.358731 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddef97e10ce649ae82d02133a094f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:44.349601 26476 leader_election.cc:343] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:44.369127 26708 tablet_bootstrap.cc:492] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:44.369778 26708 ts_tablet_manager.cc:1403] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.279s	user 0.007s	sys 0.021s
I20260709 12:28:44.371845 26569 tablet_service.cc:1511] Processing CreateTablet for tablet ddef97e10ce649ae82d02133a094f7ff (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:44.371845 26645 tablet_service.cc:1511] Processing CreateTablet for tablet a0eddc7ff9ef4017b178747494e76fc2 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:44.374212 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eddc7ff9ef4017b178747494e76fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.380627 26708 raft_consensus.cc:359] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.381498 26708 raft_consensus.cc:385] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.381803 26708 raft_consensus.cc:740] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.382712 26708 consensus_queue.cc:260] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.383967 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddef97e10ce649ae82d02133a094f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.414405 26708 ts_tablet_manager.cc:1434] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260709 12:28:44.414158 26427 tablet_service.cc:1511] Processing CreateTablet for tablet a0eddc7ff9ef4017b178747494e76fc2 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:44.415699 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eddc7ff9ef4017b178747494e76fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.420900 26709 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:44.421679 26709 ts_tablet_manager.cc:1403] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.169s	user 0.005s	sys 0.018s
I20260709 12:28:44.424985 26709 raft_consensus.cc:359] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.428622 26709 raft_consensus.cc:385] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.429593 26709 raft_consensus.cc:740] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.385919 26715 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.432672 26707 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:44.433286 26707 ts_tablet_manager.cc:1403] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.225s	user 0.010s	sys 0.010s
I20260709 12:28:44.434551 26568 tablet_service.cc:1511] Processing CreateTablet for tablet fec4b7b54d6547299b2a1a4c618afcde (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:28:44.436141 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec4b7b54d6547299b2a1a4c618afcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.439522 26715 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.441232 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:44.441883 26587 raft_consensus.cc:3060] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.443517 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:44.444183 26437 raft_consensus.cc:3060] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.448436 26503 tablet_service.cc:1511] Processing CreateTablet for tablet a0eddc7ff9ef4017b178747494e76fc2 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:44.449999 26503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eddc7ff9ef4017b178747494e76fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.440171 26751 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.454561 26751 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.415791 26708 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:44.456640 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
W20260709 12:28:44.458024 26476 leader_election.cc:343] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:44.454443 26706 tablet_bootstrap.cc:654] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.462339 26587 raft_consensus.cc:2468] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:44.464836 26625 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:44.468472 26437 raft_consensus.cc:2468] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:44.469136 26715 raft_consensus.cc:2804] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:44.481024 26715 raft_consensus.cc:697] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:44.487684 26715 consensus_queue.cc:237] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.469504 26709 consensus_queue.cc:260] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.491012 26751 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.491569 26751 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.481382 26788 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.492985 26709 ts_tablet_manager.cc:1434] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.004s
I20260709 12:28:44.492663 26788 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.493866 26751 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:44.490245 26707 raft_consensus.cc:359] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.495070 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:44.495832 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 55ed770173234cb8984ad0a8be82a8d1 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:28:44.507125 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ed770173234cb8984ad0a8be82a8d1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:44.507407 26476 leader_election.cc:343] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:44.499500 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 55ed770173234cb8984ad0a8be82a8d1 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:28:44.511412 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ed770173234cb8984ad0a8be82a8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.511626 26708 tablet_bootstrap.cc:654] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.513741 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:44.499577 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 55ed770173234cb8984ad0a8be82a8d1 (DEFAULT_TABLE table=test-workload [id=b7c0e1de336b4efbb8dd4e5350ac9f64]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 12:28:44.501899 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:28:44.515239 26477 leader_election.cc:343] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:44.515519 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ed770173234cb8984ad0a8be82a8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.515775 26477 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:44.516711 26751 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.502544 26709 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:44.515688 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:44.524974 26437 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.518415 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:44.526054 26587 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:44.527673 26402 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:44.527643 26707 raft_consensus.cc:385] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.528417 26707 raft_consensus.cc:740] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.539677 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:44.534807 26788 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:28:44.545192 26401 leader_election.cc:343] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:44.528708 26789 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.551357 26709 tablet_bootstrap.cc:654] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.529646 26707 consensus_queue.cc:260] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.551980 26789 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.557902 26706 tablet_bootstrap.cc:492] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:44.564551 26706 ts_tablet_manager.cc:1403] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.235s	user 0.010s	sys 0.015s
I20260709 12:28:44.566390 26789 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.550006 26437 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:44.573712 26477 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:44.575125 26751 raft_consensus.cc:2804] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:44.575691 26751 raft_consensus.cc:697] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:44.576614 26751 consensus_queue.cc:237] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.587042 26707 ts_tablet_manager.cc:1434] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.153s	user 0.007s	sys 0.007s
I20260709 12:28:44.589018 26660 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.591602 26706 raft_consensus.cc:359] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.592530 26706 raft_consensus.cc:385] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.593176 26706 raft_consensus.cc:740] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.592485 26332 catalog_manager.cc:5697] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:44.595938 26706 consensus_queue.cc:260] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.589071 26707 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:44.605808 26706 ts_tablet_manager.cc:1434] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 12:28:44.611461 26706 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:44.612739 26789 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.614647 26708 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:44.615016 26707 tablet_bootstrap.cc:654] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.615233 26708 ts_tablet_manager.cc:1403] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.200s	user 0.012s	sys 0.005s
I20260709 12:28:44.617291 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:44.619246 26587 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.619426 26709 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:44.620013 26709 ts_tablet_manager.cc:1403] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.007s
I20260709 12:28:44.624193 26789 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:44.627245 26587 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:44.629348 26402 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:44.629562 26709 raft_consensus.cc:359] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.630297 26709 raft_consensus.cc:385] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.630721 26709 raft_consensus.cc:740] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.630327 26789 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:44.632035 26709 consensus_queue.cc:260] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.632418 26708 raft_consensus.cc:359] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.633167 26708 raft_consensus.cc:385] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.633417 26708 raft_consensus.cc:740] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.634085 26708 consensus_queue.cc:260] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.636032 26708 ts_tablet_manager.cc:1434] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:28:44.636984 26708 tablet_bootstrap.cc:492] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:44.639427 26789 raft_consensus.cc:697] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:44.640010 26706 tablet_bootstrap.cc:654] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.640453 26789 consensus_queue.cc:237] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.643373 26709 ts_tablet_manager.cc:1434] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:28:44.650830 26709 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:44.657996 26706 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:44.663792 26706 ts_tablet_manager.cc:1403] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.014s
I20260709 12:28:44.641957 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:44.654716 26708 tablet_bootstrap.cc:654] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.664625 26332 catalog_manager.cc:5697] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:44.666306 26401 leader_election.cc:343] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:44.653194 26335 catalog_manager.cc:5697] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:44.656898 26707 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:44.668689 26707 ts_tablet_manager.cc:1403] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.009s
I20260709 12:28:44.669574 26709 tablet_bootstrap.cc:654] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.671958 26707 raft_consensus.cc:359] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.672763 26707 raft_consensus.cc:385] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.673060 26707 raft_consensus.cc:740] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.673875 26707 consensus_queue.cc:260] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.679778 26707 ts_tablet_manager.cc:1434] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:28:44.679946 26706 raft_consensus.cc:359] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.680681 26706 raft_consensus.cc:385] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.680912 26707 tablet_bootstrap.cc:492] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:44.680964 26706 raft_consensus.cc:740] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.683444 26708 tablet_bootstrap.cc:492] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:44.684134 26708 ts_tablet_manager.cc:1403] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.002s
I20260709 12:28:44.683871 26706 consensus_queue.cc:260] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.686441 26706 ts_tablet_manager.cc:1434] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:28:44.687458 26706 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:44.687583 26708 raft_consensus.cc:359] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.688468 26708 raft_consensus.cc:385] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.688817 26708 raft_consensus.cc:740] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.689610 26708 consensus_queue.cc:260] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.692142 26708 ts_tablet_manager.cc:1434] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:44.693200 26708 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:44.694025 26706 tablet_bootstrap.cc:654] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.683410 26709 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:44.695006 26709 ts_tablet_manager.cc:1403] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.006s
I20260709 12:28:44.698060 26709 raft_consensus.cc:359] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.698927 26709 raft_consensus.cc:385] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.699232 26709 raft_consensus.cc:740] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.700032 26708 tablet_bootstrap.cc:654] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.700069 26709 consensus_queue.cc:260] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.702919 26709 ts_tablet_manager.cc:1434] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:44.704023 26709 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:44.710717 26709 tablet_bootstrap.cc:654] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.722651 26709 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:44.723184 26709 ts_tablet_manager.cc:1403] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 12:28:44.725973 26709 raft_consensus.cc:359] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.726712 26709 raft_consensus.cc:385] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.726989 26709 raft_consensus.cc:740] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.727713 26709 consensus_queue.cc:260] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.730161 26709 ts_tablet_manager.cc:1434] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:44.731186 26709 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:44.737476 26709 tablet_bootstrap.cc:654] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.750370 26707 tablet_bootstrap.cc:654] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.752830 26709 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:44.753415 26709 ts_tablet_manager.cc:1403] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 12:28:44.756465 26709 raft_consensus.cc:359] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.757025 26708 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:44.757170 26709 raft_consensus.cc:385] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.757720 26709 raft_consensus.cc:740] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.757870 26708 ts_tablet_manager.cc:1403] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.065s	user 0.029s	sys 0.025s
I20260709 12:28:44.757943 26707 tablet_bootstrap.cc:492] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:44.758111 26706 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:44.758921 26706 ts_tablet_manager.cc:1403] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.072s	user 0.026s	sys 0.030s
I20260709 12:28:44.758525 26709 consensus_queue.cc:260] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.759236 26707 ts_tablet_manager.cc:1403] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.004s
I20260709 12:28:44.761171 26709 ts_tablet_manager.cc:1434] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:44.762514 26709 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:44.762332 26707 raft_consensus.cc:359] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.763173 26707 raft_consensus.cc:385] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.763607 26707 raft_consensus.cc:740] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.763115 26708 raft_consensus.cc:359] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.764106 26708 raft_consensus.cc:385] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.764562 26708 raft_consensus.cc:740] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.764671 26707 consensus_queue.cc:260] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.767143 26707 ts_tablet_manager.cc:1434] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:44.765578 26708 consensus_queue.cc:260] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.769585 26708 ts_tablet_manager.cc:1434] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:28:44.769827 26709 tablet_bootstrap.cc:654] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.770036 26707 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:44.776796 26706 raft_consensus.cc:359] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.778750 26706 raft_consensus.cc:385] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.779091 26706 raft_consensus.cc:740] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.778332 26708 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:44.782214 26707 tablet_bootstrap.cc:654] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.787043 26708 tablet_bootstrap.cc:654] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.788112 26706 consensus_queue.cc:260] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.791217 26706 ts_tablet_manager.cc:1434] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 12:28:44.793097 26706 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:44.799688 26706 tablet_bootstrap.cc:654] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.809677 26707 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:44.810254 26707 ts_tablet_manager.cc:1403] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.008s
I20260709 12:28:44.810519 26706 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:44.810766 26708 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:44.811435 26708 ts_tablet_manager.cc:1403] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.033s	user 0.002s	sys 0.014s
I20260709 12:28:44.813285 26707 raft_consensus.cc:359] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.814062 26707 raft_consensus.cc:385] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.814325 26707 raft_consensus.cc:740] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.814680 26708 raft_consensus.cc:359] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.815053 26707 consensus_queue.cc:260] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.815511 26708 raft_consensus.cc:385] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.815979 26708 raft_consensus.cc:740] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.816834 26708 consensus_queue.cc:260] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.817278 26707 ts_tablet_manager.cc:1434] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:44.817971 26709 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:44.818521 26707 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:44.818877 26706 ts_tablet_manager.cc:1403] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 12:28:44.819209 26708 ts_tablet_manager.cc:1434] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:28:44.820245 26708 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:44.821969 26706 raft_consensus.cc:359] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.822695 26706 raft_consensus.cc:385] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.822973 26706 raft_consensus.cc:740] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.823868 26706 consensus_queue.cc:260] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.826084 26706 ts_tablet_manager.cc:1434] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:28:44.818482 26709 ts_tablet_manager.cc:1403] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.035s
I20260709 12:28:44.826503 26708 tablet_bootstrap.cc:654] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.826956 26762 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.827455 26762 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.829669 26709 raft_consensus.cc:359] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.830843 26709 raft_consensus.cc:385] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.831133 26709 raft_consensus.cc:740] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.831923 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:44.832839 26706 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:44.832723 26512 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:44.834214 26551 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:44.836751 26813 raft_consensus.cc:2804] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.837193 26813 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.837551 26813 raft_consensus.cc:3060] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.837325 26789 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.839001 26789 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.839885 26706 tablet_bootstrap.cc:654] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.841403 26708 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:44.841847 26751 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.842373 26751 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.843616 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:44.844432 26660 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:44.846004 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:44.846747 26661 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:44.846813 26401 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:44.848196 26476 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:44.832633 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:44.849030 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:44.849282 26780 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.849742 26780 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.830044 26762 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:44.841302 26789 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:44.848395 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:44.848498 26723 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.858032 26708 ts_tablet_manager.cc:1403] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.008s
I20260709 12:28:44.859097 26723 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.859728 26723 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.861658 26708 raft_consensus.cc:359] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.850116 26780 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.849148 26437 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:44.844568 26751 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.862423 26708 raft_consensus.cc:385] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.886569 26708 raft_consensus.cc:740] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.831969 26709 consensus_queue.cc:260] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.888861 26709 ts_tablet_manager.cc:1434] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:28:44.890134 26762 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.890869 26762 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.893787 26709 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:44.895112 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:44.896045 26513 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:44.897601 26792 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.897794 26789 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.898892 26708 consensus_queue.cc:260] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.899093 26789 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.899574 26715 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.900098 26715 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.901219 26708 ts_tablet_manager.cc:1434] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.003s
I20260709 12:28:44.898204 26792 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.902272 26708 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:44.903911 26792 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:44.905464 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:44.906579 26587 raft_consensus.cc:2393] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:28:44.902179 26715 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.909945 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:44.910677 26751 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.911227 26751 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.913908 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:44.914794 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:44.915529 26661 raft_consensus.cc:2468] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:44.916002 26751 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.916507 26709 tablet_bootstrap.cc:654] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.914820 26511 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:44.917660 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:44.885746 26780 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.919238 26512 raft_consensus.cc:2393] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:44.919629 26476 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:44.919836 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:44.918423 26437 raft_consensus.cc:2468] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:44.920823 26751 raft_consensus.cc:2804] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.898339 26551 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:44.921516 26751 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.922012 26751 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.919312 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:44.923058 26513 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:44.920773 26587 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:44.926968 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:44.927632 26661 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.931437 26625 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:44.933941 26715 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.935691 26708 tablet_bootstrap.cc:654] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.937470 26777 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.938215 26777 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:44.941004 26777 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:44.941118 26751 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.941689 26780 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.941810 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:44.937439 26661 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:44.946347 26476 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:44.947005 26762 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:44.947636 26762 raft_consensus.cc:2804] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.948068 26762 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.948418 26762 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.947692 26780 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:44.947082 26708 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:44.916213 26789 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:44.950418 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:44.951004 26777 consensus_queue.cc:1048] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.951918 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:44.952674 26660 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:44.952934 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:44.951995 26706 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:44.953634 26437 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.953830 26706 ts_tablet_manager.cc:1403] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.121s	user 0.041s	sys 0.055s
I20260709 12:28:44.954878 26709 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:44.955397 26709 ts_tablet_manager.cc:1403] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.062s	user 0.004s	sys 0.011s
I20260709 12:28:44.949515 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:44.957454 26513 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:44.958240 26709 raft_consensus.cc:359] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.959080 26709 raft_consensus.cc:385] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.959369 26709 raft_consensus.cc:740] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.950394 26708 ts_tablet_manager.cc:1403] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 12:28:44.957242 26706 raft_consensus.cc:359] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:44.966759 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:44.966435 26706 raft_consensus.cc:385] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.966759 26625 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:44.967592 26586 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:44.969791 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:44.970541 26777 raft_consensus.cc:2804] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.966657 26709 consensus_queue.cc:260] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:44.970170 26708 raft_consensus.cc:359] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.960523 26751 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:44.974176 26661 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.976061 26709 ts_tablet_manager.cc:1434] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:28:44.977385 26709 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:44.972878 26708 raft_consensus.cc:385] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.977845 26708 raft_consensus.cc:740] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.973670 26715 raft_consensus.cc:2749] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.979141 26402 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:44.979482 26708 consensus_queue.cc:260] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.981419 26707 tablet_bootstrap.cc:700] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent opening tablet: real 0.109s	user 0.000s	sys 0.004s
I20260709 12:28:44.983086 26707 tablet_bootstrap.cc:654] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.967478 26706 raft_consensus.cc:740] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.972723 26777 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.980846 26402 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:44.949365 26813 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:44.999701 26792 raft_consensus.cc:2804] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.000242 26792 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.000627 26792 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.003258 26813 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:44.982010 26789 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.997006 26661 raft_consensus.cc:2468] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:45.008894 26708 ts_tablet_manager.cc:1434] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.005s
I20260709 12:28:45.010349 26708 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:45.006466 26789 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.012696 26789 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.012816 26788 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.004676 26777 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.014299 26706 consensus_queue.cc:260] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.013399 26788 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.017915 26788 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:45.017690 26762 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.018850 26751 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.023054 26751 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.023701 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:45.024497 26437 raft_consensus.cc:2468] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:45.021580 26780 raft_consensus.cc:697] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:45.011483 26723 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:28:45.025709 26401 leader_election.cc:343] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.026054 26780 consensus_queue.cc:237] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.026667 26476 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:45.026971 26438 raft_consensus.cc:2393] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:28:45.026991 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:45.030354 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:45.031250 26660 raft_consensus.cc:2393] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:45.025341 26751 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:45.031869 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:45.034946 26792 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.038908 26792 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:45.032116 26751 raft_consensus.cc:2804] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:45.039237 26477 leader_election.cc:343] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.041917 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:45.042757 26723 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:45.043773 26587 raft_consensus.cc:2393] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:28:45.045053 26762 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:45.046996 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:45.047711 26706 ts_tablet_manager.cc:1434] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.001s
I20260709 12:28:45.052500 26706 tablet_bootstrap.cc:492] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:45.049541 26586 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:45.021651 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 123445us
W20260709 12:28:45.062366 26477 leader_election.cc:343] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.062960 26477 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:45.063665 26707 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:45.064327 26707 ts_tablet_manager.cc:1403] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.246s	user 0.009s	sys 0.008s
I20260709 12:28:45.066356 26706 tablet_bootstrap.cc:654] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.050963 26751 raft_consensus.cc:697] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:45.067754 26818 raft_consensus.cc:2749] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.067452 26751 consensus_queue.cc:237] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.070034 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:45.072131 26513 raft_consensus.cc:3060] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.073599 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:45.074343 26512 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.078750 26707 raft_consensus.cc:359] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.079558 26707 raft_consensus.cc:385] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.079833 26707 raft_consensus.cc:740] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.080866 26707 consensus_queue.cc:260] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.081624 26715 consensus_queue.cc:1048] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.070008 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:45.104020 26709 tablet_bootstrap.cc:654] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.105770 26707 ts_tablet_manager.cc:1434] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.006s
I20260709 12:28:45.107932 26707 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
W20260709 12:28:45.108237 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 45924.6us
I20260709 12:28:45.102747 26437 raft_consensus.cc:3060] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.111881 26715 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.112474 26715 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.107049 26513 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:45.115092 26789 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.106781 26586 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:45.118925 26551 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:45.120663 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:45.121053 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:45.122141 26762 raft_consensus.cc:2804] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.122495 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:45.122792 26511 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.123034 26762 raft_consensus.cc:697] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:45.106725 26512 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:45.118423 26715 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:45.133350 26762 consensus_queue.cc:237] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.137503 26723 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.138741 26661 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.139964 26511 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:45.138157 26723 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.152494 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:45.153079 26723 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:45.153510 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:45.154181 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:45.154359 26659 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:45.141276 26708 tablet_bootstrap.cc:654] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.124574 26789 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:45.146191 26551 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:45.146550 26402 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:45.147171 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:45.145097 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:45.148706 26706 tablet_bootstrap.cc:492] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:45.155040 26585 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.160513 26706 ts_tablet_manager.cc:1403] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.108s	user 0.020s	sys 0.002s
I20260709 12:28:45.162684 26436 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:45.164827 26513 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.163823 26401 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:45.170045 26723 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.170665 26723 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.170958 26789 raft_consensus.cc:2804] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.171360 26723 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.171604 26789 raft_consensus.cc:697] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:45.172541 26789 consensus_queue.cc:237] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.176640 26788 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.177197 26788 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.178783 26707 tablet_bootstrap.cc:654] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.179525 26788 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:45.163720 26816 raft_consensus.cc:2804] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.145212 26777 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.183387 26816 raft_consensus.cc:697] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:45.184371 26816 consensus_queue.cc:237] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.186967 26818 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.187546 26818 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.187129 26585 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:45.186040 26706 raft_consensus.cc:359] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.189823 26818 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:45.190306 26706 raft_consensus.cc:385] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.191179 26706 raft_consensus.cc:740] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.192186 26513 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:45.192584 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:45.193003 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:28:45.195497 26401 leader_election.cc:343] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.188573 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:45.189121 26402 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.196548 26706 consensus_queue.cc:260] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.197307 26335 catalog_manager.cc:5697] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:45.198151 26788 raft_consensus.cc:2749] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:28:45.198734 26402 leader_election.cc:343] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.199359 26402 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.200479 26788 raft_consensus.cc:2749] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.192692 26625 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:45.204133 26715 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.204510 26715 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.204893 26715 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:45.205459 26476 leader_election.cc:343] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.174839 26586 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:45.201313 26706 ts_tablet_manager.cc:1434] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:28:45.217237 26402 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:45.217852 26660 raft_consensus.cc:2393] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:45.218677 26788 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.219532 26788 raft_consensus.cc:697] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:45.220634 26788 consensus_queue.cc:237] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.182767 26437 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:45.227358 26777 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:45.229766 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:45.233704 26706 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:45.246685 26723 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.249176 26723 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:45.249414 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:45.256352 26818 consensus_queue.cc:1048] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.250423 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:45.250363 26584 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:45.258136 26336 catalog_manager.cc:5697] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 1 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:45.257627 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:45.258001 26818 consensus_queue.cc:1048] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:28:45.273716 26709 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:45.274437 26709 ts_tablet_manager.cc:1403] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.297s	user 0.015s	sys 0.012s
I20260709 12:28:45.259898 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:45.262840 26715 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.281684 26511 raft_consensus.cc:2393] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:28:45.284163 26709 raft_consensus.cc:359] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.284905 26709 raft_consensus.cc:385] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.285154 26709 raft_consensus.cc:740] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
W20260709 12:28:45.290155 26402 leader_election.cc:343] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.292723 26708 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:45.283222 26818 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.294955 26402 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.293409 26660 raft_consensus.cc:2393] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 1: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:45.293237 26788 consensus_queue.cc:1048] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.294204 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:45.287645 26709 consensus_queue.cc:260] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.295116 26818 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.294458 26706 tablet_bootstrap.cc:654] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.295137 26708 ts_tablet_manager.cc:1403] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.285s	user 0.015s	sys 0.006s
I20260709 12:28:45.297755 26709 ts_tablet_manager.cc:1434] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:28:45.298784 26709 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:45.299710 26818 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:45.299530 26708 raft_consensus.cc:359] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.300390 26708 raft_consensus.cc:385] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.300555 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:45.302084 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:45.300742 26708 raft_consensus.cc:740] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.304082 26708 consensus_queue.cc:260] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.295936 26586 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.310334 26709 tablet_bootstrap.cc:654] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.315135 26708 ts_tablet_manager.cc:1434] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:28:45.315300 26707 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:45.316087 26707 ts_tablet_manager.cc:1403] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.208s	user 0.009s	sys 0.007s
I20260709 12:28:45.316941 26708 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:45.315505 26789 raft_consensus.cc:2749] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:45.319818 26828 log.cc:927] Time spent T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:28:45.324887 26706 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:45.325383 26706 ts_tablet_manager.cc:1403] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.001s
I20260709 12:28:45.328316 26706 raft_consensus.cc:359] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.329094 26706 raft_consensus.cc:385] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.329348 26706 raft_consensus.cc:740] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.322376 26625 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:45.319124 26477 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.330246 26818 raft_consensus.cc:2804] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.330623 26818 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.331000 26818 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.331284 26820 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.330799 26477 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:45.335366 26751 raft_consensus.cc:2749] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.335502 26334 catalog_manager.cc:5697] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.337708 26706 consensus_queue.cc:260] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.339267 26715 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:45.339834 26818 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.342952 26706 ts_tablet_manager.cc:1434] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:28:45.343940 26706 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:45.344695 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:45.345363 26584 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.354172 26707 raft_consensus.cc:359] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.355059 26707 raft_consensus.cc:385] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.355347 26707 raft_consensus.cc:740] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.356135 26707 consensus_queue.cc:260] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.338516 26586 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:45.346433 26818 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:45.363090 26707 ts_tablet_manager.cc:1434] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.003s
I20260709 12:28:45.375892 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:45.376869 26586 raft_consensus.cc:2393] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:28:45.371840 26789 consensus_queue.cc:1048] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:28:45.380764 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:45.376919 26402 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.385344 26707 tablet_bootstrap.cc:492] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:45.385178 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:45.386248 26438 raft_consensus.cc:2393] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:28:45.387202 26709 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:45.387753 26709 ts_tablet_manager.cc:1403] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.001s
I20260709 12:28:45.393554 26707 tablet_bootstrap.cc:654] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:45.397459 26476 leader_election.cc:343] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.404063 26708 tablet_bootstrap.cc:654] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.404343 26818 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.405234 26818 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.412094 26709 raft_consensus.cc:359] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.413012 26709 raft_consensus.cc:385] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.413391 26709 raft_consensus.cc:740] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.414075 26709 consensus_queue.cc:260] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.416601 26709 ts_tablet_manager.cc:1434] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:28:45.417634 26709 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:45.417745 26625 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:45.418932 26832 raft_consensus.cc:2749] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.409101 26792 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.420389 26792 raft_consensus.cc:697] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:45.421383 26792 consensus_queue.cc:237] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.418932 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:45.427683 26436 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:45.427964 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:45.428835 26659 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:45.429383 26477 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:45.410084 26818 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:45.433198 26818 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.433681 26818 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.434093 26818 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.435688 26511 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.444170 26332 catalog_manager.cc:5697] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.450702 26706 tablet_bootstrap.cc:654] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.465013 26584 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:45.471632 26707 tablet_bootstrap.cc:492] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:45.472219 26707 ts_tablet_manager.cc:1403] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.087s	user 0.023s	sys 0.029s
I20260709 12:28:45.472079 26477 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.473464 26823 raft_consensus.cc:2804] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.473588 26708 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:45.474028 26823 raft_consensus.cc:697] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:45.474195 26708 ts_tablet_manager.cc:1403] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.001s
I20260709 12:28:45.475028 26823 consensus_queue.cc:237] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.477300 26818 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.480257 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:45.480904 26659 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.487634 26780 consensus_queue.cc:1048] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.489773 26659 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:45.490975 26476 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:45.492045 26780 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.499574 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:45.500412 26437 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.505456 26706 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:45.506079 26706 ts_tablet_manager.cc:1403] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.006s
I20260709 12:28:45.509140 26437 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:45.511011 26818 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:45.512490 26336 catalog_manager.cc:5697] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 1 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.465500 26709 tablet_bootstrap.cc:654] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.469158 26751 consensus_queue.cc:1048] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.524226 26708 raft_consensus.cc:359] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.524516 26706 raft_consensus.cc:359] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.525128 26708 raft_consensus.cc:385] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.525199 26706 raft_consensus.cc:385] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.524013 26707 raft_consensus.cc:359] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.525539 26708 raft_consensus.cc:740] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.525599 26706 raft_consensus.cc:740] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.527940 26780 raft_consensus.cc:697] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:45.534318 26780 consensus_queue.cc:237] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.531759 26708 consensus_queue.cc:260] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.538401 26707 raft_consensus.cc:385] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.532739 26706 consensus_queue.cc:260] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.538918 26707 raft_consensus.cc:740] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.538645 26708 ts_tablet_manager.cc:1434] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 12:28:45.540683 26708 tablet_bootstrap.cc:492] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:45.543141 26706 ts_tablet_manager.cc:1434] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.006s
I20260709 12:28:45.549451 26855 consensus_queue.cc:1048] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.560494 26707 consensus_queue.cc:260] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.574281 26707 ts_tablet_manager.cc:1434] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 12:28:45.576236 26707 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:45.581566 26813 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.581804 26762 consensus_queue.cc:1048] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.582304 26813 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.587328 26823 consensus_queue.cc:1048] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.596552 26762 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.597162 26762 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.597822 26813 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:45.604136 26706 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:45.607717 26823 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.610036 26823 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.612102 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:45.612936 26513 raft_consensus.cc:2468] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:45.606402 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:45.614257 26436 raft_consensus.cc:2468] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:45.615010 26792 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.615563 26792 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.616010 26551 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:45.620707 26813 consensus_queue.cc:1048] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:45.622284 26707 tablet_bootstrap.cc:654] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.622248 26813 raft_consensus.cc:2804] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.626155 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:45.626814 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:28:45.627727 26476 leader_election.cc:343] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.629328 26723 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:45.629729 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:28:45.631021 26550 leader_election.cc:343] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.626157 26813 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.633308 26813 raft_consensus.cc:3060] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.613569 26823 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:45.640086 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:45.640880 26436 raft_consensus.cc:2468] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:45.635592 26762 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:45.644587 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:28:45.646710 26401 leader_election.cc:343] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.646620 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:45.650043 26477 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
W20260709 12:28:45.651098 26402 leader_election.cc:343] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.654780 26762 consensus_queue.cc:1048] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.641430 26792 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:45.655454 26706 tablet_bootstrap.cc:654] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.657725 26709 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:45.659935 26708 tablet_bootstrap.cc:654] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.670928 26709 ts_tablet_manager.cc:1403] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.253s	user 0.035s	sys 0.018s
I20260709 12:28:45.666785 26336 catalog_manager.cc:5697] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.678201 26336 catalog_manager.cc:5697] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:45.674649 26709 raft_consensus.cc:359] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.681085 26709 raft_consensus.cc:385] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.681339 26709 raft_consensus.cc:740] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.682168 26709 consensus_queue.cc:260] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.676332 26823 raft_consensus.cc:2804] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:45.673676 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 54440.8us
I20260709 12:28:45.685791 26709 ts_tablet_manager.cc:1434] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:28:45.698798 26709 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:45.663563 26402 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:45.694118 26813 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.691273 26823 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.701901 26823 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.703230 26813 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:28:45.707463 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 56424.1us
I20260709 12:28:45.707666 26792 raft_consensus.cc:2749] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.716017 26813 consensus_queue.cc:1048] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.717540 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:45.718212 26513 raft_consensus.cc:3060] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.719094 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:45.719799 26436 raft_consensus.cc:3060] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.715546 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:45.723524 26437 raft_consensus.cc:2468] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:45.728258 26792 consensus_queue.cc:1048] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.735773 26551 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.736783 26813 raft_consensus.cc:2804] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.707376 26706 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:45.737248 26813 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.738443 26813 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.740124 26706 ts_tablet_manager.cc:1403] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.008s
I20260709 12:28:45.753495 26709 tablet_bootstrap.cc:654] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.754065 26513 raft_consensus.cc:2468] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:45.754364 26436 raft_consensus.cc:2468] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:45.728276 26823 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.810992 26823 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:45.811833 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:45.813956 26708 tablet_bootstrap.cc:492] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:45.814519 26708 ts_tablet_manager.cc:1403] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.274s	user 0.024s	sys 0.031s
W20260709 12:28:45.815729 26476 leader_election.cc:343] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.817574 26708 raft_consensus.cc:359] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.818303 26708 raft_consensus.cc:385] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.818578 26708 raft_consensus.cc:740] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.818792 26707 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:45.819330 26707 ts_tablet_manager.cc:1403] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.243s	user 0.015s	sys 0.003s
I20260709 12:28:45.819492 26708 consensus_queue.cc:260] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.821326 26551 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:45.821672 26708 ts_tablet_manager.cc:1434] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:45.822219 26762 raft_consensus.cc:2804] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.822762 26762 raft_consensus.cc:697] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:45.822863 26708 tablet_bootstrap.cc:492] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:45.824019 26762 consensus_queue.cc:237] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.835055 26813 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.835811 26708 tablet_bootstrap.cc:654] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.852533 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:45.853776 26436 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.854302 26813 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:45.855805 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
W20260709 12:28:45.845587 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 87240.8us
W20260709 12:28:45.860327 26550 leader_election.cc:343] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.864143 26708 tablet_bootstrap.cc:492] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:45.863274 26332 catalog_manager.cc:5697] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:45.864666 26708 ts_tablet_manager.cc:1403] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 12:28:45.865700 26332 catalog_manager.cc:5697] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.830384 26706 raft_consensus.cc:359] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.848210 26788 consensus_queue.cc:1048] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:45.836105 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 45769.5us
I20260709 12:28:45.868530 26706 raft_consensus.cc:385] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.868875 26706 raft_consensus.cc:740] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.852609 26707 raft_consensus.cc:359] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.869807 26707 raft_consensus.cc:385] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.873467 26436 raft_consensus.cc:2468] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:45.870901 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:45.888804 26437 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.867033 26708 raft_consensus.cc:359] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.891429 26708 raft_consensus.cc:385] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.850736 26709 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:45.892234 26709 ts_tablet_manager.cc:1403] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.000s
I20260709 12:28:45.891784 26708 raft_consensus.cc:740] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.872661 26707 raft_consensus.cc:740] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.894761 26708 consensus_queue.cc:260] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.894835 26788 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.897128 26437 raft_consensus.cc:2468] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:45.897411 26709 raft_consensus.cc:359] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.898488 26551 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.898679 26707 consensus_queue.cc:260] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.931654 26709 raft_consensus.cc:385] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.932034 26709 raft_consensus.cc:740] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.932642 26707 ts_tablet_manager.cc:1434] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.001s
I20260709 12:28:45.932749 26709 consensus_queue.cc:260] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.927682 26823 consensus_queue.cc:1048] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.933774 26707 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:45.869589 26706 consensus_queue.cc:260] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.936623 26708 ts_tablet_manager.cc:1434] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.072s	user 0.014s	sys 0.006s
I20260709 12:28:45.936692 26706 ts_tablet_manager.cc:1434] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.196s	user 0.004s	sys 0.003s
I20260709 12:28:45.937942 26708 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:45.932838 26762 raft_consensus.cc:2804] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.933363 26477 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:45.938128 26706 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:45.940133 26780 raft_consensus.cc:2804] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.940727 26780 raft_consensus.cc:697] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:45.941708 26780 consensus_queue.cc:237] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:45.938630 26762 raft_consensus.cc:697] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:45.941526 26334 catalog_manager.cc:5697] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 1 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:45.943696 26762 consensus_queue.cc:237] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:45.945619 26708 tablet_bootstrap.cc:654] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.953998 26709 ts_tablet_manager.cc:1434] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.061s	user 0.017s	sys 0.002s
I20260709 12:28:45.955389 26709 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:45.970839 26842 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.975441 26842 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:45.973623 26788 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.976365 26788 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:45.978570 26788 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:45.985868 26842 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:45.987149 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:45.988041 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:45.988230 26587 raft_consensus.cc:2393] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:45.983516 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:45.989287 26584 raft_consensus.cc:2468] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:45.991631 26707 tablet_bootstrap.cc:654] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.992811 26625 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:45.982200 26823 consensus_queue.cc:1048] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:28:45.998958 26823 consensus_queue.cc:1048] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:45.983225 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:46.008523 26706 tablet_bootstrap.cc:654] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.997944 26402 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:46.010548 26788 raft_consensus.cc:2804] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.011018 26788 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.011406 26788 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.013283 26832 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:46.014830 26402 leader_election.cc:343] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.021507 26832 raft_consensus.cc:2749] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.975459 26709 tablet_bootstrap.cc:654] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.030488 26792 consensus_queue.cc:1048] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.033224 26788 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.035632 26788 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:46.011945 26335 catalog_manager.cc:5697] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 1 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.042200 26707 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:46.044064 26707 ts_tablet_manager.cc:1403] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.002s
I20260709 12:28:46.047326 26707 raft_consensus.cc:359] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.048352 26707 raft_consensus.cc:385] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.042289 26706 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:46.049154 26751 consensus_queue.cc:1048] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.058122 26706 ts_tablet_manager.cc:1403] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.120s	user 0.008s	sys 0.005s
I20260709 12:28:46.061127 26709 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:46.062366 26332 catalog_manager.cc:5697] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:46.065218 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:46.068711 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:46.069573 26792 consensus_queue.cc:1048] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.069504 26584 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:46.080470 26402 leader_election.cc:343] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.091161 26706 raft_consensus.cc:359] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.061753 26709 ts_tablet_manager.cc:1403] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.000s
I20260709 12:28:46.091995 26706 raft_consensus.cc:385] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.092593 26706 raft_consensus.cc:740] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.093775 26706 consensus_queue.cc:260] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.096858 26709 raft_consensus.cc:359] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.097879 26709 raft_consensus.cc:385] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.098294 26709 raft_consensus.cc:740] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.099385 26709 consensus_queue.cc:260] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.048689 26707 raft_consensus.cc:740] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.097873 26706 ts_tablet_manager.cc:1434] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:28:46.105623 26706 tablet_bootstrap.cc:492] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:46.108618 26707 consensus_queue.cc:260] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.112071 26709 ts_tablet_manager.cc:1434] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:28:46.112560 26707 ts_tablet_manager.cc:1434] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 12:28:46.113303 26709 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:46.115062 26707 tablet_bootstrap.cc:492] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:46.114439 26832 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.119403 26832 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.122051 26832 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:46.124799 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:46.118680 26708 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:46.127326 26708 ts_tablet_manager.cc:1403] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.190s	user 0.054s	sys 0.082s
I20260709 12:28:46.127388 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:46.128345 26436 raft_consensus.cc:2393] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:46.131162 26625 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:46.132552 26832 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.136102 26708 raft_consensus.cc:359] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.136619 26584 raft_consensus.cc:2468] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:46.138936 26402 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:46.140216 26788 raft_consensus.cc:2804] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:46.140873 26788 raft_consensus.cc:697] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:46.141788 26788 consensus_queue.cc:237] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.136955 26708 raft_consensus.cc:385] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.142953 26708 raft_consensus.cc:740] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.143847 26708 consensus_queue.cc:260] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.145521 26709 tablet_bootstrap.cc:654] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.146975 26708 ts_tablet_manager.cc:1434] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:28:46.148561 26708 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:46.151952 26832 raft_consensus.cc:2749] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:46.140928 26706 tablet_bootstrap.cc:654] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.173485 26708 tablet_bootstrap.cc:654] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.176189 26707 tablet_bootstrap.cc:654] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.187944 26709 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:46.190725 26709 ts_tablet_manager.cc:1403] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.019s
I20260709 12:28:46.194357 26709 raft_consensus.cc:359] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.194434 26332 catalog_manager.cc:5697] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.196553 26709 raft_consensus.cc:385] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.196920 26709 raft_consensus.cc:740] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.197762 26706 tablet_bootstrap.cc:492] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:46.197784 26708 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:46.197644 26709 consensus_queue.cc:260] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.198410 26706 ts_tablet_manager.cc:1403] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.001s
I20260709 12:28:46.199709 26708 ts_tablet_manager.cc:1403] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.023s
I20260709 12:28:46.200539 26709 ts_tablet_manager.cc:1434] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:28:46.201676 26709 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:46.201421 26706 raft_consensus.cc:359] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.202184 26706 raft_consensus.cc:385] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.202920 26708 raft_consensus.cc:359] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.202472 26706 raft_consensus.cc:740] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.203693 26708 raft_consensus.cc:385] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.204035 26708 raft_consensus.cc:740] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.204727 26708 consensus_queue.cc:260] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.207031 26708 ts_tablet_manager.cc:1434] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:46.204344 26706 consensus_queue.cc:260] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.208242 26708 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:46.215731 26707 tablet_bootstrap.cc:492] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:46.216300 26708 tablet_bootstrap.cc:654] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.216424 26707 ts_tablet_manager.cc:1403] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.008s
I20260709 12:28:46.217682 26709 tablet_bootstrap.cc:654] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.219651 26707 raft_consensus.cc:359] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.220448 26707 raft_consensus.cc:385] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.223572 26706 ts_tablet_manager.cc:1434] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:28:46.220788 26707 raft_consensus.cc:740] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.226284 26707 consensus_queue.cc:260] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.228636 26707 ts_tablet_manager.cc:1434] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:28:46.234700 26707 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:46.237622 26709 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:46.238425 26709 ts_tablet_manager.cc:1403] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 12:28:46.240867 26707 tablet_bootstrap.cc:654] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.244313 26706 tablet_bootstrap.cc:492] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:46.247807 26709 raft_consensus.cc:359] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.250114 26709 raft_consensus.cc:385] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.250419 26709 raft_consensus.cc:740] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.251181 26709 consensus_queue.cc:260] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.253371 26709 ts_tablet_manager.cc:1434] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:28:46.254072 26708 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:46.254329 26709 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:46.254715 26708 ts_tablet_manager.cc:1403] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.011s
I20260709 12:28:46.258924 26708 raft_consensus.cc:359] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.259749 26708 raft_consensus.cc:385] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.260066 26708 raft_consensus.cc:740] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.260838 26708 consensus_queue.cc:260] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.261672 26709 tablet_bootstrap.cc:654] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.263186 26708 ts_tablet_manager.cc:1434] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:28:46.264585 26708 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:46.266964 26707 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:46.267673 26707 ts_tablet_manager.cc:1403] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.000s
I20260709 12:28:46.271639 26708 tablet_bootstrap.cc:654] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.264605 26706 tablet_bootstrap.cc:654] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.270741 26707 raft_consensus.cc:359] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.276150 26707 raft_consensus.cc:385] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.276515 26707 raft_consensus.cc:740] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.277289 26707 consensus_queue.cc:260] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.288033 26707 ts_tablet_manager.cc:1434] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:28:46.289608 26707 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:46.293081 26708 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:46.294416 26708 ts_tablet_manager.cc:1403] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.006s
I20260709 12:28:46.298103 26708 raft_consensus.cc:359] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.299101 26708 raft_consensus.cc:385] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.299448 26708 raft_consensus.cc:740] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.299180 26780 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.300581 26780 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.302096 26818 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.302704 26818 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.304797 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:46.305519 26707 tablet_bootstrap.cc:654] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.299474 26876 consensus_queue.cc:1048] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:28:46.308010 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.312275 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:46.313249 26436 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
W20260709 12:28:46.314983 26477 leader_election.cc:343] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:46.316090 26476 leader_election.cc:343] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.320621 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:46.321020 26751 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.321647 26661 raft_consensus.cc:2468] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:46.321777 26751 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.325174 26751 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:46.328367 26476 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:46.330993 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:46.333550 26477 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:46.334784 26823 raft_consensus.cc:2804] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.335194 26823 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.335537 26823 raft_consensus.cc:3060] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.304847 26818 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:46.337131 26818 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.337491 26818 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.338744 26706 tablet_bootstrap.cc:492] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:46.339283 26706 ts_tablet_manager.cc:1403] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.003s
I20260709 12:28:46.344774 26709 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:46.345472 26709 ts_tablet_manager.cc:1403] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.091s	user 0.031s	sys 0.046s
I20260709 12:28:46.303092 26780 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:46.348779 26709 raft_consensus.cc:359] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.349684 26709 raft_consensus.cc:385] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.350004 26709 raft_consensus.cc:740] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.350242 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.337826 26818 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.342216 26706 raft_consensus.cc:359] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.351236 26706 raft_consensus.cc:385] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.351579 26706 raft_consensus.cc:740] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.351030 26587 raft_consensus.cc:2468] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:46.352455 26706 consensus_queue.cc:260] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.355681 26706 ts_tablet_manager.cc:1434] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:28:46.356689 26706 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:46.355408 26707 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:46.360535 26707 ts_tablet_manager.cc:1403] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.071s	user 0.032s	sys 0.012s
I20260709 12:28:46.360997 26818 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.352283 26876 consensus_queue.cc:1048] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:28:46.361609 26709 consensus_queue.cc:260] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.363406 26709 ts_tablet_manager.cc:1434] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:28:46.365145 26762 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.365005 26707 raft_consensus.cc:359] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.365688 26762 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.366169 26707 raft_consensus.cc:385] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.366461 26707 raft_consensus.cc:740] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.367198 26707 consensus_queue.cc:260] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.368884 26762 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:46.369793 26707 ts_tablet_manager.cc:1434] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:28:46.371780 26707 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:46.371837 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:46.372562 26661 raft_consensus.cc:2468] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:46.373296 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:46.373855 26550 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:46.374850 26709 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:46.375980 26762 raft_consensus.cc:2804] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.376492 26762 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.376915 26762 raft_consensus.cc:3060] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.378789 26707 tablet_bootstrap.cc:654] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.300570 26708 consensus_queue.cc:260] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.385363 26706 tablet_bootstrap.cc:654] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.390662 26708 ts_tablet_manager.cc:1434] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 12:28:46.391847 26818 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:46.392557 26708 tablet_bootstrap.cc:492] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:46.397948 26709 tablet_bootstrap.cc:654] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.384294 26477 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
W20260709 12:28:46.403250 26476 leader_election.cc:343] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.408806 26823 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.406047 26818 raft_consensus.cc:2804] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.411931 26513 raft_consensus.cc:2393] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:46.413757 26876 consensus_queue.cc:1048] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.414793 26818 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.415277 26818 raft_consensus.cc:3060] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.412905 26832 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.418156 26832 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.419611 26762 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.420411 26832 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:46.427378 26762 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:46.427681 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.428369 26587 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:46.428699 26788 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.431102 26818 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.429198 26788 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.437590 26788 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:46.438342 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:46.428244 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:46.439916 26436 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.440092 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:28:46.441870 26402 leader_election.cc:343] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.439313 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:46.439244 26513 raft_consensus.cc:2393] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
W20260709 12:28:46.444520 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 63135.6us
W20260709 12:28:46.444893 26401 leader_election.cc:343] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.445518 26401 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:46.446885 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:46.447624 26438 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:46.447021 26789 raft_consensus.cc:2749] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:46.450215 26751 consensus_queue.cc:1048] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.463248 26823 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:46.465831 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:46.468035 26584 raft_consensus.cc:2393] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 1: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:28:46.468912 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:46.469575 26661 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.478129 26708 tablet_bootstrap.cc:654] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.480507 26707 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:46.481235 26707 ts_tablet_manager.cc:1403] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.003s
I20260709 12:28:46.465859 26625 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:46.484661 26832 raft_consensus.cc:2804] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.485102 26832 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.485440 26832 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.486057 26660 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.486967 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:46.487624 26659 raft_consensus.cc:3060] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.493399 26707 raft_consensus.cc:359] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.494377 26707 raft_consensus.cc:385] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.494940 26707 raft_consensus.cc:740] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.500749 26707 consensus_queue.cc:260] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.501256 26706 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:46.504303 26706 ts_tablet_manager.cc:1403] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.148s	user 0.009s	sys 0.006s
I20260709 12:28:46.504711 26832 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.505842 26436 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:46.506987 26832 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:46.507458 26477 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:46.508812 26709 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:46.508479 26706 raft_consensus.cc:359] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.508944 26823 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:46.509207 26706 raft_consensus.cc:385] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.509341 26709 ts_tablet_manager.cc:1403] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.010s
I20260709 12:28:46.509634 26823 raft_consensus.cc:697] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:46.510619 26823 consensus_queue.cc:237] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.498984 26862 consensus_queue.cc:1048] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:28:46.514146 26751 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.514781 26751 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.509621 26706 raft_consensus.cc:740] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.517478 26706 consensus_queue.cc:260] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.518324 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:46.516952 26751 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:46.523703 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:46.524400 26586 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.524951 26706 ts_tablet_manager.cc:1434] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:28:46.520640 26707 ts_tablet_manager.cc:1434] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 12:28:46.521009 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:46.525667 26709 raft_consensus.cc:359] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.526396 26587 raft_consensus.cc:3060] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.527770 26707 tablet_bootstrap.cc:492] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:46.532658 26706 tablet_bootstrap.cc:492] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:46.533671 26586 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:46.534906 26587 raft_consensus.cc:2468] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:46.517892 26818 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:46.521791 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.526458 26709 raft_consensus.cc:385] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.536707 26477 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:46.537990 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:46.546452 26437 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.546501 26855 raft_consensus.cc:2804] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:46.547574 26855 raft_consensus.cc:697] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:46.498529 26661 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:46.543836 26751 consensus_queue.cc:1048] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.545028 26584 raft_consensus.cc:2393] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:28:46.545099 26709 raft_consensus.cc:740] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.538949 26659 raft_consensus.cc:2468] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:46.518450 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:46.555768 26709 consensus_queue.cc:260] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.557173 26855 consensus_queue.cc:237] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.560745 26789 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.561718 26707 tablet_bootstrap.cc:654] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.563854 26709 ts_tablet_manager.cc:1434] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:28:46.565284 26709 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:46.566303 26789 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.576822 26789 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:46.577466 26477 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:46.578748 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.580264 26336 catalog_manager.cc:5697] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:46.597713 26780 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.594429 26584 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:46.586078 26789 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.586830 26820 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.607926 26820 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.609535 26789 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.606398 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:46.607205 26402 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:46.611913 26788 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.612313 26788 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.612637 26788 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.610158 26820 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:46.594849 26660 raft_consensus.cc:2393] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 1: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
W20260709 12:28:46.621076 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 43710.3us
I20260709 12:28:46.622666 26789 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:46.624156 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:28:46.626672 26401 leader_election.cc:343] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.627702 26708 tablet_bootstrap.cc:492] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:46.628381 26708 ts_tablet_manager.cc:1403] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.236s	user 0.024s	sys 0.009s
I20260709 12:28:46.633638 26751 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.634238 26751 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.636430 26751 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:46.637573 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:46.638288 26512 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:46.639267 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:46.639912 26513 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:46.640468 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:46.641160 26436 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:46.644672 26550 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:46.645098 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:46.636474 26708 raft_consensus.cc:359] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.648932 26708 raft_consensus.cc:385] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.649323 26708 raft_consensus.cc:740] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.652236 26708 consensus_queue.cc:260] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.653924 26762 raft_consensus.cc:2804] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:46.660697 26708 ts_tablet_manager.cc:1434] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.004s
I20260709 12:28:46.663209 26708 tablet_bootstrap.cc:492] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:46.647776 26477 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:46.665766 26762 raft_consensus.cc:697] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:46.671187 26762 consensus_queue.cc:237] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.674888 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.680814 26709 tablet_bootstrap.cc:654] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.682973 26820 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.683607 26820 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.684958 26706 tablet_bootstrap.cc:654] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.685925 26820 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:46.692456 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:46.693430 26707 tablet_bootstrap.cc:492] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:46.694386 26707 ts_tablet_manager.cc:1403] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.167s	user 0.004s	sys 0.010s
W20260709 12:28:46.694521 26476 leader_election.cc:343] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.697202 26476 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:46.698839 26913 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.699301 26913 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.699688 26913 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.702956 26914 raft_consensus.cc:2749] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:46.659446 26437 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:46.703339 26707 raft_consensus.cc:359] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.708171 26707 raft_consensus.cc:385] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.708658 26707 raft_consensus.cc:740] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.709471 26707 consensus_queue.cc:260] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.714015 26707 ts_tablet_manager.cc:1434] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
W20260709 12:28:46.706655 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 56007.2us
I20260709 12:28:46.746557 26707 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:46.714039 26788 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.747350 26723 consensus_queue.cc:1048] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.749413 26788 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:28:46.715806 26915 log.cc:927] Time spent T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:28:46.745440 26625 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:46.743878 26780 raft_consensus.cc:2749] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:46.758427 26402 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:46.759773 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:46.769140 26512 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.769246 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:46.770146 26584 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.724462 26789 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.753667 26336 catalog_manager.cc:5697] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.776151 26789 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:46.777654 26723 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.778115 26723 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.778448 26723 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:46.784170 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:46.784165 26842 raft_consensus.cc:2804] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:46.766808 26913 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.811961 26842 raft_consensus.cc:697] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:46.813032 26842 consensus_queue.cc:237] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.836139 26332 catalog_manager.cc:5697] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 1 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.838490 26924 consensus_queue.cc:1048] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.840426 26706 tablet_bootstrap.cc:492] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:46.841459 26706 ts_tablet_manager.cc:1403] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.309s	user 0.022s	sys 0.011s
I20260709 12:28:46.835666 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:28:46.827749 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 58197us
I20260709 12:28:46.843333 26789 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:28:46.867614 26476 leader_election.cc:343] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.868281 26512 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:46.870138 26709 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:46.870697 26709 ts_tablet_manager.cc:1403] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.306s	user 0.024s	sys 0.012s
I20260709 12:28:46.872749 26780 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.873322 26780 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.875801 26780 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:46.873369 26706 raft_consensus.cc:359] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.876464 26706 raft_consensus.cc:385] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.876824 26706 raft_consensus.cc:740] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.877076 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.877312 26709 raft_consensus.cc:359] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.878067 26709 raft_consensus.cc:385] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.877750 26706 consensus_queue.cc:260] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.878367 26709 raft_consensus.cc:740] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.879254 26587 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:46.879194 26709 consensus_queue.cc:260] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.881225 26706 ts_tablet_manager.cc:1434] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:28:46.881420 26709 ts_tablet_manager.cc:1434] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:28:46.882058 26706 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:46.882407 26709 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:46.879299 26708 tablet_bootstrap.cc:654] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.883471 26707 tablet_bootstrap.cc:654] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.862733 26913 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:28:46.885481 26402 leader_election.cc:343] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.886071 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.893461 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:46.896590 26584 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:46.897511 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:46.892669 26402 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:46.904517 26925 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:46.901036 26723 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.908526 26437 raft_consensus.cc:2393] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:28:46.911226 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:46.913074 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:46.913785 26659 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:46.916025 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:46.916805 26437 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
W20260709 12:28:46.919301 26402 leader_election.cc:343] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.919766 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:46.919862 26402 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:28:46.921381 26401 leader_election.cc:343] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.921447 26789 raft_consensus.cc:2749] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:46.908789 26723 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:46.931227 26477 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:46.931808 26625 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:46.932209 26780 raft_consensus.cc:2804] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:46.932701 26780 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.931986 26925 raft_consensus.cc:697] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:46.933060 26780 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:46.934156 26707 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:46.935774 26707 ts_tablet_manager.cc:1403] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.191s	user 0.014s	sys 0.003s
I20260709 12:28:46.936828 26925 consensus_queue.cc:237] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:28:46.939600 26625 leader_election.cc:343] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:46.939917 26476 leader_election.cc:343] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:46.937906 26706 tablet_bootstrap.cc:654] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.940375 26476 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:46.930925 26709 tablet_bootstrap.cc:654] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.943653 26707 raft_consensus.cc:359] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.944478 26707 raft_consensus.cc:385] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.944798 26707 raft_consensus.cc:740] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.945529 26707 consensus_queue.cc:260] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.947803 26707 ts_tablet_manager.cc:1434] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:28:46.933455 26842 raft_consensus.cc:2749] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:46.948927 26707 tablet_bootstrap.cc:492] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:46.953671 26708 tablet_bootstrap.cc:492] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:46.943766 26914 raft_consensus.cc:2749] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:46.954315 26708 ts_tablet_manager.cc:1403] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.291s	user 0.008s	sys 0.008s
I20260709 12:28:46.957406 26708 raft_consensus.cc:359] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.958463 26708 raft_consensus.cc:385] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.961426 26708 raft_consensus.cc:740] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.962730 26708 consensus_queue.cc:260] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:46.965065 26708 ts_tablet_manager.cc:1434] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:28:46.967437 26708 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:46.971880 26706 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:46.972486 26706 ts_tablet_manager.cc:1403] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.003s
I20260709 12:28:46.977101 26708 tablet_bootstrap.cc:654] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.977365 26709 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:46.977985 26709 ts_tablet_manager.cc:1403] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.096s	user 0.008s	sys 0.008s
I20260709 12:28:46.978936 26914 consensus_queue.cc:1048] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.981163 26707 tablet_bootstrap.cc:654] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:46.982854 26709 raft_consensus.cc:359] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.984179 26709 raft_consensus.cc:385] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.984537 26709 raft_consensus.cc:740] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.982478 26706 raft_consensus.cc:359] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.985030 26706 raft_consensus.cc:385] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:46.985344 26706 raft_consensus.cc:740] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:46.987227 26706 consensus_queue.cc:260] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:46.986088 26709 consensus_queue.cc:260] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:46.990059 26709 ts_tablet_manager.cc:1434] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 12:28:46.994231 26332 catalog_manager.cc:5697] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.995997 26709 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:46.996383 26708 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:46.997112 26708 ts_tablet_manager.cc:1403] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.030s	user 0.004s	sys 0.017s
I20260709 12:28:46.992312 26706 ts_tablet_manager.cc:1434] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:28:47.001794 26706 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:47.007161 26780 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.007329 26708 raft_consensus.cc:359] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.008435 26708 raft_consensus.cc:385] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.008890 26708 raft_consensus.cc:740] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.009863 26708 consensus_queue.cc:260] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.010787 26780 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:47.011813 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:47.012527 26587 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.013135 26708 ts_tablet_manager.cc:1434] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:28:47.019800 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:47.020622 26661 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.024685 26706 tablet_bootstrap.cc:654] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.025290 26855 consensus_queue.cc:1048] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:47.028218 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:47.029156 26512 raft_consensus.cc:2393] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:47.032608 26707 tablet_bootstrap.cc:492] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:47.033141 26707 ts_tablet_manager.cc:1403] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.010s
I20260709 12:28:47.032342 26587 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:47.035542 26625 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:47.036348 26709 tablet_bootstrap.cc:654] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.036207 26661 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:47.036540 26842 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:47.037056 26842 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.037421 26842 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.035967 26707 raft_consensus.cc:359] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.040009 26707 raft_consensus.cc:385] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.040345 26707 raft_consensus.cc:740] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.041201 26707 consensus_queue.cc:260] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.044348 26477 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:47.045985 26402 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:47.048465 26707 ts_tablet_manager.cc:1434] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 12:28:47.069140 26723 raft_consensus.cc:2749] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:47.069303 26780 raft_consensus.cc:2804] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:47.069940 26780 raft_consensus.cc:697] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:47.052524 26708 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:47.070549 26707 tablet_bootstrap.cc:492] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:47.077126 26780 consensus_queue.cc:237] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.079032 26708 tablet_bootstrap.cc:654] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.080112 26707 tablet_bootstrap.cc:654] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.053413 26842 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.098088 26708 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:47.102108 26708 ts_tablet_manager.cc:1403] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.005s
I20260709 12:28:47.104017 26842 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:47.111944 26707 tablet_bootstrap.cc:492] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:47.112804 26707 ts_tablet_manager.cc:1403] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.005s
I20260709 12:28:47.116751 26707 raft_consensus.cc:359] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.117589 26707 raft_consensus.cc:385] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.117873 26707 raft_consensus.cc:740] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.123617 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:47.124859 26587 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.126555 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:47.127329 26436 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.132311 26659 raft_consensus.cc:3060] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.134833 26707 consensus_queue.cc:260] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.142349 26436 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:47.146291 26707 ts_tablet_manager.cc:1434] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:28:47.148145 26707 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:47.147976 26625 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.151860 26941 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:47.152513 26941 raft_consensus.cc:697] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:47.153386 26941 consensus_queue.cc:237] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.156996 26332 catalog_manager.cc:5697] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:47.159365 26709 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
W20260709 12:28:47.160126 26938 log.cc:927] Time spent T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 12:28:47.160365 26709 ts_tablet_manager.cc:1403] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.165s	user 0.024s	sys 0.006s
I20260709 12:28:47.161326 26707 tablet_bootstrap.cc:654] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.161442 26820 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.167344 26708 raft_consensus.cc:359] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.168361 26708 raft_consensus.cc:385] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.165148 26820 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.169849 26855 consensus_queue.cc:1048] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:47.171522 26709 raft_consensus.cc:359] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.172294 26709 raft_consensus.cc:385] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.172585 26709 raft_consensus.cc:740] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.173703 26709 consensus_queue.cc:260] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.174081 26855 consensus_queue.cc:1048] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:47.174888 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:47.175410 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:47.175567 26584 raft_consensus.cc:2468] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:47.173579 26820 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:47.177217 26625 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:47.177985 26709 ts_tablet_manager.cc:1434] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:28:47.168808 26708 raft_consensus.cc:740] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.179513 26820 raft_consensus.cc:2804] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:47.180761 26820 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.183228 26820 raft_consensus.cc:3060] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:47.179888 26708 consensus_queue.cc:260] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.179463 26587 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:47.181522 26706 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:47.179121 26709 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:47.185556 26706 ts_tablet_manager.cc:1403] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.185s	user 0.039s	sys 0.040s
I20260709 12:28:47.195750 26708 ts_tablet_manager.cc:1434] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.001s
I20260709 12:28:47.197737 26708 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:47.198823 26707 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:47.199391 26707 ts_tablet_manager.cc:1403] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.003s
I20260709 12:28:47.199669 26706 raft_consensus.cc:359] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.200409 26706 raft_consensus.cc:385] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.200680 26706 raft_consensus.cc:740] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.201393 26706 consensus_queue.cc:260] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.203868 26709 tablet_bootstrap.cc:654] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.207784 26707 raft_consensus.cc:359] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.209023 26707 raft_consensus.cc:385] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.209439 26707 raft_consensus.cc:740] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.210641 26707 consensus_queue.cc:260] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.213250 26708 tablet_bootstrap.cc:654] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.214233 26707 ts_tablet_manager.cc:1434] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:28:47.211723 26820 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.215431 26707 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:47.219197 26659 raft_consensus.cc:1240] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:28:47.220387 26706 ts_tablet_manager.cc:1434] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:28:47.221657 26706 tablet_bootstrap.cc:492] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:47.221995 26751 consensus_queue.cc:1059] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:47.223316 26751 raft_consensus.cc:3055] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:47.223688 26751 raft_consensus.cc:740] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:47.224673 26751 consensus_queue.cc:260] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.225934 26751 raft_consensus.cc:3060] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:47.225134 26707 tablet_bootstrap.cc:654] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.227135 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:47.228163 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:47.232694 26762 consensus_queue.cc:1048] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:47.239094 26706 tablet_bootstrap.cc:654] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.238806 26842 consensus_queue.cc:1048] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:47.241767 26820 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:47.247426 26855 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.248219 26855 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.253333 26708 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:47.253679 26709 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:47.253938 26708 ts_tablet_manager.cc:1403] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.002s
I20260709 12:28:47.254136 26709 ts_tablet_manager.cc:1403] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.013s
I20260709 12:28:47.256822 26855 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:47.257207 26709 raft_consensus.cc:359] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.258980 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:47.259745 26661 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:47.260825 26476 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:47.258951 26706 tablet_bootstrap.cc:492] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:47.261806 26855 raft_consensus.cc:2804] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:47.262449 26855 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.263082 26855 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.263370 26706 ts_tablet_manager.cc:1403] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.003s
I20260709 12:28:47.267071 26708 raft_consensus.cc:359] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.267880 26708 raft_consensus.cc:385] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.268159 26708 raft_consensus.cc:740] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.268313 26832 consensus_queue.cc:1048] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:47.270147 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:47.272912 26855 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.270815 26708 consensus_queue.cc:260] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:28:47.277904 26477 leader_election.cc:343] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.277820 26709 raft_consensus.cc:385] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.278642 26709 raft_consensus.cc:740] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.279352 26709 consensus_queue.cc:260] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.280839 26708 ts_tablet_manager.cc:1434] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:28:47.282130 26708 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:47.283514 26709 ts_tablet_manager.cc:1434] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:28:47.272768 26706 raft_consensus.cc:359] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.284355 26706 raft_consensus.cc:385] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.284669 26706 raft_consensus.cc:740] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.286510 26709 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:47.283759 26335 catalog_manager.cc:5697] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:47.289980 26706 consensus_queue.cc:260] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.296375 26709 tablet_bootstrap.cc:654] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.299477 26706 ts_tablet_manager.cc:1434] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 12:28:47.300719 26706 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:47.305460 26707 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:47.306295 26707 ts_tablet_manager.cc:1403] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.020s
I20260709 12:28:47.306691 26512 raft_consensus.cc:2410] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:28:47.309015 26929 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.309619 26929 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.309643 26707 raft_consensus.cc:359] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.312037 26707 raft_consensus.cc:385] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.312311 26707 raft_consensus.cc:740] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.312459 26709 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:47.313102 26709 ts_tablet_manager.cc:1403] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.007s
I20260709 12:28:47.316006 26709 raft_consensus.cc:359] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.316751 26709 raft_consensus.cc:385] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.317028 26709 raft_consensus.cc:740] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.317283 26706 tablet_bootstrap.cc:654] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.317708 26709 consensus_queue.cc:260] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.318070 26707 consensus_queue.cc:260] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.319429 26929 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:47.320379 26709 ts_tablet_manager.cc:1434] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:47.320147 26625 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:47.321506 26708 tablet_bootstrap.cc:654] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.325354 26820 raft_consensus.cc:2749] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:47.326280 26820 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.326958 26820 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.329069 26820 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:47.319433 26862 consensus_queue.cc:1048] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:47.323210 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:47.332337 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:47.333215 26436 raft_consensus.cc:2393] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
W20260709 12:28:47.332671 26401 leader_election.cc:343] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.320328 26707 ts_tablet_manager.cc:1434] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:28:47.336416 26707 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:47.336719 26929 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.337283 26929 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.338382 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:47.339288 26511 raft_consensus.cc:2393] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:47.340313 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:47.341035 26659 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:47.342718 26401 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.343518 26929 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:47.343654 26723 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:47.346555 26723 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.346978 26723 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.347934 26855 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:47.353405 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:47.354219 26587 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.356017 26709 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:47.356278 26723 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.359586 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:47.360260 26661 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.326332 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:28:47.366851 26402 leader_election.cc:343] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.364638 26707 tablet_bootstrap.cc:654] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.365731 26625 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:47.368358 26587 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:47.376578 26941 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.368746 26335 catalog_manager.cc:5697] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:47.378479 26477 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:47.375800 26402 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:47.379508 26855 raft_consensus.cc:2804] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:47.379992 26855 raft_consensus.cc:697] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:47.380868 26855 consensus_queue.cc:237] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.371351 26708 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:47.382418 26708 ts_tablet_manager.cc:1403] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.003s
I20260709 12:28:47.384904 26929 raft_consensus.cc:2749] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:47.375861 26706 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:47.385411 26708 raft_consensus.cc:359] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.385986 26941 raft_consensus.cc:2749] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:47.385954 26706 ts_tablet_manager.cc:1403] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.085s	user 0.004s	sys 0.009s
I20260709 12:28:47.386160 26708 raft_consensus.cc:385] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.386870 26708 raft_consensus.cc:740] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.388803 26929 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:47.389748 26706 raft_consensus.cc:359] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.390988 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:47.391613 26510 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.387663 26708 consensus_queue.cc:260] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.396754 26708 ts_tablet_manager.cc:1434] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:28:47.397840 26708 tablet_bootstrap.cc:492] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:47.401177 26510 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:47.402226 26706 raft_consensus.cc:385] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.404729 26402 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.405643 26789 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:47.406231 26789 raft_consensus.cc:697] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:47.406793 26855 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.407312 26855 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.407454 26789 consensus_queue.cc:237] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.372359 26709 tablet_bootstrap.cc:654] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.372931 26723 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:47.365794 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:47.412886 26660 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.366170 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:47.415480 26511 raft_consensus.cc:2376] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1. Re-sending same reply.
I20260709 12:28:47.404762 26706 raft_consensus.cc:740] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.372210 26661 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:47.448446 26708 tablet_bootstrap.cc:654] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.468663 26855 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:47.471055 26706 consensus_queue.cc:260] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.473455 26706 ts_tablet_manager.cc:1434] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.087s	user 0.003s	sys 0.007s
I20260709 12:28:47.478204 26707 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:47.478828 26707 ts_tablet_manager.cc:1403] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.002s
I20260709 12:28:47.481258 26925 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.481819 26925 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.482319 26751 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.482895 26751 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.484156 26925 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:47.484972 26751 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:47.481400 26709 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:47.487145 26709 ts_tablet_manager.cc:1403] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.011s
I20260709 12:28:47.481655 26707 raft_consensus.cc:359] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.487624 26707 raft_consensus.cc:385] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.487715 26706 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:47.487951 26707 raft_consensus.cc:740] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.491101 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:47.491770 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:47.491818 26436 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:47.494724 26709 raft_consensus.cc:359] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.495446 26709 raft_consensus.cc:385] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.495721 26709 raft_consensus.cc:740] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.488951 26707 consensus_queue.cc:260] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.500204 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:47.501041 26661 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:47.502265 26401 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.503978 26707 ts_tablet_manager.cc:1434] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 12:28:47.504837 26707 tablet_bootstrap.cc:492] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
W20260709 12:28:47.500289 26476 leader_election.cc:343] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.509846 26929 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.510500 26929 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.506429 26709 consensus_queue.cc:260] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.512298 26477 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.531036 26832 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.534940 26929 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:47.535272 26832 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.513262 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:47.514665 26925 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:47.536505 26587 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:47.536279 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:47.537432 26584 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:47.537552 26925 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.537878 26832 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:47.517788 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:47.533164 26706 tablet_bootstrap.cc:654] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.525935 26708 tablet_bootstrap.cc:492] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:47.540311 26708 ts_tablet_manager.cc:1403] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.001s
I20260709 12:28:47.542054 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:47.542379 26925 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.513423 26751 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:47.547075 26751 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.547327 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:47.547524 26751 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.548214 26510 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:47.551254 26708 raft_consensus.cc:359] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.552003 26708 raft_consensus.cc:385] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.552316 26708 raft_consensus.cc:740] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.499372 26660 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:47.552943 26914 consensus_queue.cc:1048] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:47.547466 26436 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
W20260709 12:28:47.563078 26625 leader_election.cc:343] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.564332 26708 consensus_queue.cc:260] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.565330 26707 tablet_bootstrap.cc:654] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.577076 26708 ts_tablet_manager.cc:1434] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:28:47.576586 26709 ts_tablet_manager.cc:1434] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.089s	user 0.012s	sys 0.006s
I20260709 12:28:47.578912 26708 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:47.580786 26709 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:47.557232 26751 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.558844 26477 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:47.584743 26855 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:47.585225 26855 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.585569 26855 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.589609 26708 tablet_bootstrap.cc:654] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.594964 26914 consensus_queue.cc:1048] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:47.581799 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 53757.7us
I20260709 12:28:47.580744 26832 consensus_queue.cc:1048] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:47.516997 26331 catalog_manager.cc:5697] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:47.613106 26751 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:47.614897 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:47.615665 26436 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.621528 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:47.622290 26584 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.623100 26402 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.634125 26708 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:47.634140 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:47.635126 26708 ts_tablet_manager.cc:1403] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.008s
I20260709 12:28:47.637244 26332 catalog_manager.cc:5697] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:47.644034 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:47.644461 26855 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.651543 26709 tablet_bootstrap.cc:654] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.654003 26708 raft_consensus.cc:359] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.633002 26967 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:47.654968 26708 raft_consensus.cc:385] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.655736 26708 raft_consensus.cc:740] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
W20260709 12:28:47.657963 26625 leader_election.cc:343] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.658617 26625 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:47.661649 26708 consensus_queue.cc:260] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.656634 26967 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.662794 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:47.669703 26708 ts_tablet_manager.cc:1434] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:28:47.671639 26708 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
W20260709 12:28:47.673346 26476 leader_election.cc:343] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.674505 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:47.675343 26437 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.662860 26832 raft_consensus.cc:2749] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:47.671252 26967 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:47.690737 26402 leader_election.cc:343] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.691150 26708 tablet_bootstrap.cc:654] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.692951 26965 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:28:47.679275 26925 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.718410 26832 consensus_queue.cc:1048] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:47.722483 26925 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:47.724365 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:47.724659 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:47.725159 26587 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.725670 26660 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.728680 26436 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:47.731761 26707 tablet_bootstrap.cc:492] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:47.733317 26707 ts_tablet_manager.cc:1403] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.229s	user 0.013s	sys 0.008s
I20260709 12:28:47.734076 26477 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.736934 26914 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:47.737779 26914 raft_consensus.cc:697] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:47.677587 26855 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:47.738843 26914 consensus_queue.cc:237] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.736217 26706 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:47.764503 26706 ts_tablet_manager.cc:1403] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.277s	user 0.017s	sys 0.008s
I20260709 12:28:47.784207 26587 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:47.788116 26402 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.791721 26723 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:47.792287 26723 raft_consensus.cc:697] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:47.793145 26723 consensus_queue.cc:237] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.801210 26706 raft_consensus.cc:359] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.802048 26706 raft_consensus.cc:385] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.802311 26706 raft_consensus.cc:740] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.799665 26967 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.810030 26707 raft_consensus.cc:359] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.812096 26707 raft_consensus.cc:385] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.812423 26707 raft_consensus.cc:740] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.813071 26707 consensus_queue.cc:260] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.814260 26706 consensus_queue.cc:260] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.816418 26707 ts_tablet_manager.cc:1434] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.082s	user 0.011s	sys 0.001s
I20260709 12:28:47.843770 26708 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:47.844421 26708 ts_tablet_manager.cc:1403] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.173s	user 0.050s	sys 0.041s
I20260709 12:28:47.848119 26708 raft_consensus.cc:359] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.848917 26708 raft_consensus.cc:385] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.851013 26855 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.851696 26855 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.855918 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:47.856712 26435 raft_consensus.cc:2468] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:47.858763 26584 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:47.860249 26477 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.860829 26967 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:47.861147 26780 raft_consensus.cc:2804] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:47.849234 26708 raft_consensus.cc:740] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.861603 26780 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.861987 26780 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.862376 26708 consensus_queue.cc:260] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:47.864321 26708 ts_tablet_manager.cc:1434] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:28:47.865480 26708 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:47.868392 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:47.868788 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:47.869199 26512 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.869391 26584 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.859331 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:47.869813 26660 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:47.872188 26706 ts_tablet_manager.cc:1434] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.000s
I20260709 12:28:47.874801 26706 tablet_bootstrap.cc:492] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:47.851049 26437 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:47.873394 26707 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:47.858861 26855 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:47.895008 26584 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:47.895303 26709 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
W20260709 12:28:47.889922 26477 leader_election.cc:343] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:47.897554 26709 ts_tablet_manager.cc:1403] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.317s	user 0.007s	sys 0.009s
I20260709 12:28:47.898167 26477 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:47.906877 26818 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:47.920801 26402 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:47.932986 26965 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:47.944470 26965 raft_consensus.cc:697] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:47.945730 26965 consensus_queue.cc:237] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.949944 26708 tablet_bootstrap.cc:654] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.956579 26707 tablet_bootstrap.cc:654] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.957252 26709 raft_consensus.cc:359] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.954432 26706 tablet_bootstrap.cc:654] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:47.969274 26709 raft_consensus.cc:385] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:47.964108 26780 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:47.966050 26981 consensus_queue.cc:1048] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:47.934252 26818 raft_consensus.cc:697] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:47.962922 26332 catalog_manager.cc:5697] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:47.969900 26709 raft_consensus.cc:740] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:47.976640 26709 consensus_queue.cc:260] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:47.981994 26983 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.982669 26983 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:47.983840 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:47.985004 26438 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:47.986078 26983 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:47.989024 26335 catalog_manager.cc:5697] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:47.994931 26709 ts_tablet_manager.cc:1434] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.003s
I20260709 12:28:47.996260 26709 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:47.998714 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:47.999114 26780 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:28:48.000248 26477 leader_election.cc:343] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.001480 26512 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:48.011168 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:28:48.013736 26477 leader_election.cc:343] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.018555 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.019331 26660 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:48.019668 26438 raft_consensus.cc:2468] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:47.975937 26818 consensus_queue.cc:237] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.025547 26477 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:48.026808 26751 raft_consensus.cc:2804] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.027343 26751 raft_consensus.cc:697] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:48.028380 26751 consensus_queue.cc:237] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.029996 26335 catalog_manager.cc:5697] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:48.024712 26476 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:48.036945 26983 raft_consensus.cc:2804] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.037403 26983 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.037751 26983 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.044090 26709 tablet_bootstrap.cc:654] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.045104 26707 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:48.045773 26707 ts_tablet_manager.cc:1403] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.174s	user 0.003s	sys 0.010s
I20260709 12:28:48.045177 26780 consensus_queue.cc:1048] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:28:48.068498 26708 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:48.069119 26708 ts_tablet_manager.cc:1403] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.204s	user 0.015s	sys 0.001s
I20260709 12:28:48.073941 26707 raft_consensus.cc:359] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.077337 26707 raft_consensus.cc:385] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.077782 26707 raft_consensus.cc:740] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.070309 26332 catalog_manager.cc:5697] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:48.060670 26983 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.076366 26708 raft_consensus.cc:359] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.081369 26708 raft_consensus.cc:385] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.083498 26708 raft_consensus.cc:740] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.087090 26707 consensus_queue.cc:260] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:28:48.077455 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:48.098064 26708 consensus_queue.cc:260] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.080873 26983 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:48.099156 26707 ts_tablet_manager.cc:1434] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 12:28:48.099854 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:48.100746 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:48.108636 26707 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:48.109692 26708 ts_tablet_manager.cc:1434] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:28:48.110526 26708 tablet_bootstrap.cc:492] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
W20260709 12:28:48.112068 26477 leader_election.cc:343] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.112587 26661 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.115572 26723 consensus_queue.cc:1048] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:48.116380 26967 consensus_queue.cc:1048] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:48.125672 26706 tablet_bootstrap.cc:492] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:48.126335 26706 ts_tablet_manager.cc:1403] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.252s	user 0.029s	sys 0.016s
I20260709 12:28:48.135272 26708 tablet_bootstrap.cc:654] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.135932 26707 tablet_bootstrap.cc:654] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.129920 26706 raft_consensus.cc:359] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.141158 26709 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:48.141359 26706 raft_consensus.cc:385] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.141741 26709 ts_tablet_manager.cc:1403] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.004s
I20260709 12:28:48.141757 26706 raft_consensus.cc:740] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.143930 26706 consensus_queue.cc:260] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.147269 26709 raft_consensus.cc:359] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.148066 26709 raft_consensus.cc:385] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.148327 26709 raft_consensus.cc:740] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.149052 26709 consensus_queue.cc:260] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.151845 26709 ts_tablet_manager.cc:1434] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:28:48.152884 26709 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:48.169924 26706 ts_tablet_manager.cc:1434] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:28:48.171028 26706 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:48.175786 26708 tablet_bootstrap.cc:492] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:48.176491 26708 ts_tablet_manager.cc:1403] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.006s
I20260709 12:28:48.179646 26708 raft_consensus.cc:359] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.181557 26708 raft_consensus.cc:385] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.181957 26708 raft_consensus.cc:740] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.182894 26708 consensus_queue.cc:260] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.186103 26708 ts_tablet_manager.cc:1434] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:28:48.181452 26706 tablet_bootstrap.cc:654] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.187309 26708 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:48.189565 26709 tablet_bootstrap.cc:654] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.191453 26661 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:48.192914 26476 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:48.194175 26983 raft_consensus.cc:2804] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.194943 26983 raft_consensus.cc:697] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:48.195876 26983 consensus_queue.cc:237] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.203970 26335 catalog_manager.cc:5697] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:48.214522 26709 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:48.215245 26709 ts_tablet_manager.cc:1403] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 12:28:48.218725 26709 raft_consensus.cc:359] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.219430 26709 raft_consensus.cc:385] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.219740 26709 raft_consensus.cc:740] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.220394 26709 consensus_queue.cc:260] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.221622 26708 tablet_bootstrap.cc:654] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.223088 26709 ts_tablet_manager.cc:1434] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:48.224157 26709 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:48.231168 26709 tablet_bootstrap.cc:654] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.250463 26706 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:48.250722 26707 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:48.251082 26706 ts_tablet_manager.cc:1403] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.080s	user 0.005s	sys 0.010s
I20260709 12:28:48.251258 26707 ts_tablet_manager.cc:1403] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.143s	user 0.029s	sys 0.031s
I20260709 12:28:48.254221 26707 raft_consensus.cc:359] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.254566 26706 raft_consensus.cc:359] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.256732 26707 raft_consensus.cc:385] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.257004 26706 raft_consensus.cc:385] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.257057 26707 raft_consensus.cc:740] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.257424 26706 raft_consensus.cc:740] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.258175 26707 consensus_queue.cc:260] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.258457 26706 consensus_queue.cc:260] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.260653 26707 ts_tablet_manager.cc:1434] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:28:48.255532 26332 catalog_manager.cc:5697] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:48.262341 26707 tablet_bootstrap.cc:492] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:48.266029 26708 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:48.266357 26983 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.266920 26708 ts_tablet_manager.cc:1403] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.013s
I20260709 12:28:48.267731 26706 ts_tablet_manager.cc:1434] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:28:48.266940 26983 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.269068 26707 tablet_bootstrap.cc:654] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.269853 26708 raft_consensus.cc:359] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.270619 26708 raft_consensus.cc:385] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.270884 26708 raft_consensus.cc:740] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.271471 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.271636 26708 consensus_queue.cc:260] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.274245 26708 ts_tablet_manager.cc:1434] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:48.275920 26708 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:48.277911 26723 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:48.278097 26476 leader_election.cc:343] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.278524 26723 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.282027 26723 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:48.282982 26708 tablet_bootstrap.cc:654] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.283000 26707 tablet_bootstrap.cc:492] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:48.283659 26707 ts_tablet_manager.cc:1403] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:28:48.287117 26707 raft_consensus.cc:359] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.287997 26707 raft_consensus.cc:385] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.288249 26707 raft_consensus.cc:740] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.288735 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.289032 26707 consensus_queue.cc:260] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.289517 26661 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:48.290817 26401 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:48.291954 26707 ts_tablet_manager.cc:1434] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:48.293147 26707 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:48.291899 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:48.296774 26706 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:48.293905 26984 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:48.298635 26402 leader_election.cc:343] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.298308 26984 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.299969 26983 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:48.296159 26723 raft_consensus.cc:2804] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.300827 26984 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:48.300966 26723 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.301506 26723 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.302999 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:28:48.306735 26477 leader_election.cc:343] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.307943 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:48.308321 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:48.308754 26438 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:48.309779 26707 tablet_bootstrap.cc:654] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:48.310293 26477 leader_election.cc:343] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.310775 26477 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:48.312415 26477 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:48.313696 26983 raft_consensus.cc:2749] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:48.311880 26984 consensus_queue.cc:1048] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:48.314769 26751 raft_consensus.cc:2804] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.318753 26751 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.319160 26751 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.316792 26709 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:48.321828 26709 ts_tablet_manager.cc:1403] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.003s
I20260709 12:28:48.323465 26707 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:48.324110 26707 ts_tablet_manager.cc:1403] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.003s
I20260709 12:28:48.317719 26708 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:48.325996 26708 ts_tablet_manager.cc:1403] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.010s
I20260709 12:28:48.329005 26708 raft_consensus.cc:359] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.329677 26708 raft_consensus.cc:385] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.329923 26708 raft_consensus.cc:740] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.330565 26708 consensus_queue.cc:260] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.331981 26706 tablet_bootstrap.cc:654] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.332779 26708 ts_tablet_manager.cc:1434] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:28:48.333854 26708 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:48.335939 26723 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.338207 26751 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.339359 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:28:48.340862 26402 leader_election.cc:343] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.341333 26707 raft_consensus.cc:359] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.342073 26707 raft_consensus.cc:385] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.342131 26723 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:48.342437 26707 raft_consensus.cc:740] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.343273 26707 consensus_queue.cc:260] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.345531 26707 ts_tablet_manager.cc:1434] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:28:48.346148 26706 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:48.346751 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:48.347105 26707 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:48.347537 26661 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.348094 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:48.348775 26660 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.351364 26709 raft_consensus.cc:359] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.352011 26706 ts_tablet_manager.cc:1403] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.004s
I20260709 12:28:48.354987 26762 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.355348 26984 consensus_queue.cc:1048] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:48.355717 26762 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.356132 26660 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:48.359563 26762 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:48.360455 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:48.354911 26709 raft_consensus.cc:385] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.362222 26709 raft_consensus.cc:740] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.362360 26476 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:48.363688 26984 raft_consensus.cc:2804] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.364782 26984 raft_consensus.cc:697] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:48.364830 26706 raft_consensus.cc:359] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.365761 26708 tablet_bootstrap.cc:654] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.363252 26709 consensus_queue.cc:260] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.365885 26706 raft_consensus.cc:385] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.365999 26984 consensus_queue.cc:237] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.366724 26706 raft_consensus.cc:740] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.367592 26706 consensus_queue.cc:260] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.370330 26709 ts_tablet_manager.cc:1434] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.004s
I20260709 12:28:48.371945 26709 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:48.374864 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.375811 26660 raft_consensus.cc:2393] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:48.376938 26550 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:48.379788 26876 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.381634 26709 tablet_bootstrap.cc:654] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.381635 26707 tablet_bootstrap.cc:654] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.394122 26709 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:48.394757 26709 ts_tablet_manager.cc:1403] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 12:28:48.396625 26876 raft_consensus.cc:2749] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:48.400820 26708 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:48.401662 26708 ts_tablet_manager.cc:1403] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.002s
I20260709 12:28:48.404431 26876 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.405625 26983 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.406258 26983 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.405381 26876 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.405772 26708 raft_consensus.cc:359] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.410063 26983 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:48.411022 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.411119 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.411577 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:48.412438 26438 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:48.411804 26660 raft_consensus.cc:2468] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:48.398526 26706 ts_tablet_manager.cc:1434] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:28:48.413282 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:48.410038 26708 raft_consensus.cc:385] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.414974 26708 raft_consensus.cc:740] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.414438 26706 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:48.415795 26708 consensus_queue.cc:260] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.414450 26707 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:48.417258 26707 ts_tablet_manager.cc:1403] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.002s
I20260709 12:28:48.419871 26657 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 0.
I20260709 12:28:48.420068 26661 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:48.420379 26876 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:48.421232 26723 consensus_queue.cc:1048] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:48.424284 26706 tablet_bootstrap.cc:654] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.424484 26965 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.425261 26965 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.425760 26708 ts_tablet_manager.cc:1434] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.002s
I20260709 12:28:48.427182 26708 tablet_bootstrap.cc:492] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:48.427726 26551 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:48.428938 26876 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.429474 26876 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.429899 26876 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.430397 26965 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:48.431713 26476 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:48.397619 26709 raft_consensus.cc:359] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.434057 26708 tablet_bootstrap.cc:654] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.453398 26723 consensus_queue.cc:1048] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:28:48.433647 26331 catalog_manager.cc:5697] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:48.434314 26983 raft_consensus.cc:2804] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.451234 26401 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:48.436126 26751 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:48.464583 26706 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:48.471163 26706 ts_tablet_manager.cc:1403] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.001s
I20260709 12:28:48.474526 26929 consensus_queue.cc:1048] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:48.442982 26876 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.478401 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:48.479025 26723 raft_consensus.cc:2804] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.479187 26660 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.464139 26709 raft_consensus.cc:385] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.480105 26709 raft_consensus.cc:740] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.480911 26709 consensus_queue.cc:260] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:28:48.435511 26477 leader_election.cc:343] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.465193 26983 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:48.482823 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 47350.7us
I20260709 12:28:48.483096 26983 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.451859 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.474687 26706 raft_consensus.cc:359] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.492588 26706 raft_consensus.cc:385] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.493033 26706 raft_consensus.cc:740] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.493882 26706 consensus_queue.cc:260] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.494792 26584 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.496407 26706 ts_tablet_manager.cc:1434] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 12:28:48.500020 26876 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:48.501619 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:48.502504 26438 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.503305 26706 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:48.420495 26707 raft_consensus.cc:359] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.510213 26707 raft_consensus.cc:385] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.510653 26707 raft_consensus.cc:740] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.516625 26780 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.516831 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:48.517732 26511 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:48.511679 26707 consensus_queue.cc:260] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.520313 26657 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:48.527007 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:48.527716 26437 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.528625 26401 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:48.529505 26965 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.529924 26965 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.530258 26965 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.531252 26707 ts_tablet_manager.cc:1434] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.114s	user 0.012s	sys 0.009s
I20260709 12:28:48.532599 26707 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:48.517491 26780 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.545445 26780 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:48.548017 26709 ts_tablet_manager.cc:1434] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.153s	user 0.006s	sys 0.002s
I20260709 12:28:48.552803 26707 tablet_bootstrap.cc:654] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.555050 26660 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:48.557195 26438 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:48.557895 26550 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:48.558933 26762 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.559836 26762 raft_consensus.cc:697] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:48.535040 26723 raft_consensus.cc:697] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:48.562212 26723 consensus_queue.cc:237] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.570297 26709 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:48.572161 26832 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.561141 26762 consensus_queue.cc:237] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.581097 26780 consensus_queue.cc:1048] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:28:48.591701 26832 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.624773 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:48.625602 26436 raft_consensus.cc:2468] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:48.626639 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:48.634343 26706 tablet_bootstrap.cc:654] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.641938 26477 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:48.645083 26983 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.610989 26965 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.642913 26929 consensus_queue.cc:1048] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:28:48.654750 26965 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:28:48.659066 26477 leader_election.cc:343] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.628089 26437 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:48.666951 26965 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.670571 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:48.671681 26513 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.667850 26965 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:48.675412 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:48.680353 26984 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.680977 26984 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.681448 26438 raft_consensus.cc:2393] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:48.684198 26335 catalog_manager.cc:5697] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:48.688696 26862 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:48.689483 26862 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.691752 26983 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:48.692058 26862 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:48.698020 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:48.699009 26511 raft_consensus.cc:2468] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:48.700973 26832 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:48.702560 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:48.703220 26551 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:48.704778 26876 raft_consensus.cc:2804] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:48.705277 26876 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:48.705868 26984 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:48.712270 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:48.705747 26876 raft_consensus.cc:3060] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:48.674305 27019 raft_consensus.cc:2804] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.720976 26709 tablet_bootstrap.cc:654] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.725916 26708 tablet_bootstrap.cc:492] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:48.726649 26708 ts_tablet_manager.cc:1403] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.300s	user 0.050s	sys 0.043s
I20260709 12:28:48.724465 27019 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.718067 26983 consensus_queue.cc:1048] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:28:48.738531 26832 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.756716 27020 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.775307 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:48.772316 26708 raft_consensus.cc:359] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.779656 26708 raft_consensus.cc:385] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.780035 26708 raft_consensus.cc:740] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.780895 26708 consensus_queue.cc:260] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.752491 27019 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.772732 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:48.801036 26661 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.765255 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.802676 26659 raft_consensus.cc:2393] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:48.765239 26513 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:48.773775 26965 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:48.821879 26707 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:48.822470 26707 ts_tablet_manager.cc:1403] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.290s	user 0.024s	sys 0.023s
I20260709 12:28:48.823251 26708 ts_tablet_manager.cc:1434] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.003s
I20260709 12:28:48.824117 26708 tablet_bootstrap.cc:492] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:48.811000 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:48.791356 27018 consensus_queue.cc:1048] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:28:48.839744 26402 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:48.842336 26706 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:48.842911 26706 ts_tablet_manager.cc:1403] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.346s	user 0.018s	sys 0.014s
I20260709 12:28:48.772217 27020 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.838974 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:48.850348 26661 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
W20260709 12:28:48.870395 26477 leader_election.cc:343] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.873155 26707 raft_consensus.cc:359] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.873946 26707 raft_consensus.cc:385] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.874254 26707 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.845391 26510 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:48.875492 26707 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.851959 26929 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.854718 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:48.856703 26660 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:48.866575 27020 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:48.909893 26708 tablet_bootstrap.cc:654] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.914327 26706 raft_consensus.cc:359] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.917302 26706 raft_consensus.cc:385] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.917616 26706 raft_consensus.cc:740] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.896381 26929 raft_consensus.cc:697] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:48.926826 26706 consensus_queue.cc:260] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.893252 26583 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:48.929179 26941 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.906379 26876 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.938391 26941 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:48.936383 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:48.950744 26941 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:48.951232 26436 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:48.952394 26929 consensus_queue.cc:237] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:48.959861 26983 consensus_queue.cc:1048] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:48.962698 26476 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:48.963048 27020 consensus_queue.cc:1048] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:48.938352 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:48.965824 26659 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.968338 26706 ts_tablet_manager.cc:1434] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.000s
I20260709 12:28:48.969343 26706 tablet_bootstrap.cc:492] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:48.971342 26707 ts_tablet_manager.cc:1434] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.149s	user 0.017s	sys 0.011s
I20260709 12:28:48.978180 26335 catalog_manager.cc:5697] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 1 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:48.976802 27020 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:48.987809 27020 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.988188 27020 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:48.989804 26862 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.990587 26862 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:48.991896 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:48.992858 26584 raft_consensus.cc:2410] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:28:48.993659 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:48.994689 26512 raft_consensus.cc:2410] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:28:48.996719 26709 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:48.997553 26709 ts_tablet_manager.cc:1403] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.428s	user 0.023s	sys 0.046s
I20260709 12:28:48.998684 26402 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:49.004343 26707 tablet_bootstrap.cc:492] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:49.008807 26925 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.014379 26925 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.014803 26925 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.019213 26706 tablet_bootstrap.cc:654] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.044632 26984 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.046587 26984 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.050863 26984 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:49.053087 26862 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:49.059129 26706 tablet_bootstrap.cc:492] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:49.059892 26706 ts_tablet_manager.cc:1403] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.005s
I20260709 12:28:49.071622 26708 tablet_bootstrap.cc:492] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:49.072208 26708 ts_tablet_manager.cc:1403] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.248s	user 0.021s	sys 0.002s
I20260709 12:28:49.072597 26707 tablet_bootstrap.cc:654] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.074512 26925 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:49.075109 26708 raft_consensus.cc:359] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.075932 26708 raft_consensus.cc:385] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.076251 26708 raft_consensus.cc:740] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.062521 26832 raft_consensus.cc:2749] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.075249 26876 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:49.074854 27020 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:28:49.124168 26377 log.cc:927] Time spent T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:28:49.139559 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:49.080664 26925 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:49.079483 27019 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:28:49.120288 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 112898us
I20260709 12:28:49.163131 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:49.170578 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:49.173231 27019 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:49.175962 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:49.177130 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:49.178256 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:49.180397 26709 raft_consensus.cc:359] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:49.181464 26709 raft_consensus.cc:385] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.182358 26709 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.080638 27020 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:49.183436 26709 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:49.207123 27018 consensus_queue.cc:1048] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:49.207175 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:28:49.239809 26477 leader_election.cc:343] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.242518 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:49.243610 26513 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.248245 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:49.249436 26654 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.264151 26707 tablet_bootstrap.cc:492] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:49.265184 26707 ts_tablet_manager.cc:1403] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.261s	user 0.016s	sys 0.002s
I20260709 12:28:49.271929 26707 raft_consensus.cc:359] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.277410 26707 raft_consensus.cc:385] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.277829 26707 raft_consensus.cc:740] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.278720 26707 consensus_queue.cc:260] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.281423 26707 ts_tablet_manager.cc:1434] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:28:49.283282 26707 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:49.288494 26513 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:49.291476 26706 raft_consensus.cc:359] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.294692 26707 tablet_bootstrap.cc:654] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.300328 26706 raft_consensus.cc:385] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.300657 26706 raft_consensus.cc:740] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.322801 26581 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:49.324443 26476 leader_election.cc:343] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:49.332428 27042 log.cc:927] Time spent T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260709 12:28:49.336773 26476 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:49.078286 26708 consensus_queue.cc:260] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.341043 26706 consensus_queue.cc:260] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.348517 27020 raft_consensus.cc:2749] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.351183 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:49.352164 26584 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.354632 26625 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:49.356120 27032 raft_consensus.cc:2749] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:49.360121 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:49.361066 26437 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:49.365764 26477 leader_election.cc:343] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.368820 26706 ts_tablet_manager.cc:1434] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.309s	user 0.009s	sys 0.001s
I20260709 12:28:49.369835 26708 ts_tablet_manager.cc:1434] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.297s	user 0.004s	sys 0.004s
I20260709 12:28:49.371234 26709 ts_tablet_manager.cc:1434] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.373s	user 0.001s	sys 0.012s
I20260709 12:28:49.372673 26709 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:49.374507 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:49.375396 26435 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.377828 26584 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
W20260709 12:28:49.310295 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 85644.9us
I20260709 12:28:49.381163 26708 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
W20260709 12:28:49.341699 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 122678us
W20260709 12:28:49.384506 26476 leader_election.cc:343] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.385070 26476 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:49.386087 26751 raft_consensus.cc:2749] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.387495 26780 consensus_queue.cc:1048] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.397161 27028 consensus_queue.cc:1048] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.370507 26706 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:49.404934 26402 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:49.406170 27037 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.406741 27037 raft_consensus.cc:697] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:49.407097 26709 tablet_bootstrap.cc:654] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.407830 27037 consensus_queue.cc:237] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:49.409036 26654 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
W20260709 12:28:49.397471 26477 leader_election.cc:343] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:49.412389 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 194523us
I20260709 12:28:49.414309 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:49.415324 26660 raft_consensus.cc:2393] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:49.416682 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:49.421780 26659 raft_consensus.cc:2468] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:49.445808 26929 consensus_queue.cc:1048] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:28:49.470309 26708 tablet_bootstrap.cc:654] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.493443 27039 consensus_queue.cc:1048] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:28:49.496137 26476 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
W20260709 12:28:49.497107 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 67497.4us
I20260709 12:28:49.498835 27019 consensus_queue.cc:1048] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.499351 27020 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:49.499972 27020 raft_consensus.cc:697] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:49.492187 26512 raft_consensus.cc:2468] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
W20260709 12:28:49.509471 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 83237us
I20260709 12:28:49.500759 26335 catalog_manager.cc:5697] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.491228 26435 raft_consensus.cc:2468] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:49.532112 26551 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:49.542286 26780 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.543051 26780 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.545451 26780 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:28:49.552935 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:49.526901 27032 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.561117 27032 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:49.563812 27032 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:49.566427 26762 raft_consensus.cc:2804] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:49.567109 26762 raft_consensus.cc:697] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:49.568156 26762 consensus_queue.cc:237] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.570326 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:49.501081 27020 consensus_queue.cc:237] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:28:49.579026 26477 leader_election.cc:343] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.587049 27029 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.597350 26707 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:49.597934 26707 ts_tablet_manager.cc:1403] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.315s	user 0.028s	sys 0.016s
I20260709 12:28:49.589306 26477 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:49.608992 26983 raft_consensus.cc:2804] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.609653 26983 raft_consensus.cc:697] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:49.612083 26709 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:49.612587 26709 ts_tablet_manager.cc:1403] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.240s	user 0.019s	sys 0.008s
I20260709 12:28:49.616775 26550 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:49.618033 27043 raft_consensus.cc:2749] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.618527 27028 consensus_queue.cc:1048] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:49.600149 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 68187.3us
I20260709 12:28:49.602186 27029 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:49.623318 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:49.624519 26983 consensus_queue.cc:237] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:49.627002 26706 tablet_bootstrap.cc:654] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.626137 26707 raft_consensus.cc:359] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:49.641006 26437 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:28:49.649892 26707 raft_consensus.cc:385] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.650301 26707 raft_consensus.cc:740] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
W20260709 12:28:49.618064 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 92380.4us
I20260709 12:28:49.677953 26709 raft_consensus.cc:359] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:49.678890 26709 raft_consensus.cc:385] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.679194 26709 raft_consensus.cc:740] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.680362 26709 consensus_queue.cc:260] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:49.690131 27029 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:49.675275 26707 consensus_queue.cc:260] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:49.690400 26709 ts_tablet_manager.cc:1434] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.001s
I20260709 12:28:49.662227 26652 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:49.706393 26709 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:49.715405 26707 ts_tablet_manager.cc:1434] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.117s	user 0.011s	sys 0.000s
I20260709 12:28:49.715113 27039 consensus_queue.cc:1048] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:49.706936 27029 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.725145 27029 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:49.727727 27029 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:49.728710 27039 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.729357 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:49.729338 27039 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.730193 26513 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:49.731655 26476 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:49.732002 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:49.734678 27020 raft_consensus.cc:2804] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.735327 27020 raft_consensus.cc:697] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:49.739916 26402 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:49.736599 27039 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:49.750311 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:49.760635 26656 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:49.762457 26708 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:49.763202 26708 ts_tablet_manager.cc:1403] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.382s	user 0.009s	sys 0.029s
I20260709 12:28:49.736349 27020 consensus_queue.cc:237] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:49.743232 27029 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.766449 27029 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.766980 27029 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.768146 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:49.768945 26656 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:49.751258 27037 consensus_queue.cc:1048] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:28:49.751587 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:49.772109 26437 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:49.801447 26706 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:49.802117 26706 ts_tablet_manager.cc:1403] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.432s	user 0.018s	sys 0.015s
I20260709 12:28:49.810491 26476 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:49.802230 26708 raft_consensus.cc:359] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:49.812395 26708 raft_consensus.cc:385] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.813443 26709 tablet_bootstrap.cc:654] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.812784 26708 raft_consensus.cc:740] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
W20260709 12:28:49.815832 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 71129.8us
W20260709 12:28:49.817350 26625 leader_election.cc:343] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.819222 27053 raft_consensus.cc:2804] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.831363 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:49.815284 26708 consensus_queue.cc:260] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:49.827811 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:49.830847 27053 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.848482 26707 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:49.822265 27029 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:49.849572 27053 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.865566 26708 ts_tablet_manager.cc:1434] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.102s	user 0.010s	sys 0.003s
I20260709 12:28:49.871023 26625 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:49.872648 27032 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.873107 27032 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.873435 27032 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.893541 26401 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:28:49.896117 26402 leader_election.cc:343] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.895906 26706 raft_consensus.cc:359] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:49.898036 26706 raft_consensus.cc:385] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.898339 26706 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.900275 26925 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.901407 26925 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.901762 26925 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.912766 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:49.913956 26653 raft_consensus.cc:2393] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:49.915920 26706 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:49.922282 26708 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:49.950888 26706 ts_tablet_manager.cc:1434] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.143s	user 0.010s	sys 0.007s
I20260709 12:28:49.963416 26762 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.964123 26762 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:49.953881 27029 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:49.968775 26762 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:49.969882 26706 tablet_bootstrap.cc:492] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:49.956734 26550 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:49.969707 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:49.971181 26762 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.980532 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:49.981381 26652 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.986863 26707 tablet_bootstrap.cc:654] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.953460 27032 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:49.991639 27032 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:50.052881 27053 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:50.049449 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:50.055140 26656 raft_consensus.cc:2393] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:50.070202 26708 tablet_bootstrap.cc:654] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:50.069974 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 68566.8us
I20260709 12:28:50.085610 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:50.058435 27036 consensus_queue.cc:1048] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:28:50.089681 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:50.091372 26587 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.095063 26513 raft_consensus.cc:1275] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.086392 26925 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:50.100016 26435 raft_consensus.cc:2393] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:28:50.102191 26925 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:50.102967 26709 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:50.103524 26709 ts_tablet_manager.cc:1403] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.404s	user 0.018s	sys 0.030s
I20260709 12:28:50.106669 26709 raft_consensus.cc:359] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:50.107376 26709 raft_consensus.cc:385] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.107650 26709 raft_consensus.cc:740] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.108297 26709 consensus_queue.cc:260] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:50.109930 27053 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:50.113366 26709 ts_tablet_manager.cc:1434] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:28:50.114718 26709 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:50.114511 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:50.115867 26656 raft_consensus.cc:2393] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 1: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:50.114887 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:50.118229 26661 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.131994 26660 raft_consensus.cc:1275] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.134768 26660 raft_consensus.cc:1275] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:28:50.136101 26706 tablet_bootstrap.cc:654] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.139161 26661 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:50.151430 26709 tablet_bootstrap.cc:654] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.162019 26762 raft_consensus.cc:2749] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:50.165565 26762 consensus_queue.cc:1048] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:50.168361 26587 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:50.153518 26652 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
W20260709 12:28:50.223698 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 158882us
I20260709 12:28:50.216879 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:50.190114 26476 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:50.227289 26438 raft_consensus.cc:1275] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:28:50.219797 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 121272us
I20260709 12:28:50.232395 26751 raft_consensus.cc:2804] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:50.237339 26751 raft_consensus.cc:697] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
W20260709 12:28:50.226730 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 91131us
I20260709 12:28:50.240617 26980 consensus_queue.cc:1048] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:50.230070 26512 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.230631 26925 consensus_queue.cc:1048] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:28:50.246266 26709 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:50.246855 26709 ts_tablet_manager.cc:1403] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.018s
W20260709 12:28:50.232153 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 74088.2us
I20260709 12:28:50.242834 26707 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:50.251498 26707 ts_tablet_manager.cc:1403] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.424s	user 0.012s	sys 0.011s
I20260709 12:28:50.253746 26709 raft_consensus.cc:359] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.254554 26709 raft_consensus.cc:385] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.255165 26709 raft_consensus.cc:740] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.243510 26551 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:50.254257 26707 raft_consensus.cc:359] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:50.259518 27018 consensus_queue.cc:1048] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:50.234040 27053 consensus_queue.cc:1048] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:28:50.260869 27081 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.261106 26751 consensus_queue.cc:237] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:50.264047 26707 raft_consensus.cc:385] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.271185 26707 raft_consensus.cc:740] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.269371 27088 raft_consensus.cc:2749] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:50.271811 27043 consensus_queue.cc:1048] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:28:50.282377 26707 consensus_queue.cc:260] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:50.280622 27081 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:50.289907 27081 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:50.292393 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:50.293371 26653 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:50.294313 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:50.296901 26708 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:50.297490 26708 ts_tablet_manager.cc:1403] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.383s	user 0.022s	sys 0.019s
W20260709 12:28:50.300619 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 51949.2us
I20260709 12:28:50.371666 26708 raft_consensus.cc:359] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.373975 26708 raft_consensus.cc:385] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.374230 26708 raft_consensus.cc:740] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.375131 26708 consensus_queue.cc:260] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:28:50.380743 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 75979.7us
I20260709 12:28:50.381999 26707 ts_tablet_manager.cc:1434] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.000s
I20260709 12:28:50.386009 26706 tablet_bootstrap.cc:492] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:50.386560 26706 ts_tablet_manager.cc:1403] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.420s	user 0.014s	sys 0.010s
I20260709 12:28:50.383411 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:50.389992 26583 raft_consensus.cc:2393] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 1: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
W20260709 12:28:50.374747 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 70405.5us
W20260709 12:28:50.395859 26477 leader_election.cc:343] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:50.378859 26512 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:50.411486 26706 raft_consensus.cc:359] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:50.412273 26707 tablet_bootstrap.cc:492] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:50.412662 26706 raft_consensus.cc:385] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.413071 26706 raft_consensus.cc:740] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.421636 26707 tablet_bootstrap.cc:654] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.425611 26706 consensus_queue.cc:260] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:50.428140 27094 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.431687 26708 ts_tablet_manager.cc:1434] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.001s
I20260709 12:28:50.438134 26709 consensus_queue.cc:260] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.440979 26709 ts_tablet_manager.cc:1434] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.194s	user 0.023s	sys 0.017s
I20260709 12:28:50.442376 26709 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:50.445660 26625 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:50.461647 26402 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:50.484056 27087 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:50.483829 26332 catalog_manager.cc:5697] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 2, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:50.461017 27032 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:50.432392 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 80691.5us
I20260709 12:28:50.491045 26706 ts_tablet_manager.cc:1434] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260709 12:28:50.496090 26332 catalog_manager.cc:5697] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.431252 27094 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.509584 27094 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:50.497028 27032 raft_consensus.cc:697] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:50.511656 26706 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:50.492964 27053 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.512929 27053 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.515530 27053 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:50.517266 27087 raft_consensus.cc:697] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:50.518525 27087 consensus_queue.cc:237] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:50.537010 26332 catalog_manager.cc:5697] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.539206 26707 tablet_bootstrap.cc:492] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:50.539815 26707 ts_tablet_manager.cc:1403] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.009s
W20260709 12:28:50.542292 26477 consensus_peers.cc:597] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:50.544080 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:50.546820 27053 consensus_queue.cc:1048] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:50.546300 26707 raft_consensus.cc:359] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:50.552055 26707 raft_consensus.cc:385] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.552456 26707 raft_consensus.cc:740] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.555377 26708 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:50.558749 26707 consensus_queue.cc:260] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:50.563614 26402 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:50.568140 26709 tablet_bootstrap.cc:654] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.575662 26707 ts_tablet_manager.cc:1434] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:28:50.569533 26929 raft_consensus.cc:2749] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:28:50.576526 26402 leader_election.cc:343] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:50.557426 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 51768.1us
I20260709 12:28:50.511817 27032 consensus_queue.cc:237] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:50.604852 26708 tablet_bootstrap.cc:654] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.639031 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:50.643293 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:50.667752 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:50.667553 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:50.674317 26401 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:50.675666 26438 raft_consensus.cc:2468] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
W20260709 12:28:50.697733 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 239549us
I20260709 12:28:50.696055 27028 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:50.715925 26477 leader_election.cc:343] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:50.716704 26477 leader_election.cc:343] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:50.712828 27028 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.727629 27028 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.752136 26762 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.752722 26762 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:50.754866 26818 consensus_queue.cc:1048] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:28:50.757018 26706 tablet_bootstrap.cc:654] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.770076 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:28:50.772615 26477 leader_election.cc:343] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:50.773207 26477 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:50.776875 26709 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:50.777891 26709 ts_tablet_manager.cc:1403] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.336s	user 0.010s	sys 0.017s
I20260709 12:28:50.791328 26762 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:50.797202 26707 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:50.782989 27106 raft_consensus.cc:2749] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:50.802739 27116 log.cc:927] Time spent T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:50.809327 26477 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:50.818616 27109 raft_consensus.cc:2804] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:50.818805 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 115293us
I20260709 12:28:50.819202 27109 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.833150 27109 raft_consensus.cc:3060] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.854918 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:50.856101 26658 raft_consensus.cc:2393] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
W20260709 12:28:50.857774 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 146124us
I20260709 12:28:50.884761 26708 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:50.885390 26708 ts_tablet_manager.cc:1403] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.393s	user 0.010s	sys 0.016s
I20260709 12:28:50.899847 26706 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:50.900466 26706 ts_tablet_manager.cc:1403] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.389s	user 0.019s	sys 0.003s
I20260709 12:28:50.901907 26709 raft_consensus.cc:359] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.902710 26709 raft_consensus.cc:385] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.903012 26709 raft_consensus.cc:740] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.906587 26550 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
W20260709 12:28:50.921805 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:50.922950 26587 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.921743 27028 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:50.931527 27028 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:50.933991 26706 raft_consensus.cc:359] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.936705 26706 raft_consensus.cc:385] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.937041 26706 raft_consensus.cc:740] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.941525 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:50.913870 26709 consensus_queue.cc:260] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.934468 26708 raft_consensus.cc:359] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:50.952601 26708 raft_consensus.cc:385] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.952940 26708 raft_consensus.cc:740] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.955188 26708 consensus_queue.cc:260] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:50.957531 26708 ts_tablet_manager.cc:1434] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 12:28:50.958067 26709 ts_tablet_manager.cc:1434] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.180s	user 0.005s	sys 0.003s
I20260709 12:28:50.959400 26706 consensus_queue.cc:260] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:50.967182 26762 raft_consensus.cc:2749] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:50.967963 26708 tablet_bootstrap.cc:492] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:50.969782 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:50.970463 26660 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.972206 26707 tablet_bootstrap.cc:654] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.983418 26709 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:50.985356 26708 tablet_bootstrap.cc:654] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.988109 27125 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.987233 26336 catalog_manager.cc:5697] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:50.990921 26402 leader_election.cc:343] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.000379 26706 ts_tablet_manager.cc:1434] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.001s
I20260709 12:28:50.961405 27099 consensus_queue.cc:1048] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:28:50.970438 27109 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.003680 26983 consensus_queue.cc:1048] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:51.011257 26706 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:51.001371 27125 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.024750 27125 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:51.026914 27037 consensus_queue.cc:1048] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:51.027323 27109 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:51.051875 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:51.052767 26510 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:51.053923 26983 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.054418 26983 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.046402 26331 catalog_manager.cc:5697] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:51.056218 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:51.057721 26709 tablet_bootstrap.cc:654] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.061605 26983 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:51.034402 26660 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:51.065435 26401 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.067175 27028 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:51.067734 27028 raft_consensus.cc:697] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:51.068619 27028 consensus_queue.cc:237] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.069357 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:51.069978 26437 raft_consensus.cc:3060] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.074542 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:51.077396 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:51.084369 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:28:51.084969 26476 leader_election.cc:343] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:51.088152 26625 leader_election.cc:343] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.088908 26625 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.089663 27125 raft_consensus.cc:2804] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:51.090121 27125 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.090517 27125 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.090725 26437 raft_consensus.cc:2468] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:51.091046 26706 tablet_bootstrap.cc:654] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.101083 26707 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:51.101919 26707 ts_tablet_manager.cc:1403] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.315s	user 0.015s	sys 0.002s
I20260709 12:28:51.107005 26707 raft_consensus.cc:359] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.107859 26707 raft_consensus.cc:385] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.108146 26707 raft_consensus.cc:740] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.113474 26707 consensus_queue.cc:260] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.117879 27121 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:51.120543 26477 leader_election.cc:343] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:51.123941 26477 leader_election.cc:343] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.126130 26477 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:51.130069 26706 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:51.151196 26706 ts_tablet_manager.cc:1403] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.143s	user 0.007s	sys 0.023s
I20260709 12:28:51.151819 26477 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.152508 27109 raft_consensus.cc:2804] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:51.152980 27109 raft_consensus.cc:697] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:51.153800 27109 consensus_queue.cc:237] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.154294 26706 raft_consensus.cc:359] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.155164 26706 raft_consensus.cc:385] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.155436 26706 raft_consensus.cc:740] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.156601 27125 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.130172 26707 ts_tablet_manager.cc:1434] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.003s
I20260709 12:28:51.161439 26706 consensus_queue.cc:260] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.164992 26706 ts_tablet_manager.cc:1434] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:28:51.166214 26706 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:51.145570 26708 tablet_bootstrap.cc:492] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:51.148064 27121 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:51.167490 26708 ts_tablet_manager.cc:1403] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.209s	user 0.023s	sys 0.014s
I20260709 12:28:51.151149 27099 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:51.170595 26708 raft_consensus.cc:359] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.171389 26708 raft_consensus.cc:385] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.171676 26708 raft_consensus.cc:740] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.177433 26708 consensus_queue.cc:260] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.180811 26708 ts_tablet_manager.cc:1434] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:28:51.182068 26708 tablet_bootstrap.cc:492] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:51.187177 26707 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:51.143599 26709 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:51.190258 26709 ts_tablet_manager.cc:1403] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.007s
I20260709 12:28:51.194950 26332 catalog_manager.cc:5697] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:28:51.199775 27125 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:51.204838 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:51.206238 26929 consensus_queue.cc:1048] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:28:51.206382 26625 leader_election.cc:343] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.208745 27028 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.209266 27028 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.209692 26708 tablet_bootstrap.cc:654] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.211686 27028 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:51.212782 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:51.214758 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:51.215481 26510 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:51.216596 26402 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:51.217109 26709 raft_consensus.cc:359] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.217744 26983 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.218313 26983 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.217845 26709 raft_consensus.cc:385] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.221169 26709 raft_consensus.cc:740] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.221774 26709 consensus_queue.cc:260] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.213137 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
W20260709 12:28:51.223402 26402 leader_election.cc:343] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.223747 26983 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:51.220647 26332 catalog_manager.cc:5697] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
I20260709 12:28:51.224540 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:51.225031 26706 tablet_bootstrap.cc:654] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.225693 26512 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:51.226244 26476 leader_election.cc:343] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.227468 26332 catalog_manager.cc:5697] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:51.231503 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:51.227820 27028 raft_consensus.cc:2804] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:51.233596 27028 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.233958 27028 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:51.237077 26477 leader_election.cc:343] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.237676 26477 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.240751 27095 raft_consensus.cc:2749] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:51.243273 26709 ts_tablet_manager.cc:1434] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.053s	user 0.002s	sys 0.005s
I20260709 12:28:51.245539 26707 tablet_bootstrap.cc:654] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.264376 26512 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:51.267165 26625 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.268715 27125 raft_consensus.cc:2804] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:51.269266 27125 raft_consensus.cc:697] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:51.272841 26709 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:51.270152 27125 consensus_queue.cc:237] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.279629 26336 catalog_manager.cc:5697] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:51.292991 27117 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.297605 27117 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.297917 26585 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.300397 27117 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:51.308676 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:51.311537 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:51.316045 26708 tablet_bootstrap.cc:492] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:51.316823 26708 ts_tablet_manager.cc:1403] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.135s	user 0.006s	sys 0.029s
I20260709 12:28:51.317849 26929 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.316334 26709 tablet_bootstrap.cc:654] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.319955 26708 raft_consensus.cc:359] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.320660 26708 raft_consensus.cc:385] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.320920 26708 raft_consensus.cc:740] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.318508 26929 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.322975 27028 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.325536 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:51.326380 26708 consensus_queue.cc:260] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.327607 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:28:51.341755 26401 leader_election.cc:343] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:51.342254 26402 leader_election.cc:343] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.342747 26402 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.346614 27126 raft_consensus.cc:2749] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:51.350242 27028 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:51.351016 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:51.351317 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:51.352195 26510 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:51.354755 26625 leader_election.cc:343] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.328130 26929 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:28:51.355698 26625 leader_election.cc:343] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:51.357170 26402 leader_election.cc:343] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.365022 26707 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:51.367717 26707 ts_tablet_manager.cc:1403] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.205s	user 0.018s	sys 0.003s
I20260709 12:28:51.357954 26625 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:51.369091 26709 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:51.369902 26709 ts_tablet_manager.cc:1403] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.118s	user 0.003s	sys 0.013s
I20260709 12:28:51.380751 26707 raft_consensus.cc:359] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.383402 26707 raft_consensus.cc:385] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.383992 26762 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:51.377094 26708 ts_tablet_manager.cc:1434] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.005s
I20260709 12:28:51.384668 26762 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.374960 26510 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:51.388847 26402 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.389858 26762 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:51.390136 27126 raft_consensus.cc:2804] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:51.390817 26709 raft_consensus.cc:359] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.390914 27126 raft_consensus.cc:697] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:51.391551 26709 raft_consensus.cc:385] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.391913 26709 raft_consensus.cc:740] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.383669 26707 raft_consensus.cc:740] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.369210 26336 catalog_manager.cc:5697] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:51.392356 27126 consensus_queue.cc:237] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.397941 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:51.399575 26709 consensus_queue.cc:260] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.401671 26707 consensus_queue.cc:260] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.407191 26709 ts_tablet_manager.cc:1434] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:28:51.411226 26707 ts_tablet_manager.cc:1434] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 12:28:51.414007 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:51.414727 26707 tablet_bootstrap.cc:492] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:51.419068 26551 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:51.419817 26762 raft_consensus.cc:2749] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:51.376715 27125 raft_consensus.cc:2749] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:51.420218 26331 catalog_manager.cc:5697] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:51.424587 26707 tablet_bootstrap.cc:654] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.416931 26706 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:51.417555 26708 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:51.425860 26706 ts_tablet_manager.cc:1403] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.260s	user 0.023s	sys 0.023s
I20260709 12:28:51.431492 26709 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:51.447587 26706 raft_consensus.cc:359] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.467557 26706 raft_consensus.cc:385] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.467984 26706 raft_consensus.cc:740] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.489106 26706 consensus_queue.cc:260] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.496788 26706 ts_tablet_manager.cc:1434] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.001s
I20260709 12:28:51.501559 27121 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.505568 27099 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.512640 27099 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.514797 27099 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:51.518740 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:51.520226 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:51.521983 26706 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
W20260709 12:28:51.522765 26476 leader_election.cc:343] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:51.526149 26477 leader_election.cc:343] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.527925 26477 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.531600 27109 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:51.532392 26707 tablet_bootstrap.cc:492] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:51.521639 27121 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.533035 26707 ts_tablet_manager.cc:1403] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.119s	user 0.040s	sys 0.017s
I20260709 12:28:51.534677 27121 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:51.537698 26707 raft_consensus.cc:359] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.538367 26707 raft_consensus.cc:385] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.538550 26707 raft_consensus.cc:740] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.539382 26707 consensus_queue.cc:260] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.539776 26708 tablet_bootstrap.cc:654] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.541946 26707 ts_tablet_manager.cc:1434] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:28:51.545143 26336 catalog_manager.cc:5697] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:51.551146 26707 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:51.559393 26708 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:51.584820 26708 ts_tablet_manager.cc:1403] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.167s	user 0.012s	sys 0.002s
I20260709 12:28:51.587551 26708 raft_consensus.cc:359] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.588075 26708 raft_consensus.cc:385] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.588287 26708 raft_consensus.cc:740] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.588864 26708 consensus_queue.cc:260] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.579113 27087 consensus_queue.cc:1048] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:28:51.581018 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:51.592916 26581 raft_consensus.cc:2468] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:51.595749 26707 tablet_bootstrap.cc:654] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.602560 26625 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:51.604935 27117 raft_consensus.cc:2804] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:51.605325 27117 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.605662 27117 raft_consensus.cc:3060] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.603899 26709 tablet_bootstrap.cc:654] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.609934 26708 ts_tablet_manager.cc:1434] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:28:51.611539 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:51.614305 26435 raft_consensus.cc:2468] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:51.614279 27117 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.618670 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:51.619366 26582 raft_consensus.cc:3060] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.619859 27117 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:51.631207 26582 raft_consensus.cc:2468] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:51.632639 26708 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:51.633018 26707 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:51.613714 26706 tablet_bootstrap.cc:654] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.634429 26581 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.636633 26707 ts_tablet_manager.cc:1403] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.018s
I20260709 12:28:51.640148 26707 raft_consensus.cc:359] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.640981 26707 raft_consensus.cc:385] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.641240 26707 raft_consensus.cc:740] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.641990 26707 consensus_queue.cc:260] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.645516 26707 ts_tablet_manager.cc:1434] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:28:51.646724 26707 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:51.647186 26625 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:51.651062 27121 raft_consensus.cc:2804] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:51.651579 27121 raft_consensus.cc:697] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:51.652388 27121 consensus_queue.cc:237] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.653826 26707 tablet_bootstrap.cc:654] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.663007 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:51.663846 26435 raft_consensus.cc:3060] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.680184 27089 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.680799 27089 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.685600 27089 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:51.685983 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:51.686627 27087 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.687813 27099 consensus_queue.cc:1048] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:51.687183 27087 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.720445 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:51.721716 26661 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:51.731623 26401 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:51.717265 26435 raft_consensus.cc:2468] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:51.749994 26707 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:51.750630 26707 ts_tablet_manager.cc:1403] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.006s
W20260709 12:28:51.747991 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 75223.7us
I20260709 12:28:51.737130 27120 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:51.783880 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 68209.5us
I20260709 12:28:51.773197 27120 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.788661 27120 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.790849 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:51.786358 27087 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:51.793393 26708 tablet_bootstrap.cc:654] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.795737 26550 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:51.799036 26709 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:51.799665 26709 ts_tablet_manager.cc:1403] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.370s	user 0.030s	sys 0.020s
I20260709 12:28:51.800915 27160 raft_consensus.cc:2749] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:51.805707 26707 raft_consensus.cc:359] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.806569 26707 raft_consensus.cc:385] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.806859 26707 raft_consensus.cc:740] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.807860 27125 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.808393 27125 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.810547 27125 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:51.815702 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:51.817896 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:51.818698 26510 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
W20260709 12:28:51.820088 26477 consensus_peers.cc:597] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:51.795272 27028 consensus_queue.cc:1048] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:28:51.823647 26706 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:51.824183 26706 ts_tablet_manager.cc:1403] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.319s	user 0.020s	sys 0.008s
W20260709 12:28:51.827899 26625 consensus_peers.cc:597] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:51.807601 26707 consensus_queue.cc:260] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.835909 27125 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.836512 27125 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.837216 26706 raft_consensus.cc:359] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.837937 26706 raft_consensus.cc:385] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.838217 26706 raft_consensus.cc:740] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.834049 26709 raft_consensus.cc:359] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.839293 26709 raft_consensus.cc:385] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:51.839668 26709 raft_consensus.cc:740] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:51.840546 26706 consensus_queue.cc:260] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.843932 26709 consensus_queue.cc:260] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.849017 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:51.849799 26436 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:51.855536 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:28:51.869422 26625 leader_election.cc:343] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:51.890341 26625 leader_election.cc:343] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:51.895337 26706 ts_tablet_manager.cc:1434] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 12:28:51.858482 27125 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:51.897385 26707 ts_tablet_manager.cc:1434] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.146s	user 0.005s	sys 0.003s
I20260709 12:28:51.904227 26625 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:51.905303 26709 ts_tablet_manager.cc:1434] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.001s
I20260709 12:28:51.908239 26707 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:51.910542 27125 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:51.911054 27125 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.911417 27125 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.914953 26709 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:51.917034 26707 tablet_bootstrap.cc:654] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:51.900322 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:51.927234 26512 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:51.928723 26706 tablet_bootstrap.cc:492] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:51.928963 27163 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.929462 27163 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:51.936460 26625 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:51.946357 27125 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:51.959522 26941 raft_consensus.cc:2804] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:51.976071 26941 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.992918 26941 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:51.995848 27120 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:51.996906 27121 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.997638 27121 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:51.998171 27120 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:52.000267 27121 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:52.008307 26709 tablet_bootstrap.cc:654] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:52.015399 26706 tablet_bootstrap.cc:654] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:52.033447 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:52.034197 26659 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:52.037207 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:52.037519 27163 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:28:52.039021 26625 leader_election.cc:343] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:52.039817 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:52.040570 26506 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:52.018688 27121 consensus_queue.cc:1048] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:28:52.046216 26331 catalog_manager.cc:5697] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:52.060609 26708 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:52.061344 26708 ts_tablet_manager.cc:1403] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.429s	user 0.020s	sys 0.024s
I20260709 12:28:52.087949 26659 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:52.089672 26401 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:52.090533 27036 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:52.091130 27036 raft_consensus.cc:697] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:52.075407 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:52.091996 26708 raft_consensus.cc:359] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.092743 26708 raft_consensus.cc:385] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:52.093014 26708 raft_consensus.cc:740] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:52.092011 27036 consensus_queue.cc:237] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.095311 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:52.096107 26507 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:52.097196 26506 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:52.071645 27167 consensus_queue.cc:1048] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:28:52.099282 26708 consensus_queue.cc:260] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:28:52.118068 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 75492us
I20260709 12:28:52.124884 26625 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:52.140305 26709 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:52.140959 26709 ts_tablet_manager.cc:1403] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.028s
I20260709 12:28:52.142561 26708 ts_tablet_manager.cc:1434] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:28:52.147686 26709 raft_consensus.cc:359] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.153049 26709 raft_consensus.cc:385] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:52.153471 26709 raft_consensus.cc:740] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:52.148550 26707 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:52.136277 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:52.154359 26707 ts_tablet_manager.cc:1403] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.246s	user 0.024s	sys 0.016s
I20260709 12:28:52.154217 26709 consensus_queue.cc:260] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.161077 27117 consensus_queue.cc:1048] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:52.161365 26941 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.164091 26709 ts_tablet_manager.cc:1434] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:28:52.166953 26709 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:52.168836 27166 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.169435 27166 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.172216 26706 tablet_bootstrap.cc:492] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:52.172971 26706 ts_tablet_manager.cc:1403] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.244s	user 0.008s	sys 0.024s
I20260709 12:28:52.136175 27177 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:52.188015 26708 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Bootstrap starting.
I20260709 12:28:52.175971 27177 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.199365 26707 raft_consensus.cc:359] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.200352 26707 raft_consensus.cc:385] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:52.200639 26707 raft_consensus.cc:740] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:52.202148 27177 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:52.207571 26551 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:52.207350 26707 consensus_queue.cc:260] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.320118 26707 ts_tablet_manager.cc:1434] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.001s
I20260709 12:28:52.295215 27163 raft_consensus.cc:2749] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:52.381524 26707 tablet_bootstrap.cc:492] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:52.392275 26709 tablet_bootstrap.cc:654] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:52.368801 27166 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:52.381048 27037 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.395774 27037 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.398056 27037 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:52.428814 26706 raft_consensus.cc:359] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:52.431808 26706 raft_consensus.cc:385] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:52.432160 26706 raft_consensus.cc:740] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:52.432965 26706 consensus_queue.cc:260] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:52.435129 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:52.436049 26660 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:52.438069 26476 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:52.443205 26708 tablet_bootstrap.cc:654] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:52.459985 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 270526us
I20260709 12:28:52.461165 26584 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:52.464161 26706 ts_tablet_manager.cc:1434] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.291s	user 0.007s	sys 0.002s
I20260709 12:28:52.480046 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:52.492003 26707 tablet_bootstrap.cc:654] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:52.495741 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:52.496623 26652 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 0.
I20260709 12:28:52.518419 26579 raft_consensus.cc:3060] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:52.529654 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 92522.9us
I20260709 12:28:52.500247 27177 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:52.543114 26401 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:52.552728 26706 tablet_bootstrap.cc:492] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:52.534945 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:52.560293 27190 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:52.566316 26436 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:52.590164 26709 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:52.590792 26709 ts_tablet_manager.cc:1403] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.424s	user 0.027s	sys 0.011s
I20260709 12:28:52.577047 27190 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.610163 27177 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:52.604306 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:52.613564 26706 tablet_bootstrap.cc:654] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:52.590399 27120 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:52.616673 27120 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.617117 27120 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:52.631764 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 67676.4us
I20260709 12:28:52.619153 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:52.604843 27190 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:52.638623 26507 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:52.638315 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:52.665917 26708 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: No bootstrap required, opened a new log
I20260709 12:28:52.666711 26708 ts_tablet_manager.cc:1403] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent bootstrapping tablet: real 0.491s	user 0.023s	sys 0.004s
I20260709 12:28:52.653410 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:28:52.748490 27202 log.cc:927] Time spent T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:28:52.753620 26707 tablet_bootstrap.cc:492] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:52.754331 26707 ts_tablet_manager.cc:1403] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.382s	user 0.019s	sys 0.018s
W20260709 12:28:52.758980 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 107294us
I20260709 12:28:52.749998 26708 raft_consensus.cc:359] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:52.776669 26708 raft_consensus.cc:385] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:52.777031 26708 raft_consensus.cc:740] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Initialized, Role: FOLLOWER
I20260709 12:28:52.793570 26708 consensus_queue.cc:260] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:28:52.804229 26625 leader_election.cc:343] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:52.809577 26625 leader_election.cc:343] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:52.814824 26709 raft_consensus.cc:359] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.815685 26709 raft_consensus.cc:385] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:52.750015 26507 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:52.815979 26709 raft_consensus.cc:740] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:52.828212 26709 consensus_queue.cc:260] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:52.831418 26708 ts_tablet_manager.cc:1434] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent starting tablet: real 0.164s	user 0.004s	sys 0.004s
I20260709 12:28:52.796747 27177 consensus_queue.cc:1048] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:28:52.850694 26709 ts_tablet_manager.cc:1434] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.260s	user 0.007s	sys 0.001s
I20260709 12:28:52.857263 26709 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:52.869042 26707 raft_consensus.cc:359] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:52.870273 26707 raft_consensus.cc:385] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:52.884178 26707 raft_consensus.cc:740] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:52.889261 26707 consensus_queue.cc:260] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:52.897384 26707 ts_tablet_manager.cc:1434] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.000s
I20260709 12:28:52.899645 26625 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:52.900421 26706 tablet_bootstrap.cc:492] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:52.900936 26706 ts_tablet_manager.cc:1403] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.364s	user 0.036s	sys 0.025s
I20260709 12:28:52.900856 27177 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:52.883733 27125 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:52.912628 26941 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:52.922195 27177 raft_consensus.cc:697] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:52.955725 27177 consensus_queue.cc:237] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:52.934361 26707 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0: Bootstrap starting.
I20260709 12:28:52.937546 26706 raft_consensus.cc:359] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:52.946938 26433 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:52.958142 26706 raft_consensus.cc:385] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:52.962458 26706 raft_consensus.cc:740] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:52.997336 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:52.998129 26509 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:52.999006 27193 consensus_queue.cc:1048] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:53.002381 26402 consensus_peers.cc:597] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:53.004355 26706 consensus_queue.cc:260] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.006222 26706 ts_tablet_manager.cc:1434] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.001s
I20260709 12:28:52.897982 27120 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:53.008514 27120 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:53.034540 26706 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:53.041253 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:53.049513 26709 tablet_bootstrap.cc:654] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:53.050042 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 48724.3us
I20260709 12:28:53.053225 26707 tablet_bootstrap.cc:654] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:53.054353 27117 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.058054 26509 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:53.064862 27190 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:53.047425 26433 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:53.077155 27117 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.071904 26706 tablet_bootstrap.cc:654] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:53.087766 27029 consensus_queue.cc:1048] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:53.082058 26625 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:53.103174 26941 raft_consensus.cc:2804] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:53.103559 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:53.103849 26941 raft_consensus.cc:697] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:53.087261 27117 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:53.103178 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
W20260709 12:28:53.138799 26625 leader_election.cc:343] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:53.163239 26510 raft_consensus.cc:2393] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:53.168213 27190 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:53.169937 26432 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.180382 27178 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:53.181119 27178 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.187749 26706 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:53.188481 26706 ts_tablet_manager.cc:1403] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.154s	user 0.019s	sys 0.009s
I20260709 12:28:53.188730 26331 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45824 (request call id 67) took 1261 ms. Trace:
I20260709 12:28:53.189173 26331 rpcz_store.cc:276] 0709 12:28:51.926988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.943339 (+ 16351us) service_pool.cc:224] Handling call
0709 12:28:53.188630 (+1245291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:52.073751 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:52.083921 (+ 10170us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:52.083961 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:28:52.083973 (+    12us) tablet.cc:662] Decoding operations
0709 12:28:52.090030 (+  6057us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:52.090115 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:52.090146 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:28:52.090430 (+   284us) tablet.cc:701] Row locks acquired
0709 12:28:52.090442 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:28:52.090690 (+   248us) write_op.cc:270] Start()
0709 12:28:52.090821 (+   131us) write_op.cc:276] Timestamp: P: 1783600132090625 usec, L: 0
0709 12:28:52.090837 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:28:52.091690 (+   853us) log.cc:844] Serialized 540 byte log entry
0709 12:28:52.383276 (+291586us) op_driver.cc:464] REPLICATION: finished
0709 12:28:52.639113 (+255837us) write_op.cc:301] APPLY: starting
0709 12:28:52.644626 (+  5513us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:52.651326 (+  6700us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:52.675034 (+ 23708us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:52.745866 (+ 70832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:52.746034 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:28:52.746086 (+    52us) write_op.cc:312] APPLY: finished
0709 12:28:52.746290 (+   204us) log.cc:844] Serialized 22 byte log entry
0709 12:28:52.746483 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:52.746587 (+   104us) write_op.cc:454] Released schema lock
0709 12:28:52.746650 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:52.747048 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:52.747074 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":244171,"apply.run_cpu_time_us":2095,"apply.run_wall_time_us":113888,"num_ops":1,"prepare.queue_time_us":4463,"prepare.run_cpu_time_us":3410,"prepare.run_wall_time_us":25078,"replication_time_us":272789,"thread_start_us":146026,"threads_started":1}]]}
I20260709 12:28:53.200532 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:53.201349 26506 raft_consensus.cc:2468] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:53.208206 26625 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:53.209581 27177 raft_consensus.cc:2804] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:53.209992 27177 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.210330 27177 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.174968 26941 consensus_queue.cc:237] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:53.213325 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:53.213997 26653 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.221797 27178 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:53.223661 26706 raft_consensus.cc:359] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.224423 26706 raft_consensus.cc:385] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:53.224730 26706 raft_consensus.cc:740] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:53.225374 26706 consensus_queue.cc:260] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:28:53.227418 26384 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:53.227494 26706 ts_tablet_manager.cc:1434] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
W20260709 12:28:53.235862 27210 log.cc:927] Time spent T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.333s	user 0.008s	sys 0.007s
I20260709 12:28:53.243378 26709 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:53.243973 26709 ts_tablet_manager.cc:1403] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.387s	user 0.027s	sys 0.031s
I20260709 12:28:53.236415 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:53.246572 26706 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:53.246822 26709 raft_consensus.cc:359] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.253218 26709 raft_consensus.cc:385] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:28:53.252907 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 120152us
I20260709 12:28:53.253547 26709 raft_consensus.cc:740] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:53.236972 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:53.267940 27089 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.268591 27089 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.271235 27089 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:53.273305 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:53.275187 26709 consensus_queue.cc:260] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.261205 26429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:53.281250 26429 raft_consensus.cc:2393] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 1: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:28:53.263154 27095 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.284385 27095 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.285643 26432 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:53.291886 26625 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:53.296088 26709 ts_tablet_manager.cc:1434] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 12:28:53.294888 27121 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:53.305161 27121 raft_consensus.cc:697] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:53.306133 27121 consensus_queue.cc:237] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.294436 27177 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.320351 27177 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:53.318153 27089 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:53.321002 27089 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.321704 26653 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:28:53.323132 27160 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:53.310875 27095 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:53.323706 27160 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.323125 26429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:53.325181 26429 raft_consensus.cc:2468] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 0.
I20260709 12:28:53.326078 27160 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:53.329878 26709 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:53.331928 26401 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:53.325466 27089 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:53.331147 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:53.340639 26477 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:53.333848 26929 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:53.347193 27186 raft_consensus.cc:2749] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:53.348428 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:53.349108 26505 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.349519 26477 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:53.351650 26707 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0: No bootstrap required, opened a new log
I20260709 12:28:53.352118 26707 ts_tablet_manager.cc:1403] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent bootstrapping tablet: real 0.418s	user 0.022s	sys 0.005s
I20260709 12:28:53.352308 27190 raft_consensus.cc:2804] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:53.352705 27190 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.353042 27190 raft_consensus.cc:3060] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.344483 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:53.355289 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:53.356431 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:53.362078 26707 raft_consensus.cc:359] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.362980 26707 raft_consensus.cc:385] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:53.363265 26707 raft_consensus.cc:740] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Initialized, Role: FOLLOWER
I20260709 12:28:53.364984 26707 consensus_queue.cc:260] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.360562 26929 raft_consensus.cc:697] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:28:53.379236 26929 consensus_queue.cc:237] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:53.387205 26707 ts_tablet_manager.cc:1434] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:28:53.393908 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:53.396534 26551 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:53.397631 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:53.409556 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:53.397779 27163 raft_consensus.cc:2749] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:53.412837 26625 leader_election.cc:343] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:53.413393 26477 leader_election.cc:343] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:53.414120 26584 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:53.417636 26625 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:53.422837 27121 raft_consensus.cc:2804] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:53.423247 27121 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:53.423626 27121 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:53.434474 26580 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.437235 26709 tablet_bootstrap.cc:654] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:53.438928 26551 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:53.437994 27121 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.442382 26706 tablet_bootstrap.cc:654] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:53.446259 26336 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45818 (request call id 65) took 1395 ms. Trace:
I20260709 12:28:53.452267 27163 raft_consensus.cc:2749] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:53.452498 27121 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:53.448287 26336 rpcz_store.cc:276] 0709 12:28:52.050710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.050884 (+   174us) service_pool.cc:224] Handling call
0709 12:28:53.446191 (+1395307us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":11}
I20260709 12:28:53.455929 26429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:53.457772 26505 raft_consensus.cc:2468] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:53.458729 26551 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:53.461519 27163 raft_consensus.cc:2749] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:53.456225 27190 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.463968 27190 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:53.466444 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:53.468766 26625 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:53.468739 27121 consensus_queue.cc:1048] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:28:53.476831 26429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:53.503609 26429 raft_consensus.cc:3060] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.504161 27121 raft_consensus.cc:2804] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:53.471848 27163 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.482481 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:53.505120 27163 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
W20260709 12:28:53.506889 26477 leader_election.cc:343] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:53.508832 27163 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:53.508944 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:53.510087 26509 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:53.510243 26653 raft_consensus.cc:1240] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:53.511433 26551 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:53.512300 27160 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:53.512790 27160 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.513024 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:53.513139 27160 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:53.516239 27190 consensus_queue.cc:1059] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:53.517653 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:53.520162 26335 catalog_manager.cc:5697] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:28:53.520332 27207 raft_consensus.cc:3055] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:53.522276 27207 raft_consensus.cc:740] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:53.522670 27121 raft_consensus.cc:697] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:53.523155 27207 consensus_queue.cc:260] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.524008 27121 consensus_queue.cc:237] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.525090 27207 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:53.541556 26429 raft_consensus.cc:2468] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:53.520326 26625 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:53.545434 26477 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:53.552826 27125 raft_consensus.cc:2749] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:53.556514 27197 consensus_queue.cc:1048] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:53.550388 27190 raft_consensus.cc:2804] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:53.580331 27190 raft_consensus.cc:697] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:53.612193 27160 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.619818 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:53.620806 26941 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.621371 26941 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.622515 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:53.619823 26582 raft_consensus.cc:1240] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:28:53.627655 27190 consensus_queue.cc:237] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.610987 26709 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: No bootstrap required, opened a new log
I20260709 12:28:53.635347 26709 ts_tablet_manager.cc:1403] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.318s	user 0.023s	sys 0.023s
I20260709 12:28:53.618139 27160 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:53.648341 27197 consensus_queue.cc:1059] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:28:53.655742 27197 raft_consensus.cc:3055] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:53.656136 27197 raft_consensus.cc:740] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:53.656967 27197 consensus_queue.cc:260] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.658198 27197 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:53.667567 26550 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:53.645262 26941 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:53.675951 26706 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:53.677611 26706 ts_tablet_manager.cc:1403] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.431s	user 0.025s	sys 0.014s
I20260709 12:28:53.679152 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:28:53.681497 26625 leader_election.cc:343] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:53.675653 27163 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:53.692016 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:53.694005 26706 raft_consensus.cc:359] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.696388 26709 raft_consensus.cc:359] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.701529 26706 raft_consensus.cc:385] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:53.701633 26709 raft_consensus.cc:385] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:53.705969 26709 raft_consensus.cc:740] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:53.701942 26706 raft_consensus.cc:740] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:53.709889 26709 consensus_queue.cc:260] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.711114 26706 consensus_queue.cc:260] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.718261 26709 ts_tablet_manager.cc:1434] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.003s
I20260709 12:28:53.714506 26430 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 0.
I20260709 12:28:53.722525 26706 ts_tablet_manager.cc:1434] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
W20260709 12:28:53.732558 27240 log.cc:927] Time spent T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:28:53.763082 26706 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:53.770186 26706 tablet_bootstrap.cc:654] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:53.770856 26586 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:53.779839 27245 log.cc:927] Time spent T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:28:53.781950 26706 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:53.782569 26706 ts_tablet_manager.cc:1403] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 12:28:53.785526 26625 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:53.787022 27121 raft_consensus.cc:2804] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:53.787446 27121 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.787781 27121 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.787904 26706 raft_consensus.cc:359] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.788697 26706 raft_consensus.cc:385] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:53.788967 26706 raft_consensus.cc:740] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:53.789623 26706 consensus_queue.cc:260] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.792085 26706 ts_tablet_manager.cc:1434] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:28:53.793175 26706 tablet_bootstrap.cc:492] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:53.793722 26336 catalog_manager.cc:5697] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:53.819201 27197 consensus_queue.cc:1048] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:53.801280 27121 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.804376 26706 tablet_bootstrap.cc:654] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:53.819765 26336 catalog_manager.cc:5697] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:53.825285 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:53.825016 26336 catalog_manager.cc:5697] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:53.827229 26625 leader_election.cc:343] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:53.828967 27178 consensus_queue.cc:1048] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:53.832078 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:53.832757 26434 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.834740 27178 consensus_queue.cc:1048] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:53.836755 26336 catalog_manager.cc:5697] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:53.831966 27121 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:53.846195 26434 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:53.851284 26625 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:28:53.852412 27177 raft_consensus.cc:2804] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:53.853020 27177 raft_consensus.cc:697] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:53.855383 26335 catalog_manager.cc:5697] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 1 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:53.854168 27177 consensus_queue.cc:237] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:53.875247 26333 catalog_manager.cc:5697] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:53.884423 26706 tablet_bootstrap.cc:492] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:53.885087 26706 ts_tablet_manager.cc:1403] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.000s
I20260709 12:28:53.887893 26706 raft_consensus.cc:359] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.888621 26706 raft_consensus.cc:385] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:53.888891 26706 raft_consensus.cc:740] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:53.889640 26706 consensus_queue.cc:260] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:53.891278 26586 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.891767 26706 ts_tablet_manager.cc:1434] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:28:53.892764 26706 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e: Bootstrap starting.
I20260709 12:28:53.899367 26706 tablet_bootstrap.cc:654] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:53.926249 27120 consensus_queue.cc:1048] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:53.933081 27197 consensus_queue.cc:1048] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:53.947600 27120 consensus_queue.cc:1048] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:53.951339 27163 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.951962 27163 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:53.956269 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:53.957094 26430 raft_consensus.cc:2393] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:53.959362 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:53.963400 26551 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:53.964254 27160 raft_consensus.cc:3060] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:53.964847 27163 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:53.997466 26332 catalog_manager.cc:5697] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 1 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.017405 27160 raft_consensus.cc:2749] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:54.027318 26586 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:54.054774 26706 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e: No bootstrap required, opened a new log
I20260709 12:28:54.055325 26706 ts_tablet_manager.cc:1403] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent bootstrapping tablet: real 0.163s	user 0.030s	sys 0.036s
I20260709 12:28:54.049785 27121 consensus_queue.cc:1048] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:28:54.066956 26706 raft_consensus.cc:359] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:54.067687 26706 raft_consensus.cc:385] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:54.067958 26706 raft_consensus.cc:740] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Initialized, Role: FOLLOWER
I20260709 12:28:54.068638 26706 consensus_queue.cc:260] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:54.071419 26706 ts_tablet_manager.cc:1434] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:28:54.082947 27099 consensus_queue.cc:1048] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:54.090724 27163 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.091377 27163 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:54.103399 27163 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:54.104943 27121 consensus_queue.cc:1048] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:54.106078 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:54.109545 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:54.110015 26433 raft_consensus.cc:2393] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 1: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:54.114430 26550 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:54.115679 27222 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:54.140920 27099 consensus_queue.cc:1048] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:54.145043 27222 raft_consensus.cc:2749] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:54.352242 27177 consensus_queue.cc:1048] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:54.371574 27125 consensus_queue.cc:1048] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:54.828990 27177 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.829496 27177 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:54.831619 27177 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:54.832491 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:54.832499 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:54.833364 26585 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:28:54.834525 26625 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:54.835302 27177 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:54.835667 27177 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:54.836004 27177 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.842226 27177 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:54.844281 27177 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:54.845163 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:54.845536 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:54.846166 26580 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.852558 26580 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:28:54.853701 26625 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:54.854344 27177 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:54.854771 27177 raft_consensus.cc:697] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:54.855499 27177 consensus_queue.cc:237] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:54.866196 26336 catalog_manager.cc:5697] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.988617 27222 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:54.989228 27222 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:54.991176 27222 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:54.994102 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:54.995349 26654 raft_consensus.cc:2393] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:54.996263 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:54.996927 26505 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:54.998471 26551 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:54.999523 27222 raft_consensus.cc:2804] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:54.999887 27222 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:28:55.000254 27222 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:55.008706 27222 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:55.010671 27222 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:55.011332 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:55.011816 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:55.012624 26654 raft_consensus.cc:2393] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:28:55.020898 26509 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:55.022033 26551 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:55.022698 27222 raft_consensus.cc:2804] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:55.023146 27222 raft_consensus.cc:697] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:55.024170 27222 consensus_queue.cc:237] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:55.033818 26336 catalog_manager.cc:5697] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:55.104245 27184 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:28:55.105093 27184 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:28:55.107156 27184 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:28:55.108294 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:55.108311 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:55.109678 26580 raft_consensus.cc:2368] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3.
I20260709 12:28:55.110785 26477 leader_election.cc:400] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3.
I20260709 12:28:55.111018 26477 leader_election.cc:403] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:55.111558 27184 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:55.117734 27184 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3.
I20260709 12:28:55.254369 26580 raft_consensus.cc:1275] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:55.255537 27177 consensus_queue.cc:1048] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:55.268752 26509 raft_consensus.cc:1275] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:55.272487 20917 tablet_server.cc:179] TabletServer@127.20.109.65:0 shutting down...
I20260709 12:28:55.274622 27274 consensus_queue.cc:1048] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:55.280478 26625 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:28:55.351454 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 70993.5us
W20260709 12:28:55.354497 26551 consensus_peers.cc:597] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.357475 26477 consensus_peers.cc:597] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.387039 26477 consensus_peers.cc:597] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.387661 26477 consensus_peers.cc:597] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.388233 26477 consensus_peers.cc:597] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.396368 26625 consensus_peers.cc:597] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.402544 26625 consensus_peers.cc:597] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.403383 26625 consensus_peers.cc:597] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.404263 26625 consensus_peers.cc:597] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.415386 26509 raft_consensus.cc:1275] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:55.417878 27286 consensus_queue.cc:1048] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:55.434512 26551 consensus_peers.cc:597] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.440702 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:28:55.443573 26477 consensus_peers.cc:597] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.452560 26658 raft_consensus.cc:1275] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:55.452484 20917 tablet_replica.cc:333] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.455691 20917 raft_consensus.cc:2243] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.457574 20917 raft_consensus.cc:2272] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.456056 27267 consensus_queue.cc:1048] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:28:55.463688 26477 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.465122 20917 tablet_replica.cc:333] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.466172 20917 raft_consensus.cc:2243] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.467443 20917 raft_consensus.cc:2272] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:55.467520 26477 consensus_peers.cc:597] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.470415 20917 tablet_replica.cc:333] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.471334 20917 raft_consensus.cc:2243] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.471896 20917 raft_consensus.cc:2272] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.474364 20917 tablet_replica.cc:333] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.475221 20917 raft_consensus.cc:2243] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.476176 20917 raft_consensus.cc:2272] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.478714 20917 tablet_replica.cc:333] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.479509 20917 raft_consensus.cc:2243] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.480015 20917 raft_consensus.cc:2272] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.483542 20917 tablet_replica.cc:333] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.484424 20917 raft_consensus.cc:2243] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:55.484833 26477 consensus_peers.cc:597] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.485636 20917 raft_consensus.cc:2272] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.487834 20917 tablet_replica.cc:333] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.488749 20917 raft_consensus.cc:2243] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.489514 20917 raft_consensus.cc:2272] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.491420 20917 tablet_replica.cc:333] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.492025 20917 raft_consensus.cc:2243] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.492483 20917 raft_consensus.cc:2272] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.494458 20917 tablet_replica.cc:333] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.495072 20917 raft_consensus.cc:2243] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.495474 20917 raft_consensus.cc:2272] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.497401 20917 tablet_replica.cc:333] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.498026 20917 raft_consensus.cc:2243] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.498466 20917 raft_consensus.cc:2272] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.500602 20917 tablet_replica.cc:333] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.501219 20917 raft_consensus.cc:2243] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.501964 20917 raft_consensus.cc:2272] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.503875 20917 tablet_replica.cc:333] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.504415 20917 raft_consensus.cc:2243] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.505199 20917 raft_consensus.cc:2272] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.507465 20917 tablet_replica.cc:333] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.508019 20917 raft_consensus.cc:2243] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.508564 20917 raft_consensus.cc:2272] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.510475 20917 tablet_replica.cc:333] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.511169 20917 raft_consensus.cc:2243] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.512109 20917 raft_consensus.cc:2272] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.514406 20917 tablet_replica.cc:333] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.515225 20917 raft_consensus.cc:2243] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.515764 20917 raft_consensus.cc:2272] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.518285 20917 tablet_replica.cc:333] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.519125 20917 raft_consensus.cc:2243] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:55.519131 26625 consensus_peers.cc:597] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.520267 20917 raft_consensus.cc:2272] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:55.521176 26477 consensus_peers.cc:597] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.523710 20917 tablet_replica.cc:333] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.524396 20917 raft_consensus.cc:2243] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.524926 20917 raft_consensus.cc:2272] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.527562 20917 tablet_replica.cc:333] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.528157 20917 raft_consensus.cc:2243] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.528568 20917 raft_consensus.cc:2272] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.530660 20917 tablet_replica.cc:333] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.531418 20917 raft_consensus.cc:2243] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.531855 20917 raft_consensus.cc:2272] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.534236 20917 tablet_replica.cc:333] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.534899 20917 raft_consensus.cc:2243] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.535328 20917 raft_consensus.cc:2272] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.537163 20917 tablet_replica.cc:333] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.537755 20917 raft_consensus.cc:2243] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.538643 20917 raft_consensus.cc:2272] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.540593 20917 tablet_replica.cc:333] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.541292 20917 raft_consensus.cc:2243] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.541697 20917 raft_consensus.cc:2272] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.543572 20917 tablet_replica.cc:333] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.544064 20917 raft_consensus.cc:2243] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.544404 20917 raft_consensus.cc:2272] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.546087 20917 tablet_replica.cc:333] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.546551 20917 raft_consensus.cc:2243] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.546984 20917 raft_consensus.cc:2272] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.548915 20917 tablet_replica.cc:333] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.549440 20917 raft_consensus.cc:2243] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.550184 20917 raft_consensus.cc:2272] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.552078 20917 tablet_replica.cc:333] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.552572 20917 raft_consensus.cc:2243] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.552937 20917 raft_consensus.cc:2272] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.554875 20917 tablet_replica.cc:333] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.555363 20917 raft_consensus.cc:2243] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.555758 20917 raft_consensus.cc:2272] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.557801 20917 tablet_replica.cc:333] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.558454 20917 raft_consensus.cc:2243] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.558951 20917 raft_consensus.cc:2272] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.560863 20917 tablet_replica.cc:333] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.561486 20917 raft_consensus.cc:2243] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.561903 20917 raft_consensus.cc:2272] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.563879 20917 tablet_replica.cc:333] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.564379 20917 raft_consensus.cc:2243] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.564851 20917 raft_consensus.cc:2272] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.567669 20917 tablet_replica.cc:333] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.568498 20917 raft_consensus.cc:2243] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.569082 20917 raft_consensus.cc:2272] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:55.570516 26477 consensus_peers.cc:597] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.571802 20917 tablet_replica.cc:333] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.572644 20917 raft_consensus.cc:2243] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.573175 20917 raft_consensus.cc:2272] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:55.573225 26551 consensus_peers.cc:597] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.576015 20917 tablet_replica.cc:333] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
W20260709 12:28:55.576445 26625 consensus_peers.cc:597] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.576875 20917 raft_consensus.cc:2243] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.577934 20917 raft_consensus.cc:2272] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.580334 20917 tablet_replica.cc:333] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.581125 20917 raft_consensus.cc:2243] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:55.581120 26551 consensus_peers.cc:597] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.582233 20917 raft_consensus.cc:2272] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.584518 20917 tablet_replica.cc:333] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.585297 20917 raft_consensus.cc:2243] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.586259 20917 raft_consensus.cc:2272] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.588204 20917 tablet_replica.cc:333] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.588785 20917 raft_consensus.cc:2243] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.589227 20917 raft_consensus.cc:2272] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.591250 20917 tablet_replica.cc:333] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.591786 20917 raft_consensus.cc:2243] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.592216 20917 raft_consensus.cc:2272] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.595032 20917 tablet_replica.cc:333] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.595798 20917 raft_consensus.cc:2243] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.596338 20917 raft_consensus.cc:2272] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.599154 20917 tablet_replica.cc:333] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.599911 20917 raft_consensus.cc:2243] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.600979 20917 raft_consensus.cc:2272] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.603818 20917 tablet_replica.cc:333] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
W20260709 12:28:55.603816 26477 consensus_peers.cc:597] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.604956 20917 raft_consensus.cc:2243] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.605980 20917 raft_consensus.cc:2272] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.609169 20917 tablet_replica.cc:333] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.609920 20917 raft_consensus.cc:2243] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.610417 20917 raft_consensus.cc:2272] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.612619 20917 tablet_replica.cc:333] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.613157 20917 raft_consensus.cc:2243] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.613910 20917 raft_consensus.cc:2272] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.615902 20917 tablet_replica.cc:333] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.616470 20917 raft_consensus.cc:2243] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.617403 20917 raft_consensus.cc:2272] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.619427 20917 tablet_replica.cc:333] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.619867 20917 raft_consensus.cc:2243] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.620223 20917 raft_consensus.cc:2272] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.622145 20917 tablet_replica.cc:333] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: stopping tablet replica
I20260709 12:28:55.622571 20917 raft_consensus.cc:2243] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:55.623342 20917 raft_consensus.cc:2272] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:55.628898 26625 consensus_peers.cc:597] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.640432 26625 consensus_peers.cc:597] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.652701 26477 consensus_peers.cc:597] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.688402 20917 tablet_server.cc:196] TabletServer@127.20.109.65:0 shutdown complete.
W20260709 12:28:55.725817 26551 consensus_peers.cc:597] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.768457 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:55.777527 27292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:55.785460 27293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:55.789996 27295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:55.794099 26477 consensus_peers.cc:597] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.794173 20917 server_base.cc:1061] running on GCE node
I20260709 12:28:55.797514 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:55.797755 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:55.797940 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600135797923 us; error 0 us; skew 500 ppm
I20260709 12:28:55.798518 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:55.801862 20917 webserver.cc:533] Webserver started at http://127.20.109.65:38337/ using document root <none> and password file <none>
I20260709 12:28:55.802352 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:55.802543 20917 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:28:55.808060 20917 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:55.815902 27300 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:55.816836 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:28:55.817168 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-sc4p"
I20260709 12:28:55.817595 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:55.831746 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:55.832995 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:55.837322 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:28:55.841425 26477 consensus_peers.cc:597] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.844628 27307 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:28:56.165033 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:28:56.165416 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.322s	user 0.009s	sys 0.000s
I20260709 12:28:56.165762 20917 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:28:56.175272 27307 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.195179 27307 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.196111 27307 tablet_bootstrap.cc:492] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.196686 27307 ts_tablet_manager.cc:1403] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 12:28:56.198536 27307 raft_consensus.cc:359] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.199110 27307 raft_consensus.cc:740] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.199820 27307 consensus_queue.cc:260] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.202145 27307 ts_tablet_manager.cc:1434] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:28:56.202891 27307 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.226018 27307 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.226833 27307 tablet_bootstrap.cc:492] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.227340 27307 ts_tablet_manager.cc:1403] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:28:56.229396 27307 raft_consensus.cc:359] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.230036 27307 raft_consensus.cc:740] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.230850 27307 consensus_queue.cc:260] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.232669 27307 ts_tablet_manager.cc:1434] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:28:56.233421 27307 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.251614 27307 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.252519 27307 tablet_bootstrap.cc:492] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.253170 27307 ts_tablet_manager.cc:1403] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:28:56.255522 27307 raft_consensus.cc:359] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.256160 27307 raft_consensus.cc:740] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.256703 27307 consensus_queue.cc:260] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.258107 27307 ts_tablet_manager.cc:1434] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:56.258781 27307 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.273049 27307 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.273768 27307 tablet_bootstrap.cc:492] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.274271 27307 ts_tablet_manager.cc:1403] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:28:56.276621 27307 raft_consensus.cc:359] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.277418 27307 raft_consensus.cc:740] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.278090 27307 consensus_queue.cc:260] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.280015 27307 ts_tablet_manager.cc:1434] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:56.280866 27307 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.295547 27307 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.296469 27307 tablet_bootstrap.cc:492] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.297106 27307 ts_tablet_manager.cc:1403] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:28:56.299679 27307 raft_consensus.cc:359] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.300359 27307 raft_consensus.cc:740] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.301054 27307 consensus_queue.cc:260] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.303176 27307 ts_tablet_manager.cc:1434] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:56.304112 27307 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.319941 27307 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.320729 27307 tablet_bootstrap.cc:492] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.321314 27307 ts_tablet_manager.cc:1403] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 12:28:56.323203 27307 raft_consensus.cc:359] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.323724 27307 raft_consensus.cc:740] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.324306 27307 consensus_queue.cc:260] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.325773 27307 ts_tablet_manager.cc:1434] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:28:56.326391 27307 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.339892 27307 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.340871 27307 tablet_bootstrap.cc:492] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.341539 27307 ts_tablet_manager.cc:1403] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:28:56.343771 27307 raft_consensus.cc:359] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.344866 27307 raft_consensus.cc:740] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.345500 27307 consensus_queue.cc:260] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.347267 27307 ts_tablet_manager.cc:1434] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.002s
I20260709 12:28:56.347965 27307 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.360930 27307 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.361743 27307 tablet_bootstrap.cc:492] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.362390 27307 ts_tablet_manager.cc:1403] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 12:28:56.364691 27307 raft_consensus.cc:359] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.365206 27307 raft_consensus.cc:740] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.365826 27307 consensus_queue.cc:260] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.367910 27307 ts_tablet_manager.cc:1434] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:56.368718 27307 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.382112 27307 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.382820 27307 tablet_bootstrap.cc:492] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.383276 27307 ts_tablet_manager.cc:1403] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:28:56.385071 27307 raft_consensus.cc:359] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.385529 27307 raft_consensus.cc:740] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.386029 27307 consensus_queue.cc:260] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.387414 27307 ts_tablet_manager.cc:1434] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:56.387995 27307 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.405355 27307 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.406275 27307 tablet_bootstrap.cc:492] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.406960 27307 ts_tablet_manager.cc:1403] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:28:56.409339 27307 raft_consensus.cc:359] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.409996 27307 raft_consensus.cc:740] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.410791 27307 consensus_queue.cc:260] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.413239 27307 ts_tablet_manager.cc:1434] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:56.414954 27307 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.426301 27307 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.427069 27307 tablet_bootstrap.cc:492] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.427541 27307 ts_tablet_manager.cc:1403] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:28:56.429358 27307 raft_consensus.cc:359] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.429826 27307 raft_consensus.cc:740] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.430382 27307 consensus_queue.cc:260] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.430639 20917 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:28:56.431007 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.265s	user 0.238s	sys 0.010s
I20260709 12:28:56.431911 27307 ts_tablet_manager.cc:1434] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:56.432596 27307 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.448895 27307 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.454205 27307 tablet_bootstrap.cc:492] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.455442 27307 ts_tablet_manager.cc:1403] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:28:56.458495 27307 raft_consensus.cc:359] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.459254 27307 raft_consensus.cc:740] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.460095 27307 consensus_queue.cc:260] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.466082 27095 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.466898 27095 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.468910 27095 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:56.472692 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:56.473089 27125 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.473726 27125 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.475994 27125 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.477738 27307 ts_tablet_manager.cc:1434] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:28:56.478757 27307 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
W20260709 12:28:56.479939 26477 leader_election.cc:336] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:28:56.480415 26477 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.481904 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:28:56.484318 26625 leader_election.cc:336] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:28:56.485076 26625 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.485692 27125 raft_consensus.cc:2749] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.485993 27095 raft_consensus.cc:2749] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.518491 27307 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.519498 27307 tablet_bootstrap.cc:492] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.520140 27307 ts_tablet_manager.cc:1403] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.008s
I20260709 12:28:56.522583 27307 raft_consensus.cc:359] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.523276 27307 raft_consensus.cc:740] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.523979 27307 consensus_queue.cc:260] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.525974 27307 ts_tablet_manager.cc:1434] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:56.526748 27307 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.554867 27307 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.555774 27307 tablet_bootstrap.cc:492] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.556382 27307 ts_tablet_manager.cc:1403] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.008s
I20260709 12:28:56.558995 27307 raft_consensus.cc:359] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.559630 27307 raft_consensus.cc:740] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.560384 27307 consensus_queue.cc:260] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.562585 27307 ts_tablet_manager.cc:1434] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:56.563406 27307 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.579274 27307 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.580191 27307 tablet_bootstrap.cc:492] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.580857 27307 ts_tablet_manager.cc:1403] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:28:56.581316 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:39541
I20260709 12:28:56.581485 27380 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:39541 every 8 connection(s)
I20260709 12:28:56.583376 27307 raft_consensus.cc:359] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.583910 27307 raft_consensus.cc:740] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.584654 27307 consensus_queue.cc:260] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.586915 27307 ts_tablet_manager.cc:1434] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:56.587704 27307 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.599774 27095 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.600479 27095 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.605854 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:56.608940 27095 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.611344 27095 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.612828 27095 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.615901 27095 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:56.617020 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:56.621591 27267 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.621650 27222 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.622162 27267 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.624639 27222 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.626092 27267 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.626655 27222 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.627813 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.627775 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:56.636843 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.637926 27307 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.639036 27307 tablet_bootstrap.cc:492] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.639791 27307 ts_tablet_manager.cc:1403] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.007s
I20260709 12:28:56.640663 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.644372 27307 raft_consensus.cc:359] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:28:56.647287 26551 leader_election.cc:343] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.647986 26551 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.649200 27267 raft_consensus.cc:2749] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.649567 27307 raft_consensus.cc:740] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
W20260709 12:28:56.649363 26551 leader_election.cc:343] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.650213 26551 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.650491 27307 consensus_queue.cc:260] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.651015 27267 raft_consensus.cc:2749] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.652565 27307 ts_tablet_manager.cc:1434] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:28:56.653343 27307 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.658354 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.659811 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:28:56.662896 26477 leader_election.cc:343] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.663371 26477 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.664139 27095 raft_consensus.cc:2749] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:56.664500 26477 leader_election.cc:343] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.664996 26477 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.665668 27095 raft_consensus.cc:2749] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.669446 27095 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.670042 27095 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.673241 27095 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.673521 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:56.673908 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.674988 27125 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.675514 27125 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.677861 27352 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:56.678854 27125 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.678843 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:56.679735 26477 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:56.682039 27275 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.682440 27275 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.682904 27275 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.690778 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.699435 27381 heartbeater.cc:344] Connected to a master server at 127.20.109.126:41885
I20260709 12:28:56.699661 27125 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.700026 27381 heartbeater.cc:461] Registering TS with master...
W20260709 12:28:56.700220 26625 leader_election.cc:343] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.700186 27125 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.700845 26625 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.701045 27381 heartbeater.cc:507] Master 127.20.109.126:41885 requested a full tablet report, sending...
I20260709 12:28:56.701967 27095 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.702785 27177 raft_consensus.cc:2749] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.702528 27095 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.703523 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.704759 27184 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.705327 27184 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.705792 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:56.706983 27095 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.707563 27184 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:56.708328 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.708781 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.708702 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:28:56.710213 26477 leader_election.cc:343] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.710985 26477 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.719112 27184 raft_consensus.cc:2749] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.702464 27125 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.721765 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:28:56.723799 26625 leader_election.cc:343] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.724243 26625 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.724967 27125 raft_consensus.cc:2749] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:56.730620 26477 leader_election.cc:343] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.731134 26477 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.731793 27308 raft_consensus.cc:2749] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.732419 27275 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.734766 27275 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.736207 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:56.737027 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:56.737598 27350 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.745597 27307 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.746713 27307 tablet_bootstrap.cc:492] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.747557 27307 ts_tablet_manager.cc:1403] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.094s	user 0.030s	sys 0.005s
I20260709 12:28:56.746613 26336 ts_manager.cc:194] Re-registered known tserver with Master: baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.749902 27307 raft_consensus.cc:359] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.750571 27307 raft_consensus.cc:740] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.751390 27307 consensus_queue.cc:260] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.752749 27177 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.752893 27350 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:28:56.753603 27307 ts_tablet_manager.cc:1434] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:28:56.753537 27125 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.754217 27125 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.754287 26477 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:28:56.754640 27307 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.755661 27392 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:56.756220 27392 raft_consensus.cc:697] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:56.753321 27177 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.757189 27392 consensus_queue.cc:237] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.758955 27177 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.761348 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.761710 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.762137 26509 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:56.767309 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.767268 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.770320 26625 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:56.771528 27177 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.771910 27177 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.772262 27177 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.781980 27222 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.756259 27125 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:28:56.779341 26625 leader_election.cc:343] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.783731 27267 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.784315 27267 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.786670 27267 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:28:56.784247 26625 leader_election.cc:343] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.783118 27286 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.787328 26625 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.787863 27286 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.788520 27275 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.789031 27307 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.789079 27275 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.790138 27307 tablet_bootstrap.cc:492] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.790959 27307 ts_tablet_manager.cc:1403] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.004s
I20260709 12:28:56.792253 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.793007 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.792953 27352 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:56.794272 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:56.794955 26477 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:56.795468 27307 raft_consensus.cc:359] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:28:56.795903 26551 leader_election.cc:343] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.796185 27307 raft_consensus.cc:740] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.795811 27391 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.790122 27286 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.792940 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.797062 27307 consensus_queue.cc:260] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.797446 26509 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:56.797567 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.796870 27391 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.798530 27391 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.798776 26551 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.782711 27222 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:28:56.800006 26551 leader_election.cc:343] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.800668 27286 raft_consensus.cc:2804] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.801127 27286 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.801432 27222 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.801745 27286 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.802747 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.803575 27350 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:56.803908 27125 raft_consensus.cc:2749] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:56.803501 27275 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:56.804903 26551 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:56.805980 27222 raft_consensus.cc:2804] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.806414 27222 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.806854 27222 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.801381 26336 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48722
I20260709 12:28:56.813536 27307 ts_tablet_manager.cc:1434] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:28:56.815793 27381 heartbeater.cc:499] Master 127.20.109.126:41885 was elected leader, sending a full tablet report...
I20260709 12:28:56.817638 27307 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.827363 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:56.828176 26658 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:56.831053 27267 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.786331 27177 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.831707 27267 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.837867 27267 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.840865 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.843047 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.843950 27352 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:56.843463 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:56.845625 26551 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:56.850651 27267 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.851164 27267 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.851538 27267 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.852723 27286 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.853904 27125 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.854519 27125 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.855257 27286 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.856010 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:56.856727 27125 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.858299 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:56.858963 26509 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:56.860337 26551 leader_election.cc:343] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.864202 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:56.864502 26336 catalog_manager.cc:5697] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:56.869522 27267 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.870209 26509 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:56.834013 27177 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.872709 27267 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.873191 27391 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.856554 27222 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.873701 26551 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:56.879216 27267 raft_consensus.cc:2804] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:56.879837 27267 raft_consensus.cc:697] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:56.880709 27267 consensus_queue.cc:237] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.881784 27392 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.882287 27286 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.882524 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.882391 27392 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:56.882984 27286 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.883335 26505 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:56.884801 27392 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.885118 27286 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.885690 27286 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.886138 27286 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.887363 27125 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.887892 27125 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.888690 27286 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.888546 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.889448 26504 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:56.891175 27391 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:56.891698 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:56.892822 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:56.893504 26504 raft_consensus.cc:2468] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:56.891069 27125 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.896682 27391 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.896880 26551 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:56.897258 27391 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.895100 27222 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.898034 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:56.898787 27222 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.899210 27222 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.899562 27222 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.901224 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:56.913798 27222 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.898011 26551 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:56.915205 26580 raft_consensus.cc:2393] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:28:56.915594 27395 raft_consensus.cc:2804] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.904273 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.904793 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:56.916222 27395 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.907160 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.908284 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:56.909264 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.910781 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.911311 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.912271 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.916729 27395 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.913982 27125 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.925403 27125 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.916750 27349 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.918820 27348 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.930768 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:56.931684 27350 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.932225 27392 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.932483 27307 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:56.932837 27392 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:56.933502 27307 tablet_bootstrap.cc:492] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:56.934299 27307 ts_tablet_manager.cc:1403] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.117s	user 0.034s	sys 0.026s
I20260709 12:28:56.935190 27392 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:56.937216 27307 raft_consensus.cc:359] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.937969 27307 raft_consensus.cc:740] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.938678 27307 consensus_queue.cc:260] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.939694 27286 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.940274 27286 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:56.941092 27348 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:56.941304 27307 ts_tablet_manager.cc:1434] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:56.942337 27307 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:56.946967 26625 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:56.942458 27286 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.967308 27125 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:56.968031 27125 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.968367 27125 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:56.939653 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:56.978209 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:56.978855 26509 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.968690 27125 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:56.976471 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:56.980927 26550 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:28:56.982728 26625 leader_election.cc:343] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:56.981349 26477 leader_election.cc:343] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:56.983431 26625 leader_election.cc:343] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.995297 27391 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:56.996524 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:56.997330 26580 raft_consensus.cc:2393] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:28:56.997607 27222 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:56.998276 27222 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:56.984193 26658 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:56.982059 27286 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.004033 27395 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.004506 27286 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.003849 27349 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:28:56.979701 27350 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
W20260709 12:28:56.985167 26477 leader_election.cc:343] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.012449 27403 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.015725 26476 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.015856 26335 catalog_manager.cc:5697] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.018529 26625 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.019030 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:57.027040 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:57.027670 26505 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.028162 27308 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.028498 27391 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:57.007053 27222 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.013001 27403 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.029299 27222 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.029860 27308 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.031014 27403 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:57.029265 27404 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.031965 27308 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:57.019865 27274 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.032012 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.032738 27274 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.034813 27274 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:57.036612 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.037510 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.040972 27346 raft_consensus.cc:2393] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:28:57.041028 27286 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.035567 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
W20260709 12:28:57.038491 26551 leader_election.cc:343] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.043501 26509 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:28:57.028903 27391 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.039992 26477 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:28:57.044764 27398 log.cc:927] Time spent T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:28:57.046074 27391 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.048949 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.045885 27308 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.051898 27395 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:28:57.052469 27308 raft_consensus.cc:697] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:57.053462 27308 consensus_queue.cc:237] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.056053 26477 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.057323 27275 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:57.044764 26551 leader_election.cc:343] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.068246 27392 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.068846 27392 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:28:57.080124 26477 leader_election.cc:343] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.083639 27184 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.084250 27184 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.085638 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:57.082090 27392 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:57.086328 26579 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:57.086428 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:57.087123 26580 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:57.088622 27184 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.089246 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:57.089926 26579 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:28:57.091962 27404 raft_consensus.cc:2749] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:57.096985 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 72468.6us
I20260709 12:28:57.098664 27125 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:28:57.099409 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 54684us
I20260709 12:28:57.100175 26551 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:57.098830 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:57.100943 27267 raft_consensus.cc:2804] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.101557 27267 raft_consensus.cc:697] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:57.095602 27222 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.102540 26625 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:57.102413 27267 consensus_queue.cc:237] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.100834 27125 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:28:57.103657 26551 leader_election.cc:343] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.117091 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:57.117491 26551 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:28:57.117993 26579 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:57.118418 27402 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.104970 26658 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:57.105262 27401 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:57.118976 27402 raft_consensus.cc:697] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:57.119117 27401 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.119596 27401 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.119933 27402 consensus_queue.cc:237] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.108985 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.122113 27350 raft_consensus.cc:2393] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:57.114086 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:57.123078 26654 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:28:57.124307 26477 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.115219 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:57.130200 26653 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:57.109040 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.110363 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.116340 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
W20260709 12:28:57.116814 26625 leader_election.cc:343] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.132110 26652 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.131943 27401 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.093704 26505 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:57.133965 27308 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:57.134368 27308 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.134771 27308 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.136301 26477 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.137081 27392 raft_consensus.cc:2804] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:57.137439 27392 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.137779 27392 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.141108 27401 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.142282 26625 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.143030 27307 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.143656 26652 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
W20260709 12:28:57.127183 26551 leader_election.cc:343] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.144011 27307 tablet_bootstrap.cc:492] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
W20260709 12:28:57.144645 26551 leader_election.cc:343] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.144881 27307 ts_tablet_manager.cc:1403] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.203s	user 0.013s	sys 0.012s
I20260709 12:28:57.146368 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.147285 27348 raft_consensus.cc:2393] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:57.147347 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:28:57.148293 27402 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.148865 26551 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.149011 27402 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.148367 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:57.150126 26504 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.150388 26625 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.150847 27267 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.151352 27267 raft_consensus.cc:697] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:57.151422 27125 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.152034 27125 raft_consensus.cc:697] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:57.152616 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.152806 27125 consensus_queue.cc:237] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.149376 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.152805 27404 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.129205 27391 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.103564 27222 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.148860 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.155575 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:28:57.158385 26477 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:57.159293 26513 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.158568 27267 consensus_queue.cc:237] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.157473 27391 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.145431 27392 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.160861 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:28:57.163297 26551 leader_election.cc:343] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.164070 26551 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.164165 27404 raft_consensus.cc:2749] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:57.164822 27395 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.165383 27402 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.155524 27308 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.168645 26509 raft_consensus.cc:2393] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:28:57.122869 27275 raft_consensus.cc:2749] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:57.172087 27395 raft_consensus.cc:2749] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:57.173389 26551 leader_election.cc:343] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.174640 26551 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.174957 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.175621 27350 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:57.176668 27392 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:57.177371 27395 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.181051 27308 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:57.193040 27095 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:57.193454 27095 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.193818 27095 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.195194 26476 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:57.195345 26550 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.196584 27402 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:57.197098 27402 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.197438 27402 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.181542 26504 raft_consensus.cc:2468] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:57.185199 27395 raft_consensus.cc:2749] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:57.185705 27307 raft_consensus.cc:359] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.186204 26551 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:57.201107 26551 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.206525 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:57.207011 27405 raft_consensus.cc:2804] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.207221 26579 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.207548 27405 raft_consensus.cc:697] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:57.208416 27405 consensus_queue.cc:237] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.185201 26513 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:28:57.196574 27391 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:57.212338 27391 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.212829 27391 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.216665 26579 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:28:57.204708 27395 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:57.217474 27395 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.217864 27395 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:57.204686 26477 leader_election.cc:343] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:57.221695 26477 leader_election.cc:343] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.222709 27307 raft_consensus.cc:740] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.202994 27095 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.224937 27095 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:28:57.225754 27395 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.227571 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.228843 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.225193 27307 consensus_queue.cc:260] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.231176 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:57.231971 26579 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.232096 27307 ts_tablet_manager.cc:1434] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.000s
I20260709 12:28:57.233753 27307 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.235682 27395 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.240675 27391 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.242426 26579 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:28:57.206341 27402 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.243957 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.244665 27352 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.243906 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.259032 26550 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.258728 26335 catalog_manager.cc:5697] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.260198 27395 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.260483 27352 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:57.260902 27395 raft_consensus.cc:697] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:57.261857 26551 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:28:57.262315 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.262720 27267 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.263208 27267 raft_consensus.cc:697] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:57.264058 27267 consensus_queue.cc:237] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.264600 27401 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:28:57.260418 26335 catalog_manager.cc:5697] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.264730 26625 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:57.268260 27125 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.268699 27125 raft_consensus.cc:697] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:57.269372 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:57.270009 26654 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.264899 27395 consensus_queue.cc:237] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.272473 26657 raft_consensus.cc:1275] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.273777 27402 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.265161 27401 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.276752 27401 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.265843 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:57.277465 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:28:57.278023 26580 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:57.277500 26477 leader_election.cc:343] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:57.279235 26477 leader_election.cc:343] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:57.280133 26477 leader_election.cc:343] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.281572 26477 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.282686 27391 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:28:57.283453 27391 raft_consensus.cc:2804] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.269413 27125 consensus_queue.cc:237] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.283998 27391 raft_consensus.cc:697] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:57.285964 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:28:57.286808 26657 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:28:57.264614 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.288956 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:57.287261 27391 consensus_queue.cc:237] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.289610 26657 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:57.294220 26551 leader_election.cc:343] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.295279 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:57.295977 26656 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.296368 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.298295 26654 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:28:57.300740 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:28:57.301033 26579 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:28:57.303081 26336 catalog_manager.cc:5697] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 2 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.305864 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:28:57.306782 27348 raft_consensus.cc:2393] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:28:57.307752 26335 catalog_manager.cc:5697] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.309738 26335 catalog_manager.cc:5697] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.310850 27392 consensus_queue.cc:1048] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.319339 27307 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:28:57.320613 26551 consensus_peers.cc:597] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.323536 27307 tablet_bootstrap.cc:492] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.323715 27352 raft_consensus.cc:1275] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.325459 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:28:57.326545 26580 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:28:57.328766 26657 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:28:57.330000 26625 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:28:57.331362 26477 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.332401 27307 ts_tablet_manager.cc:1403] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.008s
W20260709 12:28:57.334434 26625 leader_election.cc:343] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.334944 27392 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.333420 27401 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.336032 26477 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:28:57.336567 26656 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
W20260709 12:28:57.345095 26625 leader_election.cc:343] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.344252 27401 raft_consensus.cc:697] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:28:57.345846 27422 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.346352 27422 raft_consensus.cc:697] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:57.347357 27422 consensus_queue.cc:237] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.347934 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:28:57.348577 26657 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.344673 27392 raft_consensus.cc:697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:57.350136 27392 consensus_queue.cc:237] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.350677 26476 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.341645 27307 raft_consensus.cc:359] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.351557 27307 raft_consensus.cc:740] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.352015 27184 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.352561 27184 raft_consensus.cc:697] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:57.353351 27184 consensus_queue.cc:237] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:28:57.355721 26477 leader_election.cc:343] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.356083 27307 consensus_queue.cc:260] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.358275 26657 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:28:57.347033 27401 consensus_queue.cc:237] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.359993 27307 ts_tablet_manager.cc:1434] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:28:57.360927 27307 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.365149 26550 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:28:57.368988 26477 leader_election.cc:343] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.370343 27184 consensus_queue.cc:1048] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.371173 27267 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.382947 27267 raft_consensus.cc:697] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:28:57.384016 27267 consensus_queue.cc:237] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.390661 26625 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.391512 27401 raft_consensus.cc:2749] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:57.393591 27307 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.394783 27307 tablet_bootstrap.cc:492] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.395591 27307 ts_tablet_manager.cc:1403] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 12:28:57.397745 26476 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:28:57.398772 27095 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:57.399267 27095 raft_consensus.cc:697] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:28:57.398965 27307 raft_consensus.cc:359] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.400508 27307 raft_consensus.cc:740] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.400202 27095 consensus_queue.cc:237] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.401397 27307 consensus_queue.cc:260] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.404726 27307 ts_tablet_manager.cc:1434] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:28:57.405773 27307 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.393896 26336 catalog_manager.cc:5697] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.419417 26335 catalog_manager.cc:5697] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.423039 26331 catalog_manager.cc:5697] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 2 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.430079 26331 catalog_manager.cc:5697] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 2 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.433563 26335 catalog_manager.cc:5697] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.436677 26336 catalog_manager.cc:5697] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.449194 27307 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.450774 27307 tablet_bootstrap.cc:492] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.451465 27307 ts_tablet_manager.cc:1403] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.014s
I20260709 12:28:57.454020 27307 raft_consensus.cc:359] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.454704 27307 raft_consensus.cc:740] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.455484 27307 consensus_queue.cc:260] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:57.457482 27307 ts_tablet_manager.cc:1434] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:28:57.458410 27307 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.483299 27307 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.484200 27307 tablet_bootstrap.cc:492] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.484866 27307 ts_tablet_manager.cc:1403] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 12:28:57.486624 26335 catalog_manager.cc:5697] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.487341 27307 raft_consensus.cc:359] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.488057 27307 raft_consensus.cc:740] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.488766 27307 consensus_queue.cc:260] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.489130 26513 raft_consensus.cc:1275] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.490821 27307 ts_tablet_manager.cc:1434] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:57.491931 27267 consensus_queue.cc:1048] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.492343 26335 catalog_manager.cc:5697] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.499208 27307 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.502061 26335 catalog_manager.cc:5697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.502820 26331 catalog_manager.cc:5697] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.503835 26335 catalog_manager.cc:5697] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.542816 27307 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.543979 27307 tablet_bootstrap.cc:492] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.544723 27307 ts_tablet_manager.cc:1403] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.007s
I20260709 12:28:57.548494 27307 raft_consensus.cc:359] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.549253 27307 raft_consensus.cc:740] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.550083 27307 consensus_queue.cc:260] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.553100 27307 ts_tablet_manager.cc:1434] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:57.554276 27307 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.566473 26504 raft_consensus.cc:1275] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.569394 27267 consensus_queue.cc:1048] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.576124 27307 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.577270 27307 tablet_bootstrap.cc:492] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.579170 27307 ts_tablet_manager.cc:1403] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 12:28:57.582233 27307 raft_consensus.cc:359] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.586783 27307 raft_consensus.cc:740] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.587738 27352 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.588124 27350 raft_consensus.cc:1275] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.590299 27307 consensus_queue.cc:260] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.590838 27405 consensus_queue.cc:1048] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.599186 27350 raft_consensus.cc:1275] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.603979 27307 ts_tablet_manager.cc:1434] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:28:57.605026 27307 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.608678 27352 raft_consensus.cc:1275] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.610759 27184 consensus_queue.cc:1048] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.623155 27267 consensus_queue.cc:1048] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.630147 26654 raft_consensus.cc:1275] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.631959 27267 consensus_queue.cc:1048] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.632989 26504 raft_consensus.cc:1275] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.635979 27307 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.637023 27307 tablet_bootstrap.cc:492] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.638293 27307 ts_tablet_manager.cc:1403] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.008s
I20260709 12:28:57.641866 26586 raft_consensus.cc:1275] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.649395 27286 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:57.657337 27422 consensus_queue.cc:1048] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:57.657961 27307 raft_consensus.cc:359] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.659227 27307 raft_consensus.cc:740] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.659979 27307 consensus_queue.cc:260] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.662648 26656 raft_consensus.cc:1275] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.664903 27307 ts_tablet_manager.cc:1434] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:28:57.666177 27402 consensus_queue.cc:1048] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:28:57.672384 26625 consensus_peers.cc:597] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.680085 27307 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.683056 27346 raft_consensus.cc:1275] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.690481 27348 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.698307 26504 raft_consensus.cc:1275] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.700330 27401 consensus_queue.cc:1048] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:57.703805 26625 consensus_peers.cc:597] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:57.705953 27222 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:57.732700 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 59210.9us
I20260709 12:28:57.735110 26654 raft_consensus.cc:1275] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.739042 27222 consensus_queue.cc:1048] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:57.747895 26551 consensus_peers.cc:597] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.753140 26509 raft_consensus.cc:1275] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.754034 26654 raft_consensus.cc:1275] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.756299 27308 consensus_queue.cc:1048] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.756523 27395 consensus_queue.cc:1048] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.767771 27348 raft_consensus.cc:1275] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.781633 27450 consensus_queue.cc:1048] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:57.783541 26586 raft_consensus.cc:1275] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.783744 27307 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.785567 27401 consensus_queue.cc:1048] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.791693 27350 raft_consensus.cc:1275] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:57.796766 26477 consensus_peers.cc:597] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.800259 27307 tablet_bootstrap.cc:492] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.801319 27307 ts_tablet_manager.cc:1403] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.121s	user 0.028s	sys 0.011s
I20260709 12:28:57.802776 27352 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.803756 27307 raft_consensus.cc:359] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.804427 27307 raft_consensus.cc:740] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.805142 27307 consensus_queue.cc:260] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:57.814077 27352 raft_consensus.cc:1275] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.816344 27307 ts_tablet_manager.cc:1434] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 12:28:57.817274 27307 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.826797 27125 consensus_queue.cc:1048] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:57.831183 26504 raft_consensus.cc:1275] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.834864 27404 consensus_queue.cc:1048] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:57.859066 26625 consensus_peers.cc:597] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.861151 27395 consensus_queue.cc:1048] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:57.864523 26580 raft_consensus.cc:1275] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.870399 26580 raft_consensus.cc:1275] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.874126 27307 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.876433 27307 tablet_bootstrap.cc:492] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.877341 27307 ts_tablet_manager.cc:1403] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.011s
W20260709 12:28:57.882674 26477 consensus_peers.cc:597] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.883761 26477 consensus_peers.cc:597] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.884253 27307 raft_consensus.cc:359] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.884989 27307 raft_consensus.cc:740] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.890201 27307 consensus_queue.cc:260] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:57.903556 27307 ts_tablet_manager.cc:1434] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:28:57.912240 27307 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:57.920606 27350 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:57.903831 27392 consensus_queue.cc:1048] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:28:57.904049 27422 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:28:57.929284 27350 raft_consensus.cc:1275] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:57.971360 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 69457.7us
I20260709 12:28:57.976446 27307 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:57.977514 27307 tablet_bootstrap.cc:492] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:57.978193 27307 ts_tablet_manager.cc:1403] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.022s
I20260709 12:28:57.978709 27308 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:57.990803 26656 raft_consensus.cc:1275] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:57.996174 27286 consensus_queue.cc:1048] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:57.999451 26582 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.003029 27307 raft_consensus.cc:359] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.003842 27307 raft_consensus.cc:740] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.004525 27307 consensus_queue.cc:260] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.006654 26654 raft_consensus.cc:1275] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.006654 27307 ts_tablet_manager.cc:1434] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:28:58.009524 27347 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.010811 27307 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
W20260709 12:28:58.019384 26477 consensus_peers.cc:597] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:58.026358 27347 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.027669 27392 consensus_queue.cc:1048] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:58.034020 26551 consensus_peers.cc:597] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.034106 27308 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:58.060823 27095 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:58.076987 26625 consensus_peers.cc:597] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:58.103406 27307 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.104386 27307 tablet_bootstrap.cc:492] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.105067 27307 ts_tablet_manager.cc:1403] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.000s
I20260709 12:28:58.108093 27307 raft_consensus.cc:359] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.108757 27307 raft_consensus.cc:740] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.109678 27307 consensus_queue.cc:260] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.111948 27307 ts_tablet_manager.cc:1434] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:58.112848 27307 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.153008 27307 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.154013 27307 tablet_bootstrap.cc:492] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.154721 27307 ts_tablet_manager.cc:1403] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.008s
I20260709 12:28:58.156852 27307 raft_consensus.cc:359] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.157425 27307 raft_consensus.cc:740] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.158097 27307 consensus_queue.cc:260] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.159811 27307 ts_tablet_manager.cc:1434] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:58.160928 27307 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.176999 27307 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.178313 27307 tablet_bootstrap.cc:492] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.179189 27307 ts_tablet_manager.cc:1403] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:28:58.181627 27307 raft_consensus.cc:359] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.182322 27307 raft_consensus.cc:740] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.183048 27307 consensus_queue.cc:260] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.185161 27307 ts_tablet_manager.cc:1434] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 12:28:58.185909 26477 consensus_peers.cc:597] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:58.186347 27307 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
W20260709 12:28:58.193641 26477 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:58.197598 26625 consensus_peers.cc:597] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:58.201515 27307 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.202438 27307 tablet_bootstrap.cc:492] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.203130 27307 ts_tablet_manager.cc:1403] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:28:58.205495 27307 raft_consensus.cc:359] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.206156 27307 raft_consensus.cc:740] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.206805 27307 consensus_queue.cc:260] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.208761 27307 ts_tablet_manager.cc:1434] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:58.210166 27307 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.229205 27307 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.230189 27307 tablet_bootstrap.cc:492] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.230890 27307 ts_tablet_manager.cc:1403] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:28:58.233080 27307 raft_consensus.cc:359] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.233733 27307 raft_consensus.cc:740] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.234419 27307 consensus_queue.cc:260] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.236311 27307 ts_tablet_manager.cc:1434] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:58.237382 27307 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.252103 27307 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.253090 27307 tablet_bootstrap.cc:492] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.253814 27307 ts_tablet_manager.cc:1403] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.003s
I20260709 12:28:58.257515 27307 raft_consensus.cc:359] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.258298 27307 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.259478 27307 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.261652 27307 ts_tablet_manager.cc:1434] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:28:58.262488 27307 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.281315 27307 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.282085 27307 tablet_bootstrap.cc:492] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.282737 27307 ts_tablet_manager.cc:1403] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:28:58.284725 27307 raft_consensus.cc:359] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.285348 27307 raft_consensus.cc:740] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.286048 27307 consensus_queue.cc:260] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.288239 27307 ts_tablet_manager.cc:1434] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:58.289395 27307 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.293392 27346 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.304315 27307 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.305696 27307 tablet_bootstrap.cc:492] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.306382 27307 ts_tablet_manager.cc:1403] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:28:58.308914 27307 raft_consensus.cc:359] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.309603 27307 raft_consensus.cc:740] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.310247 27307 consensus_queue.cc:260] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.312356 27307 ts_tablet_manager.cc:1434] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:58.313127 27307 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.325671 27307 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.326375 27307 tablet_bootstrap.cc:492] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.326954 27307 ts_tablet_manager.cc:1403] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:28:58.328689 27307 raft_consensus.cc:359] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.329159 27307 raft_consensus.cc:740] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.329638 27307 consensus_queue.cc:260] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.331532 27307 ts_tablet_manager.cc:1434] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:58.332973 27307 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.334764 27346 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.344218 27349 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.348793 27307 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.349715 27307 tablet_bootstrap.cc:492] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.350270 27307 ts_tablet_manager.cc:1403] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:28:58.352412 27307 raft_consensus.cc:359] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.353003 27307 raft_consensus.cc:740] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.353672 27307 consensus_queue.cc:260] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.356185 27307 ts_tablet_manager.cc:1434] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:58.357039 27307 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.381126 27307 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.382382 27307 tablet_bootstrap.cc:492] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.383160 27307 ts_tablet_manager.cc:1403] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 12:28:58.385442 27307 raft_consensus.cc:359] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.386101 27307 raft_consensus.cc:740] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.386808 27307 consensus_queue.cc:260] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:28:58.388939 27307 ts_tablet_manager.cc:1434] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:58.389837 27307 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.403918 27349 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.414316 27307 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.415479 27307 tablet_bootstrap.cc:492] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.416148 27307 ts_tablet_manager.cc:1403] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 12:28:58.418702 27307 raft_consensus.cc:359] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.419417 27307 raft_consensus.cc:740] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.420122 27307 consensus_queue.cc:260] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.422397 27307 ts_tablet_manager.cc:1434] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:58.423767 27307 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.440310 27307 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.441085 27307 tablet_bootstrap.cc:492] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.441629 27307 ts_tablet_manager.cc:1403] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:28:58.443497 27307 raft_consensus.cc:359] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.443969 27307 raft_consensus.cc:740] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.444547 27307 consensus_queue.cc:260] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.445961 27307 ts_tablet_manager.cc:1434] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:58.446861 27307 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.459631 27307 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.460356 27307 tablet_bootstrap.cc:492] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.460970 27307 ts_tablet_manager.cc:1403] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:28:58.462863 27307 raft_consensus.cc:359] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.463356 27307 raft_consensus.cc:740] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.463893 27307 consensus_queue.cc:260] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:28:58.466276 27307 ts_tablet_manager.cc:1434] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:58.467551 27307 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap starting.
I20260709 12:28:58.482913 27307 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:58.483798 27307 tablet_bootstrap.cc:492] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Bootstrap complete.
I20260709 12:28:58.484476 27307 ts_tablet_manager.cc:1403] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:28:58.486825 27307 raft_consensus.cc:359] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.487478 27307 raft_consensus.cc:740] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.488142 27307 consensus_queue.cc:260] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:28:58.490201 27307 ts_tablet_manager.cc:1434] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:58.599907 27349 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.852274 27346 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.907295 27346 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.911897 27349 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:04.777714 27515 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.778800 27515 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:04.784121 27516 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.784874 27516 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:04.787644 27516 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:04.788130 27516 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.788575 27516 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:04.790864 27516 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:04.782291 27515 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:04.822140 27515 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.822723 27515 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:04.824836 27515 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:04.831568 27520 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:04.832341 27520 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:04.836833 27520 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:04.836592 27513 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:04.838862 27513 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:04.845039 27513 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:04.845398 27526 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:04.846907 27526 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:04.850998 27526 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:04.852334 27515 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.881901 27527 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.882679 27527 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:04.883064 27529 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.883661 27529 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:04.871402 27515 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:04.888293 27532 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.889117 27532 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:04.891251 27515 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:04.899197 27515 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.899784 27515 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:04.900264 27527 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:04.901649 27515 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:04.904244 27530 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.904969 27530 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:04.907368 27530 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:04.903028 27525 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.903407 27520 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.902552 27527 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.903375 27529 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:04.942880 27532 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:04.939072 27515 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.943874 27530 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.944304 27516 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:04.961592 27517 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.962271 27517 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:04.945510 27522 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.957721 27514 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.962654 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:04.957772 27530 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:04.972625 27516 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:04.944687 27527 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:04.958299 27532 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:04.979809 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:04.973229 27530 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:04.943886 27520 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:04.979575 27514 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:04.956454 27515 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.001497 27516 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:04.985631 27533 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.002519 27514 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.003162 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.003320 27517 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.002915 27533 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.005514 27533 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.006383 27514 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.006714 27522 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.007064 27514 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.008257 27527 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.006644 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.009007 27514 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:04.952162 27525 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:05.025090 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 54417.3us
I20260709 12:29:05.030055 27538 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.027029 27547 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.054422 27538 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.054481 27547 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.056864 27538 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.056895 27547 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.057444 27538 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.001499 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.033654 27516 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.058036 27538 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.033205 27529 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.009029 27522 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.032687 27517 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.014197 27532 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.091964 27547 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.102267 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.095127 27516 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.103859 27535 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.105118 27535 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.105720 27521 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.106330 27521 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.098426 27536 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.107422 27535 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.108526 27521 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.105752 27533 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.098563 27537 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.110867 27533 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.111311 27537 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.101133 27522 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.112885 27522 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.113171 27533 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:05.109661 26552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.015s	sys 0.002s
W20260709 12:29:05.114061 26552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.015s	sys 0.002s
I20260709 12:29:05.109012 27347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42142 (request call id 198) took 1451 ms. Trace:
I20260709 12:29:05.113623 27537 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.103055 27547 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.116314 27532 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.122001 27546 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.115324 27347 rpcz_store.cc:276] 0709 12:29:03.657340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.108075 (+1450735us) service_pool.cc:224] Handling call
0709 12:29:05.108404 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:05.108587 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:05.108614 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:05.108659 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:05.108688 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:05.108736 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:05.108844 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:05.124930 27515 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.125650 27546 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.099704 27529 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.107576 27536 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.129113 27517 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.137367 27536 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.137871 27517 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.139763 27516 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.140055 27530 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.140718 27530 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.141170 27522 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.143703 27539 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.144366 27530 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.144269 27539 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.110286 27525 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.155265 27513 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.155939 27513 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.159891 27548 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.160372 27548 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.161903 27548 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.158303 27513 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.124971 27538 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.125211 27551 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.168325 27534 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.169096 27547 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.168893 27534 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.169378 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:05.170230 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 51175.6us
I20260709 12:29:05.153043 27535 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.154102 27532 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.153923 27536 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.169970 26513 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:05.163208 27531 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.166072 27530 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.166281 27515 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.167953 27517 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.169761 27541 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.180869 27526 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.172210 27527 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.181339 27542 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.177527 27516 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.174575 27521 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.180058 27520 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.187248 27527 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.188586 27517 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.201386 27554 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.193495 27537 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.198444 27516 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.202965 27533 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.197199 27521 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.203665 27533 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.204512 27547 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.205442 27521 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.182205 27532 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.208514 27532 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.203015 27537 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.208455 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.178472 27535 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.182333 27551 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.182695 27536 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.207844 27554 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.191573 27542 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.212519 27535 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.213217 27533 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.179917 27531 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.188568 27541 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.198184 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.206296 27539 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.205211 27547 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.222746 27563 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.193778 27538 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.214284 27548 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.198568 27550 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.229751 27562 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.198362 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.194249 27525 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.198216 27552 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.180372 27530 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.202018 27527 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.190981 27526 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.226012 27564 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.237494 27555 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.237679 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.238348 27522 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.210187 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.191484 27515 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.231465 27533 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.246533 27527 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.242057 27548 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.249035 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.257838 26551 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:05.257432 27533 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.246201 26507 raft_consensus.cc:2468] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:05.259975 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.255728 27522 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.273903 27522 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.267879 27517 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.275002 27517 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.275385 27537 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.275583 27517 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.276060 27537 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.276625 27537 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.277922 27517 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.240839 27563 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.270012 27533 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.271237 27561 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.271481 27542 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.250643 27525 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.267598 27527 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.247263 27562 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.278576 27517 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.283195 27562 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.283327 27517 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.285557 27530 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.248044 27550 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.286484 27537 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.253857 27546 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.248278 27538 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.287099 27516 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.281153 27525 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.292574 27515 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:05.287041 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 53353.5us
I20260709 12:29:05.259087 27514 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.280398 27563 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.282943 27527 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.294341 27538 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.294502 27514 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.295454 27549 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.296080 27549 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.296777 27514 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:29:05.298988 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 59967.6us
I20260709 12:29:05.299850 27547 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.300488 27547 raft_consensus.cc:2804] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:05.300840 27547 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.301203 26551 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:05.303399 27522 raft_consensus.cc:2804] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:05.303805 27522 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.304222 27522 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.305390 27534 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.307037 27529 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.309094 27515 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.247330 27552 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.309705 27515 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.313073 27515 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.313167 27552 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.313585 27515 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.314245 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.314586 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.314937 26510 raft_consensus.cc:2468] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:05.255158 27555 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.314232 27515 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.318451 27531 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.320031 27558 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.318557 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.319571 26551 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:05.320705 27558 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.319667 27515 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.322818 27514 raft_consensus.cc:2804] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:05.323241 27514 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.284269 27526 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.323438 27554 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.323599 27514 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.279287 27561 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.325338 27559 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.281363 27560 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.258219 27564 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.325984 27559 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.319574 27536 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.314682 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.328425 27559 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.328853 26505 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:05.281215 27541 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.292661 27548 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.331347 27550 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.322737 27551 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.317265 27555 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.298273 27549 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:05.343387 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 149346us
I20260709 12:29:05.345372 26551 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:05.301177 27547 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.286563 27517 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.356050 27549 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:05.357084 27549 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.326040 27560 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.365458 27560 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.366688 27564 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.368569 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.368918 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.369320 27349 raft_consensus.cc:2468] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.370180 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.370712 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.359294 27561 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.362651 27558 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.372504 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.371543 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.376878 27514 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.379385 27522 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.381640 27522 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.382470 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:05.383978 27514 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.374286 27347 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.384636 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:05.372891 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.374132 27560 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.387698 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.388069 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.372396 27350 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:05.391114 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.391271 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.391923 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.393047 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.393651 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.394145 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.371918 27549 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:05.406435 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.416054 26580 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:05.409860 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.394873 27517 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.419571 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.420235 26580 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
W20260709 12:29:05.422960 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 74379.5us
I20260709 12:29:05.411216 27548 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.425920 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.515544 26582 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:05.415424 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.426841 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.519204 27347 raft_consensus.cc:2468] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.419806 27517 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.430533 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.402737 27560 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.390878 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.520666 27571 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.521230 27571 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.415372 27572 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.418138 27354 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:05.510659 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.419126 27526 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.511355 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.512603 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.511128 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.477447 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.513820 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.520522 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.537175 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.520973 27346 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.511154 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.415838 27349 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.538677 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.538839 27538 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.541489 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.548296 27515 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.542215 27571 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.542512 27560 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.521171 27565 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.542677 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.542946 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.511241 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.513486 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.510792 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.549724 27550 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.576323 27517 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.549975 27350 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:05.510972 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.543845 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.557116 27538 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.577780 26582 raft_consensus.cc:2468] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:05.545396 27347 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.537412 27548 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.579136 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.579231 27538 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.553455 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.548234 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.576577 27565 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.580139 27354 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:05.581072 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.581456 27548 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.581681 27354 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:05.581737 27565 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.554404 26578 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:05.575707 27571 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.552501 27515 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.584312 27346 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:05.559001 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.539117 27572 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.591774 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.555979 27551 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.576994 27550 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.559103 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.590408 27565 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.576220 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.589350 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.593250 26579 raft_consensus.cc:2468] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:05.589963 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.592121 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.547791 27526 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.590683 27571 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.595711 26625 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:05.597929 27346 raft_consensus.cc:2468] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:05.588539 27348 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:05.587766 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.621776 27345 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.621683 27547 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.622506 26580 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:05.622912 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.600193 27349 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.598687 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.602401 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.625756 27526 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:05.626343 27345 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:05.608486 27351 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.618909 27347 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:05.629698 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.630434 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.630887 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.631588 27347 raft_consensus.cc:2468] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:05.632488 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.633065 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.636775 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.605195 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.606671 27551 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.600802 27565 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:05.592175 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.641180 27354 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:05.602392 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.641357 27549 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:05.642361 27565 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.638393 26551 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:05.608135 27550 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.619866 27570 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:05.619987 27568 raft_consensus.cc:2804] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:05.620150 26625 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:05.644332 27549 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:05.644770 27548 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:05.645161 26625 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:05.645242 27548 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.645386 27559 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:05.645757 27548 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:05.645994 27559 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.646242 27529 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:05.645707 27568 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:05.646733 27529 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.620493 27571 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.646564 26625 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:05.647300 27529 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:05.648613 27572 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:05.591745 27352 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:05.638938 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:05.640413 27551 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.782501 27570 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.644847 26551 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:05.649809 26625 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:05.602645 27515 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:05.648792 27554 raft_consensus.cc:2804] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:05.664398 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.650229 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.647238 27568 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.780663 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46320 (request call id 1) took 1131 ms. Trace:
I20260709 12:29:06.781117 26509 rpcz_store.cc:276] 0709 12:29:05.649652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.649987 (+   335us) service_pool.cc:224] Handling call
0709 12:29:06.780548 (+1130561us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:05.646518 27559 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.844970 27554 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:06.786989 27554 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:05.855436 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 205667us
I20260709 12:29:05.651435 27547 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:29:05.846500 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 201768us
I20260709 12:29:05.850368 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.851738 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.862968 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:07.833580 26579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52816 (request call id 22) took 1982 ms (client timeout 1933 ms). Trace:
W20260709 12:29:07.834146 26581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60298 (request call id 414) took 1971 ms (client timeout 1602 ms). Trace:
W20260709 12:29:07.834628 26581 rpcz_store.cc:269] 0709 12:29:05.862453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.862587 (+   134us) service_pool.cc:224] Handling call
0709 12:29:07.834077 (+1971490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.835786 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:07.836810 26581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60298 (request call id 415) took 1973 ms (client timeout 2224 ms). Trace:
W20260709 12:29:07.837177 26581 rpcz_store.cc:269] 0709 12:29:05.863314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.835482 (+1972168us) service_pool.cc:224] Handling call
0709 12:29:07.836718 (+  1236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.838163 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.861443 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.852389 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.852972 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:05.850131 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.872550 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:05.851753 26586 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:05.848147 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:07.877730 26586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52816 (request call id 11) took 2363 ms (client timeout 1533 ms). Trace:
I20260709 12:29:06.638545 27578 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:06.642690 27579 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:06.791208 26625 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:06.653640 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.650900 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.654691 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.658509 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.652303 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.650352 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.653415 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:07.884037 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 4) took 1231 ms. Trace:
I20260709 12:29:07.884387 26658 rpcz_store.cc:276] 0709 12:29:06.652815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.652968 (+   153us) service_pool.cc:224] Handling call
0709 12:29:07.883972 (+1231004us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.885576 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.656240 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.654769 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.656980 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:06.812628 27580 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:05.937361 27302 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:07.888192 27580 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:06.636958 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:06.633936 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:06.643568 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:05.928138 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:07.891283 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 2.0315e+06us
I20260709 12:29:07.891283 27349 raft_consensus.cc:2468] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:07.891971 27352 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
W20260709 12:29:07.892102 27349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42140 (request call id 334) took 1253 ms (client timeout 1614 ms). Trace:
W20260709 12:29:07.892526 27349 rpcz_store.cc:269] 0709 12:29:06.642457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.643297 (+   840us) service_pool.cc:224] Handling call
0709 12:29:07.892021 (+1248724us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:29:07.892936 27302 connection.cc:256] RPC call timeout handler was delayed by -1.4955085769997822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:29:07.893374 27302 connection.cc:256] RPC call timeout handler was delayed by -1.379723722000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 12:29:07.892545 27352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42142 (request call id 221) took 1975 ms (client timeout 1528 ms). Trace:
W20260709 12:29:07.893682 27302 connection.cc:256] RPC call timeout handler was delayed by -1.3497085769995465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260709 12:29:06.639242 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:05.884634 27377 debug-util.cc:398] Leaking SignalData structure 0x7b080032d660 after lost signal to thread 20920
W20260709 12:29:07.897486 27377 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3860 after lost signal to thread 26370
I20260709 12:29:05.913630 27515 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.900204 27515 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:07.901717 27377 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1580 after lost signal to thread 27380
I20260709 12:29:05.860746 27526 raft_consensus.cc:2804] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:05.915827 27529 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:05.856938 27534 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:05.914722 27548 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:06.802341 27554 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:07.906978 27529 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:06.848485 27559 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:07.908154 27548 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:07.908699 27554 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:07.908944 26587 raft_consensus.cc:1240] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:07.909478 27559 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:06.853749 27568 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:05.957402 27570 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:07.912863 26587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60298 (request call id 413) took 2051 ms. Trace:
I20260709 12:29:07.679407 27584 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.683753 27582 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:07.684791 27583 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.913166 27568 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:07.754446 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.755052 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.756513 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.913287 26587 rpcz_store.cc:276] 0709 12:29:05.861579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.861788 (+   209us) service_pool.cc:224] Handling call
0709 12:29:05.862080 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:07.909380 (+2047300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:07.911699 (+  2319us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b540051de54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:07.912771 (+  1072us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4706766208}
I20260709 12:29:07.913580 27582 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:07.757297 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.915028 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.915661 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.915827 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.758224 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.916177 27582 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:07.758519 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.917003 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.913841 27583 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:07.917657 26505 raft_consensus.cc:2468] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:07.918125 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.759287 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.919320 27583 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:07.764052 27585 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
W20260709 12:29:07.771857 27303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.009s	sys 0.005s
I20260709 12:29:07.772047 27586 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.773692 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.920348 27586 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:07.775204 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.920871 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.921252 26512 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:07.921727 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.922079 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.806324 27348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42140 (request call id 322) took 1187 ms. Trace:
W20260709 12:29:07.830945 26550 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.528s (SENT) [suppressed 71 similar messages]
W20260709 12:29:07.923024 27303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.010s	sys 0.005s
I20260709 12:29:07.832497 26580 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
W20260709 12:29:07.924461 26580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52816 (request call id 21) took 2074 ms (client timeout 1695 ms). Trace:
W20260709 12:29:07.924810 26580 rpcz_store.cc:269] 0709 12:29:05.849961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.850135 (+   174us) service_pool.cc:224] Handling call
0709 12:29:07.924380 (+2074245us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:29:07.839635 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52816 (request call id 25) took 1986 ms (client timeout 1829 ms). Trace:
I20260709 12:29:07.840018 26584 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
W20260709 12:29:07.833992 26579 rpcz_store.cc:269] 0709 12:29:05.851303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.851471 (+   168us) service_pool.cc:224] Handling call
0709 12:29:07.833483 (+1982012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.844647 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.861567 26551 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
W20260709 12:29:07.869310 26477 connection.cc:256] RPC call timeout handler was delayed by -1.0504580340002576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 12:29:07.869307 27589 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.914987 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.927138 27570 raft_consensus.cc:2804] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:07.927579 27570 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.927287 27589 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:07.869927 27587 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.870745 26582 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:07.925971 27348 rpcz_store.cc:276] 0709 12:29:06.619391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.619893 (+   502us) service_pool.cc:224] Handling call
0709 12:29:07.805571 (+1185678us) spinlock_profiling.cc:243] Waited 977 us on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1eee 000000000036eb39 00007ff1916551e0 00007ff19171e0c4 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:07.805747 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:07.805934 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:07.805963 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:07.806013 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:07.806043 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:07.806100 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:07.806235 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247936}
I20260709 12:29:07.928004 27570 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:07.925956 26583 rpcz_store.cc:269] 0709 12:29:05.855252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.861066 (+  5814us) service_pool.cc:224] Handling call
0709 12:29:07.839565 (+1978499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.916848 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.928822 27587 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:07.878057 26586 rpcz_store.cc:269] 0709 12:29:05.514494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.514636 (+   142us) service_pool.cc:224] Handling call
0709 12:29:07.877518 (+2362882us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400444154. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:07.877626 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704608512}
I20260709 12:29:07.929210 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.929435 26504 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:07.878554 27579 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:07.926867 26584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52816 (request call id 23) took 2075 ms (client timeout 2122 ms). Trace:
I20260709 12:29:07.878418 27578 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:07.925745 27586 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:07.880326 27536 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.880712 26653 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:07.881089 26654 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:07.881630 26652 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:07.930956 27536 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:07.931296 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 5) took 1277 ms. Trace:
I20260709 12:29:07.882347 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 9) took 1224 ms. Trace:
W20260709 12:29:07.886354 26658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 14) took 1225 ms (client timeout 1533 ms). Trace:
I20260709 12:29:07.919334 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:07.880205 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 1.08904e+06us
W20260709 12:29:07.931859 26658 rpcz_store.cc:269] 0709 12:29:06.661365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.885259 (+1223894us) service_pool.cc:224] Handling call
0709 12:29:07.886287 (+  1028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.888067 26661 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:07.931387 27536 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.932592 26625 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:07.933225 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1) took 1283 ms. Trace:
I20260709 12:29:07.933578 26654 rpcz_store.cc:276] 0709 12:29:06.650374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.650541 (+   167us) service_pool.cc:224] Handling call
0709 12:29:07.933167 (+1282626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.934173 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:07.934672 26655 rpcz_store.cc:276] 0709 12:29:06.658051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.658215 (+   164us) service_pool.cc:224] Handling call
0709 12:29:07.882245 (+1224030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.935709 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:07.932984 26661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 8) took 1276 ms. Trace:
I20260709 12:29:07.936169 27570 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:07.936420 26661 rpcz_store.cc:276] 0709 12:29:06.656445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.656595 (+   150us) service_pool.cc:224] Handling call
0709 12:29:07.932923 (+1276328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.936949 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.937330 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:07.930104 26584 rpcz_store.cc:269] 0709 12:29:05.851968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.852143 (+   175us) service_pool.cc:224] Handling call
0709 12:29:07.926812 (+2074669us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:29:07.938793 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 77313.4us
I20260709 12:29:07.938865 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.927773 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.939191 26652 rpcz_store.cc:276] 0709 12:29:06.653501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.654185 (+   684us) service_pool.cc:224] Handling call
0709 12:29:07.931235 (+1277050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944}
I20260709 12:29:07.940407 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.940757 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:07.890422 27580 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:07.890730 27350 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:06.636153 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:07.893862 27352 rpcz_store.cc:269] 0709 12:29:05.926691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.927770 (+  1079us) service_pool.cc:224] Handling call
0709 12:29:07.892479 (+1964709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.894734 27354 raft_consensus.cc:2468] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:07.950996 27353 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:07.951445 27354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42140 (request call id 333) took 1312 ms. Trace:
I20260709 12:29:07.902063 27515 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:07.904688 27526 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.906024 27534 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.906024 26656 raft_consensus.cc:2393] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:07.667949 27581 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:07.913558 27584 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:07.951949 27354 rpcz_store.cc:276] 0709 12:29:06.638673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.638787 (+   114us) service_pool.cc:224] Handling call
0709 12:29:07.951380 (+1312593us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:29:07.895221 27302 connection.cc:256] RPC call timeout handler was delayed by -1.3460565959999258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 12:29:07.919881 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:07.781297 26476 connection.cc:256] RPC call timeout handler was delayed by -1.115922904999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 12:29:07.954032 26476 connection.cc:256] RPC call timeout handler was delayed by -1.104222904999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 12:29:07.919992 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.922549 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:07.953673 27302 connection.cc:256] RPC call timeout handler was delayed by -1.3417349649998869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 12:29:07.954649 27583 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.916229 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.920006 27585 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:07.928341 26582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52816 (request call id 24) took 2075 ms (client timeout 2049 ms). Trace:
W20260709 12:29:07.926906 26477 connection.cc:256] RPC call timeout handler was delayed by -1.0027580340001805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:29:07.954872 27582 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:07.955330 27583 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:07.954867 27581 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:07.956779 27585 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:07.957542 27583 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:07.957955 27581 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:29:07.954674 26476 connection.cc:256] RPC call timeout handler was delayed by -1.0565229049998379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:29:07.919430 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.941005 26581 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:07.960477 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.961050 26581 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
W20260709 12:29:07.955435 26582 rpcz_store.cc:269] 0709 12:29:05.852563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.852734 (+   171us) service_pool.cc:224] Handling call
0709 12:29:07.928280 (+2075546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.961823 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.962097 27594 consensus_queue.cc:1059] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:07.963182 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.962258 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.964466 26582 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:07.965338 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.966024 26582 raft_consensus.cc:2393] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 4: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:07.941516 27346 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:07.925702 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.942770 26551 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:07.966938 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:07.939491 26653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 3) took 1287 ms (client timeout 1650 ms). Trace:
W20260709 12:29:07.967514 26653 rpcz_store.cc:269] 0709 12:29:06.652294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.652468 (+   174us) service_pool.cc:224] Handling call
0709 12:29:07.939425 (+1286957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.968068 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.928398 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.938300 27570 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:07.945066 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.945513 27559 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.969365 27570 raft_consensus.cc:2804] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.969611 27559 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.938091 26661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 10) took 1278 ms. Trace:
I20260709 12:29:07.969722 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.970055 26661 rpcz_store.cc:276] 0709 12:29:06.659468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.937110 (+1277642us) service_pool.cc:224] Handling call
0709 12:29:07.938020 (+   910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.944868 26511 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:07.968842 26551 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:07.970995 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:07.971647 26661 raft_consensus.cc:2393] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:07.942866 27301 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:07.968889 26580 raft_consensus.cc:2393] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:07.972440 27570 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.944116 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.935010 26625 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:07.972832 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.942698 27536 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:07.973793 26625 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:07.974261 26659 raft_consensus.cc:2393] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:07.974607 26625 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:07.932101 27578 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:07.974933 27536 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:07.975512 27536 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:07.975832 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.975929 27536 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.976756 27536 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:07.976996 26584 raft_consensus.cc:1240] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
W20260709 12:29:07.872934 26578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52816 (request call id 20) took 2023 ms (client timeout 1660 ms). Trace:
I20260709 12:29:07.947155 27568 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:29:07.975409 26659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 7) took 1319 ms (client timeout 1534 ms). Trace:
I20260709 12:29:07.938074 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.976030 26583 raft_consensus.cc:2468] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:07.972090 26551 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:07.980448 27515 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.980995 27515 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:07.981324 27585 raft_consensus.cc:2804] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.975342 27578 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:07.975670 27529 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:07.981459 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:07.982060 27529 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.982440 26511 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:07.982487 27529 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:07.972851 27570 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:07.949018 27350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42140 (request call id 327) took 1315 ms (client timeout 1750 ms). Trace:
I20260709 12:29:07.979228 27568 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.978839 27559 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:07.983700 27350 rpcz_store.cc:269] 0709 12:29:06.633432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.633537 (+   105us) service_pool.cc:224] Handling call
0709 12:29:07.948958 (+1315421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:07.932916 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:07.972867 27301 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:07.985467 26658 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:07.985945 27301 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:07.986091 26658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 24) took 1320 ms (client timeout 1591 ms). Trace:
I20260709 12:29:07.986799 27301 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:07.987427 27580 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.987814 27580 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:07.936344 26655 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:07.988162 27580 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:07.988581 26655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 22) took 1323 ms (client timeout 1660 ms). Trace:
I20260709 12:29:07.949838 27587 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:07.950260 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 119448us
I20260709 12:29:07.955947 27582 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:07.989910 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:07.990321 26506 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:07.990556 27354 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:07.945887 27589 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:07.954402 27584 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:07.996019 27541 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:07.996480 27541 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:07.996845 27541 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:07.979045 26659 rpcz_store.cc:269] 0709 12:29:06.655749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.655899 (+   150us) service_pool.cc:224] Handling call
0709 12:29:07.975201 (+1319302us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b5400810954. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:07.975343 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199522688}
I20260709 12:29:07.952183 27526 raft_consensus.cc:3060] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.953536 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 2) took 1301 ms. Trace:
I20260709 12:29:07.917160 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:07.934608 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:07.877946 26585 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:08.004776 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:08.005405 26585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52816 (request call id 19) took 2157 ms (client timeout 1875 ms). Trace:
I20260709 12:29:08.005479 27548 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:29:08.005826 26585 rpcz_store.cc:269] 0709 12:29:05.847707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.847843 (+   136us) service_pool.cc:224] Handling call
0709 12:29:08.005328 (+2157485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.006808 27548 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.007268 27548 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:07.952736 27534 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:07.963867 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:08.003252 26656 rpcz_store.cc:276] 0709 12:29:06.651786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.651925 (+   139us) service_pool.cc:224] Handling call
0709 12:29:07.953346 (+1301421us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5400248454. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:07.953476 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53357440}
I20260709 12:29:07.887671 26660 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:08.011837 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:07.968014 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:07.966949 27346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42140 (request call id 331) took 1330 ms. Trace:
I20260709 12:29:08.012496 26656 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:08.012820 26660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 6) took 1358 ms. Trace:
I20260709 12:29:08.013056 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 23) took 1347 ms. Trace:
I20260709 12:29:08.013301 26660 rpcz_store.cc:276] 0709 12:29:06.654065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.654243 (+   178us) service_pool.cc:224] Handling call
0709 12:29:08.012762 (+1358519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26880}
I20260709 12:29:07.981922 27585 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:07.983741 27578 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.012810 27346 rpcz_store.cc:276] 0709 12:29:06.636019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.636712 (+   693us) service_pool.cc:224] Handling call
0709 12:29:07.966795 (+1330083us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b540000a354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:07.966887 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118446464}
I20260709 12:29:07.972074 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:08.014147 27585 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.012555 26582 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:08.016034 26656 rpcz_store.cc:276] 0709 12:29:06.665234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.011582 (+1346348us) service_pool.cc:224] Handling call
0709 12:29:08.013003 (+  1421us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:29:07.986542 26658 rpcz_store.cc:269] 0709 12:29:06.665497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.932648 (+1267151us) service_pool.cc:224] Handling call
0709 12:29:07.986001 (+ 53353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.017380 27582 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:07.990733 27568 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.968565 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.018647 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 13) took 1357 ms. Trace:
I20260709 12:29:08.019052 26653 rpcz_store.cc:276] 0709 12:29:06.660912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.968294 (+1307382us) service_pool.cc:224] Handling call
0709 12:29:08.018562 (+ 50268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.019562 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.019953 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.020231 26656 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:08.020756 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 16) took 1357 ms. Trace:
I20260709 12:29:08.021195 26656 rpcz_store.cc:276] 0709 12:29:06.663001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.019161 (+1356160us) service_pool.cc:224] Handling call
0709 12:29:08.020699 (+  1538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.023556 27585 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.024627 26587 raft_consensus.cc:1240] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:08.027468 26587 raft_consensus.cc:1240] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:08.028481 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:08.029137 27346 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:08.018010 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 43494.2us
W20260709 12:29:07.989018 26655 rpcz_store.cc:269] 0709 12:29:06.664860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.935434 (+1270574us) service_pool.cc:224] Handling call
0709 12:29:07.988499 (+ 53065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.031440 26625 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:07.972057 26661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 15) took 1310 ms. Trace:
I20260709 12:29:08.033543 26661 rpcz_store.cc:276] 0709 12:29:06.661808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.970786 (+1308978us) service_pool.cc:224] Handling call
0709 12:29:07.972006 (+  1220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.022147 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.034548 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.017760 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.035953 26658 raft_consensus.cc:2393] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:08.036077 27585 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:08.036571 27554 raft_consensus.cc:2804] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.036995 27554 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.037375 27554 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.014312 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.039357 27548 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:08.040053 26660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 11) took 1380 ms. Trace:
I20260709 12:29:08.040378 26660 rpcz_store.cc:276] 0709 12:29:06.660003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.014092 (+1354089us) service_pool.cc:224] Handling call
0709 12:29:08.039970 (+ 25878us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:29:07.955045 27302 connection.cc:256] RPC call timeout handler was delayed by -1.3390500579998843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260709 12:29:08.041582 27548 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:08.015218 27578 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.087549 26585 raft_consensus.cc:1240] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:08.088008 27598 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:08.089313 27559 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:07.978253 26578 rpcz_store.cc:269] 0709 12:29:05.849300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.849840 (+   540us) service_pool.cc:224] Handling call
0709 12:29:07.872858 (+2023018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.090797 26659 raft_consensus.cc:2393] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:08.091048 26511 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
W20260709 12:29:08.091801 26659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 12) took 1431 ms (client timeout 1890 ms). Trace:
W20260709 12:29:08.092231 26659 rpcz_store.cc:269] 0709 12:29:06.660457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.004481 (+1344024us) service_pool.cc:224] Handling call
0709 12:29:08.091588 (+ 87107us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b540075d5d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:08.091715 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195822336}
I20260709 12:29:08.088485 27598 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.094024 26551 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:08.037191 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
W20260709 12:29:08.041949 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 81109.5us
I20260709 12:29:08.094791 27584 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:08.095165 27559 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.095285 27584 raft_consensus.cc:697] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:08.042649 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 19) took 1378 ms. Trace:
W20260709 12:29:08.095988 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 64756.3us
I20260709 12:29:08.043704 26580 raft_consensus.cc:1240] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:08.036298 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:08.045831 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:07.948979 26652 raft_consensus.cc:2393] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
W20260709 12:29:08.101876 26652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 20) took 1437 ms (client timeout 1809 ms). Trace:
I20260709 12:29:08.098815 26658 rpcz_store.cc:276] 0709 12:29:06.663946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.017492 (+1353546us) service_pool.cc:224] Handling call
0709 12:29:08.042553 (+ 25061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.103631 26551 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.103998 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:08.104405 27585 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.104624 27350 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.104843 27585 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:08.105319 27585 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.105599 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
W20260709 12:29:07.951486 27353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42140 (request call id 330) took 1315 ms (client timeout 1702 ms). Trace:
I20260709 12:29:08.107674 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:08.102648 27584 consensus_queue.cc:237] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:07.947054 27579 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:08.046806 27581 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:08.047333 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:08.031585 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:08.108098 27353 rpcz_store.cc:269] 0709 12:29:06.635711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.635850 (+   139us) service_pool.cc:224] Handling call
0709 12:29:07.951429 (+1315579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.117543 26551 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:08.048159 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:08.048899 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:08.118937 27586 raft_consensus.cc:2749] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:08.119159 27585 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.119705 26507 raft_consensus.cc:2468] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:08.119319 27352 raft_consensus.cc:2468] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:08.121183 26551 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:08.121371 27585 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:08.002754 27515 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:08.051050 26581 raft_consensus.cc:2393] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:08.121948 27586 raft_consensus.cc:2749] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:08.122721 26582 raft_consensus.cc:1240] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:08.051643 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 18) took 1388 ms. Trace:
I20260709 12:29:08.123113 26551 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:08.123502 26653 rpcz_store.cc:276] 0709 12:29:06.663604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.019717 (+1356113us) service_pool.cc:224] Handling call
0709 12:29:08.051579 (+ 31862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.057355 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:08.059942 27536 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.124893 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:08.125487 27352 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.125840 27536 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.058228 27570 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:08.060683 27568 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.063647 27534 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.064733 27526 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:07.890031 27592 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:29:08.071270 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 84532.5us
I20260709 12:29:08.134161 26657 raft_consensus.cc:2393] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:08.126544 27581 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:08.133464 27526 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.133795 27592 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:08.135186 27301 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:08.054242 27346 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:08.135509 27592 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.130133 27570 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.136209 27585 raft_consensus.cc:2804] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.066061 27587 raft_consensus.cc:3055] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:08.136641 27585 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:08.136713 27587 raft_consensus.cc:740] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
W20260709 12:29:08.043028 27302 connection.cc:256] RPC call timeout handler was delayed by -1.3056085769994752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 12:29:08.137133 27585 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:08.137446 27302 connection.cc:256] RPC call timeout handler was delayed by -1.284160466999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 12:29:08.100203 27354 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:08.137754 27515 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.137816 27587 consensus_queue.cc:260] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:08.137794 27302 connection.cc:256] RPC call timeout handler was delayed by -1.2803565960002743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 12:29:08.139115 27302 connection.cc:256] RPC call timeout handler was delayed by -1.2328023969998867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:29:08.139344 27587 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:08.139401 27302 connection.cc:256] RPC call timeout handler was delayed by -1.2328023969998867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:29:08.139892 27302 connection.cc:256] RPC call timeout handler was delayed by -1.2031023969998387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 12:29:08.140195 27302 connection.cc:256] RPC call timeout handler was delayed by -1.1572349650000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:29:08.140455 27302 connection.cc:256] RPC call timeout handler was delayed by -1.0699349649999021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 12:29:08.141302 27302 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:08.142275 27579 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:08.102278 26652 rpcz_store.cc:269] 0709 12:29:06.664263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.940490 (+1276227us) service_pool.cc:224] Handling call
0709 12:29:08.101795 (+161305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:08.134850 27581 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.143639 27302 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:08.139484 27301 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.144759 27579 raft_consensus.cc:2749] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:08.126641 26551 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.130582 26656 raft_consensus.cc:2393] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:08.130112 27568 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.131590 26584 raft_consensus.cc:1240] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:08.133360 27534 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:08.080796 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 114971us
I20260709 12:29:08.159803 27579 raft_consensus.cc:2804] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.160238 27579 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.136749 26583 raft_consensus.cc:1240] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:08.161927 27352 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:08.159462 27529 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.094381 27598 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.098573 26625 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:08.148861 26657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 0) took 1499 ms (client timeout 1994 ms). Trace:
I20260709 12:29:08.166293 26654 raft_consensus.cc:2393] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
W20260709 12:29:08.166549 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 68061.1us
I20260709 12:29:08.167239 26625 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.150539 27302 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.153049 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:08.154479 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:08.158669 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 17) took 1495 ms. Trace:
I20260709 12:29:08.160598 27579 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:08.166195 26657 rpcz_store.cc:269] 0709 12:29:06.649718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.649893 (+   175us) service_pool.cc:224] Handling call
0709 12:29:08.148660 (+1498767us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001efd54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:08.148797 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576910592}
W20260709 12:29:08.184849 26654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 21) took 1520 ms (client timeout 1638 ms). Trace:
W20260709 12:29:08.185451 26654 rpcz_store.cc:269] 0709 12:29:06.664566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.934340 (+1269774us) service_pool.cc:224] Handling call
0709 12:29:08.184651 (+250311us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003c0854. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:08.184788 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367170816}
I20260709 12:29:08.165917 27570 raft_consensus.cc:2804] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.187548 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:08.202730 27570 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.185101 27568 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.183516 26656 rpcz_store.cc:276] 0709 12:29:06.663322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.021868 (+1358546us) service_pool.cc:224] Handling call
0709 12:29:08.158442 (+136574us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b540075e9d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:08.158582 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219464576}
I20260709 12:29:08.191084 27350 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:08.187435 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:08.195662 27529 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.197461 27541 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.209990 27541 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:08.198740 27515 raft_consensus.cc:2749] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:08.210908 27515 raft_consensus.cc:2804] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.211264 27515 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:08.211710 27515 raft_consensus.cc:3060] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.211448 27554 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.213397 27554 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.205988 27570 raft_consensus.cc:3060] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.197453 27579 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.164780 27578 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.202874 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:08.167913 26551 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
W20260709 12:29:08.219503 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 51665.3us
I20260709 12:29:08.204906 26625 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:08.203838 27302 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:08.204979 26477 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:08.181459 27534 raft_consensus.cc:2804] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:08.221112 27529 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.221170 27592 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.221652 27529 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.219055 27354 raft_consensus.cc:3060] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.221362 26625 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.222481 27529 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.205670 27568 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.223088 27568 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.223184 26625 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.220260 26551 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.145428 27580 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.218755 27579 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.221926 27534 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:08.226522 27534 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.227788 27580 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:08.207383 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 67988.4us
I20260709 12:29:08.218837 27578 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.229341 27301 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.224181 27548 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.230182 27578 raft_consensus.cc:2804] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.229856 27515 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:08.224768 26551 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.241670 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:08.242861 26583 raft_consensus.cc:2393] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:08.230648 27578 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.230644 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.243997 27578 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.231336 27541 raft_consensus.cc:2804] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.244915 27541 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.245381 27541 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.243641 27585 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:08.243122 26551 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.247658 27590 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:08.248178 27590 raft_consensus.cc:697] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:08.248301 27526 raft_consensus.cc:2804] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:08.248860 27526 raft_consensus.cc:697] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:08.249048 27590 consensus_queue.cc:237] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.252707 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:08.252820 26551 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:08.231482 27301 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.225757 27302 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:08.232295 27554 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:08.255339 27554 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.255435 27602 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:08.230121 27548 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:08.221298 27586 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:08.256345 27586 raft_consensus.cc:697] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:08.257223 27586 consensus_queue.cc:237] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:08.257892 27534 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.235700 27581 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.239002 27601 raft_consensus.cc:2804] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.238814 27529 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.239931 27354 raft_consensus.cc:2468] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:08.241111 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.259198 27352 raft_consensus.cc:1240] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:08.267925 27351 raft_consensus.cc:1240] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:08.255766 27554 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.271569 27568 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.259707 27548 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.260103 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:08.272737 26510 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.273778 27568 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.274868 27579 raft_consensus.cc:2749] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:08.279996 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.280332 27515 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:08.255949 27301 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.281523 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.282301 26652 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:08.283165 27598 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.285565 27598 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.283202 27578 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.286285 27598 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:08.223912 27592 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:08.263078 27591 raft_consensus.cc:2749] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:08.281570 27301 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.264312 27570 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:08.287947 27578 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.255090 27585 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:08.288772 27570 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.258950 27526 consensus_queue.cc:237] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.292286 26657 raft_consensus.cc:1240] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:08.264385 27601 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:08.271978 27581 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:08.255879 27602 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:08.293589 27602 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.293095 27601 raft_consensus.cc:3060] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.265331 27580 raft_consensus.cc:2804] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:08.264766 27302 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:08.288722 27301 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:08.301592 26656 raft_consensus.cc:1240] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:08.303711 26510 raft_consensus.cc:2468] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:08.293385 27534 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:08.306897 27548 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:08.308604 26654 raft_consensus.cc:1240] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:08.309197 27548 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:08.310443 27302 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:08.309715 27592 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.312527 27302 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:08.300384 27301 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:08.298058 27580 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:08.316809 27554 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:08.290241 27599 consensus_queue.cc:1059] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:29:08.288596 27578 raft_consensus.cc:2804] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:08.324079 27587 consensus_queue.cc:1059] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:08.325049 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.325350 27554 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.325786 26652 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:08.309909 27594 consensus_queue.cc:1059] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:29:08.300500 27598 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:08.300150 27581 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:08.320782 27515 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.328521 27594 raft_consensus.cc:3055] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:08.368129 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:08.323699 27578 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:08.371323 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:08.326751 27582 raft_consensus.cc:3055] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:08.329012 27587 raft_consensus.cc:3055] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:08.378226 26582 raft_consensus.cc:2393] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:08.321043 27580 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:08.379643 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 79345.1us
I20260709 12:29:08.414263 27606 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:09.161885 27606 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:09.162402 27606 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:08.422107 27604 log.cc:927] Time spent T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:29:09.345919 27610 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.377868 27594 raft_consensus.cc:740] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:09.566454 27594 consensus_queue.cc:260] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:09.568104 27594 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:09.572178 26367 debug-util.cc:398] Leaking SignalData structure 0x7b0800380fe0 after lost signal to thread 20920
I20260709 12:29:09.622354 27582 raft_consensus.cc:740] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:09.641045 27582 consensus_queue.cc:260] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:09.458459 27606 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:09.644748 27606 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:08.372088 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 107370us
I20260709 12:29:09.810209 27587 raft_consensus.cc:740] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:09.811441 27587 consensus_queue.cc:260] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:09.812849 27587 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:09.838197 27610 raft_consensus.cc:2749] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:08.414366 26653 raft_consensus.cc:1240] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:09.841781 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60780 (request call id 324) took 1439 ms. Trace:
W20260709 12:29:09.834282 27592 consensus_meta.cc:287] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent flushing consensus metadata: real 1.516s	user 0.028s	sys 0.000s
I20260709 12:29:09.842130 26653 rpcz_store.cc:276] 0709 12:29:08.402425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.402970 (+   545us) service_pool.cc:224] Handling call
0709 12:29:08.414124 (+ 11154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:09.841450 (+1427326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:09.841685 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:09.842682 27592 raft_consensus.cc:2749] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:08.370801 27581 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:09.852617 27581 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:09.878988 20922 debug-util.cc:398] Leaking SignalData structure 0x7b080000f9e0 after lost signal to thread 27302
W20260709 12:29:09.880201 20922 kernel_stack_watchdog.cc:198] Thread 27302 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 194ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:29:09.881717 26551 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:09.885996 27591 raft_consensus.cc:2804] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:09.888180 27591 raft_consensus.cc:697] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:09.890286 27591 consensus_queue.cc:237] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:09.892592 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:09.915562 27581 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:09.924849 27581 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:09.932665 27615 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:09.933857 27615 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:09.910513 27613 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:09.937836 27613 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:09.942164 27613 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:09.942857 27613 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:09.943583 27613 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:09.943830 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60780 (request call id 314) took 1680 ms. Trace:
I20260709 12:29:09.944676 26657 rpcz_store.cc:276] 0709 12:29:08.263624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.263764 (+   140us) service_pool.cc:224] Handling call
0709 12:29:08.264030 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:08.292764 (+ 28734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:09.943187 (+1650423us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54005343d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:09.943564 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64543104}
I20260709 12:29:09.947348 27613 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:09.948076 27613 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:09.948872 27613 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:09.952845 27613 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:09.952728 27585 consensus_queue.cc:1059] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:09.955781 27585 raft_consensus.cc:3055] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:09.954838 27613 consensus_queue.cc:1059] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:29:09.956701 27585 raft_consensus.cc:740] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:09.964042 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:09.963905 27585 consensus_queue.cc:260] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:09.966567 26584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60298 (request call id 442) took 1599 ms (client timeout 1813 ms). Trace:
I20260709 12:29:09.967170 27585 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.967689 27615 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:09.967100 26584 rpcz_store.cc:269] 0709 12:29:08.367398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.375248 (+  7850us) service_pool.cc:224] Handling call
0709 12:29:09.963571 (+1588323us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b5800003998. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:09.966406 (+  2835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21130624}
W20260709 12:29:09.970541 26608 debug-util.cc:398] Leaking SignalData structure 0x7b080021fce0 after lost signal to thread 20920
W20260709 12:29:09.983003 26608 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecfe0 after lost signal to thread 26370
W20260709 12:29:09.985330 26608 debug-util.cc:398] Leaking SignalData structure 0x7b08001481a0 after lost signal to thread 26537
I20260709 12:29:09.995061 27581 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:09.996165 27581 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:09.996995 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:09.998046 27354 raft_consensus.cc:3060] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.000833 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.001910 27345 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:10.003412 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.004556 27351 raft_consensus.cc:2468] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:09.995400 26551 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:10.005092 27581 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:10.005869 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.003757 27347 raft_consensus.cc:1240] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.006955 27529 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:08.416294 27601 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.010625 26513 raft_consensus.cc:1240] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:10.011794 26479 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.648s	user 0.008s	sys 0.016s
I20260709 12:29:10.013964 27347 raft_consensus.cc:1240] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
W20260709 12:29:10.014441 26552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:10.015283 26476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.659s	user 0.015s	sys 0.003s
I20260709 12:29:10.015903 27591 raft_consensus.cc:2804] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:10.017167 27591 raft_consensus.cc:697] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.018985 27591 consensus_queue.cc:237] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:10.022274 27541 consensus_meta.cc:287] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent flushing consensus metadata: real 1.776s	user 0.014s	sys 0.010s
I20260709 12:29:10.023310 27541 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:10.031795 27601 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:08.435521 27599 consensus_queue.cc:1059] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 1.598s
W20260709 12:29:10.032894 26479 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.669s	user 0.008s	sys 0.017s
I20260709 12:29:10.034442 27353 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:10.035480 27599 raft_consensus.cc:3055] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.026306 27541 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:10.036027 27599 raft_consensus.cc:740] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.036195 27348 raft_consensus.cc:1275] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:10.037539 27599 consensus_queue.cc:260] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.049271 26508 raft_consensus.cc:1275] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:29:10.039091 26477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.667s	user 0.006s	sys 0.005s
I20260709 12:29:10.044781 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
W20260709 12:29:10.047222 26476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.691s	user 0.015s	sys 0.004s
W20260709 12:29:10.048985 26608 debug-util.cc:398] Leaking SignalData structure 0x7b08001525c0 after lost signal to thread 26611
I20260709 12:29:10.054926 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:10.056428 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:10.057351 27350 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.059793 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.061880 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.062577 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.063699 27588 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.064409 27588 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.066946 27588 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:10.067134 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:10.067848 26550 leader_election.cc:336] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.528s (SENT)
I20260709 12:29:10.069236 26551 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.070299 26551 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.070293 27616 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:10.072441 27616 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:10.072840 27616 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:10.073748 26608 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2840 after lost signal to thread 26685
W20260709 12:29:10.074153 26608 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2c20 after lost signal to thread 26686
W20260709 12:29:10.074800 26477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.703s	user 0.007s	sys 0.005s
W20260709 12:29:10.070341 26550 leader_election.cc:336] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.555s (SENT)
W20260709 12:29:10.077952 26550 leader_election.cc:336] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.604s (SENT)
I20260709 12:29:10.056509 26581 raft_consensus.cc:2393] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:10.078500 26550 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:10.079141 26581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60298 (request call id 444) took 1711 ms (client timeout 2109 ms). Trace:
I20260709 12:29:10.080197 27618 raft_consensus.cc:2749] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:10.080439 26550 leader_election.cc:336] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.604s (SENT)
W20260709 12:29:10.079646 26581 rpcz_store.cc:269] 0709 12:29:08.368072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.371050 (+  2978us) service_pool.cc:224] Handling call
0709 12:29:10.054538 (+1683488us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b5800003998. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1eee 000000000036eb39 00007ff1916551e0 00007ff19171e0c4 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:10.079046 (+ 24508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20795648}
I20260709 12:29:10.082453 27599 raft_consensus.cc:3060] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.087015 27618 raft_consensus.cc:2804] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:10.087548 27618 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:10.088243 27618 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.091930 27585 consensus_queue.cc:1059] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:10.092841 27354 raft_consensus.cc:2468] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:10.093153 27585 consensus_queue.cc:1048] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:10.093765 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:10.094882 26608 debug-util.cc:398] Leaking SignalData structure 0x7b0800275c40 after lost signal to thread 27380
I20260709 12:29:10.098493 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.102206 27616 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.081099 26550 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:08.379998 27578 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.107355 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.109665 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.109902 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.111084 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:10.112264 26582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60298 (request call id 443) took 1744 ms (client timeout 2004 ms). Trace:
I20260709 12:29:10.112486 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.113150 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.113868 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.114138 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:08.366043 27598 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.119167 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.127415 27348 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:10.130631 26657 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:10.131664 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.131793 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.132938 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.133049 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.133710 27350 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:10.134091 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.135686 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.136234 27619 raft_consensus.cc:3055] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.136773 27619 raft_consensus.cc:740] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.139678 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.140820 26505 raft_consensus.cc:1275] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:10.141099 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.087401 27301 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.143359 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.144013 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:10.124373 26582 rpcz_store.cc:269] 0709 12:29:08.367751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.367868 (+   117us) service_pool.cc:224] Handling call
0709 12:29:10.112073 (+1744205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:10.144269 26661 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
W20260709 12:29:10.147070 27302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.828s	user 0.012s	sys 0.017s
I20260709 12:29:10.154217 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
W20260709 12:29:10.154565 27302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.836s	user 0.012s	sys 0.018s
I20260709 12:29:10.143162 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:10.155939 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 1.84335e+06us
I20260709 12:29:10.157141 27302 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.158068 27581 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:10.070389 27588 consensus_queue.cc:1059] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:29:10.158293 27302 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
W20260709 12:29:10.162851 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 74206.1us
I20260709 12:29:10.158529 27581 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:10.136983 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.146548 27616 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:10.195030 27602 consensus_meta.cc:287] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent flushing consensus metadata: real 1.900s	user 0.011s	sys 0.022s
I20260709 12:29:10.195370 27579 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.195675 27602 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.197196 27352 raft_consensus.cc:1240] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.142575 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.198518 27602 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:10.199599 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.200871 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:08.389732 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:10.168212 27587 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.202190 27587 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:10.203651 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 45500.2us
I20260709 12:29:10.204080 27579 raft_consensus.cc:2749] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:10.204613 27587 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:10.168972 27526 raft_consensus.cc:2749] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.205000 27579 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.169927 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:08.383440 26652 raft_consensus.cc:1240] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.206280 27585 raft_consensus.cc:3055] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.207278 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60780 (request call id 323) took 1850 ms. Trace:
W20260709 12:29:10.177639 26367 debug-util.cc:398] Leaking SignalData structure 0x7b0800047660 after lost signal to thread 26370
I20260709 12:29:10.177186 27580 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.206857 27585 raft_consensus.cc:740] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.208546 27346 raft_consensus.cc:1240] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
W20260709 12:29:10.209108 26367 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9b40 after lost signal to thread 26537
I20260709 12:29:10.208806 27585 consensus_queue.cc:260] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.206843 27302 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
W20260709 12:29:10.204895 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 117809us
I20260709 12:29:10.138010 27619 consensus_queue.cc:260] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.211730 27580 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:10.212519 27619 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:10.183218 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 102866us
I20260709 12:29:10.184257 26513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55310 (request call id 330) took 1933 ms. Trace:
I20260709 12:29:10.213207 26513 rpcz_store.cc:276] 0709 12:29:08.251296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.261940 (+ 10644us) service_pool.cc:224] Handling call
0709 12:29:08.262205 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:10.011149 (+1748944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:10.183967 (+172818us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54005be854. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:10.184169 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4019712256}
I20260709 12:29:10.144618 27618 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.185032 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.185326 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.187016 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.216274 27618 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:10.216615 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.207690 26652 rpcz_store.cc:276] 0709 12:29:08.357080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.363039 (+  5959us) service_pool.cc:224] Handling call
0709 12:29:08.383236 (+ 20197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:10.206839 (+1823603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:10.207120 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:10.217316 27598 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:10.187220 27582 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.217042 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.218425 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.187690 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.187994 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.219192 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.220431 26660 raft_consensus.cc:3055] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.210196 27585 raft_consensus.cc:3060] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.220808 26660 raft_consensus.cc:740] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
W20260709 12:29:10.210485 26367 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4d40 after lost signal to thread 26611
I20260709 12:29:10.217962 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.223336 26661 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:10.223490 26654 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:10.223901 27302 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.220626 26659 raft_consensus.cc:3055] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.225219 26659 raft_consensus.cc:740] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:10.224860 26660 consensus_queue.cc:260] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.226492 26660 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.166334 27581 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:10.231132 26550 leader_election.cc:336] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.663s (SENT)
W20260709 12:29:10.223037 26367 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc560 after lost signal to thread 26685
W20260709 12:29:10.212394 26476 leader_election.cc:336] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.536s (SENT)
W20260709 12:29:10.232187 26367 debug-util.cc:398] Leaking SignalData structure 0x7b080022f880 after lost signal to thread 26686
I20260709 12:29:10.217943 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.232918 26658 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
W20260709 12:29:10.233872 26367 debug-util.cc:398] Leaking SignalData structure 0x7b0800124e80 after lost signal to thread 27380
W20260709 12:29:10.234295 26367 debug-util.cc:398] Leaking SignalData structure 0x7b08003d85e0 after lost signal to thread 27381
I20260709 12:29:10.226802 27602 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:10.227559 26659 consensus_queue.cc:260] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.228210 27598 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:10.228585 27302 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.228991 26654 raft_consensus.cc:1240] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.186527 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.206377 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.219190 26652 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:10.187269 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.231621 26550 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.232295 26476 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.229898 27615 raft_consensus.cc:3055] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.211287 27301 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
W20260709 12:29:10.207562 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60298 (request call id 441) took 1840 ms (client timeout 1702 ms). Trace:
I20260709 12:29:10.249010 27615 raft_consensus.cc:740] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
W20260709 12:29:10.249228 26583 rpcz_store.cc:269] 0709 12:29:08.366802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.371100 (+  4298us) service_pool.cc:224] Handling call
0709 12:29:10.207373 (+1836273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:10.234193 26658 raft_consensus.cc:1240] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:10.250556 26476 leader_election.cc:336] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.549s (SENT)
I20260709 12:29:10.251094 26476 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.251479 26658 raft_consensus.cc:1240] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:10.252434 26476 leader_election.cc:336] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.602s (SENT)
I20260709 12:29:10.238252 26661 raft_consensus.cc:1240] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.253216 27599 raft_consensus.cc:2749] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.253996 27599 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.237408 27602 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:10.255103 27602 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.255384 27615 consensus_queue.cc:260] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.256866 27615 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.258937 27592 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:10.262349 26550 leader_election.cc:336] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.687s (SENT)
I20260709 12:29:10.262898 26550 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.243738 26659 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.263792 27591 raft_consensus.cc:2749] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.264572 27591 raft_consensus.cc:2749] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.265700 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.266705 26660 raft_consensus.cc:1275] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:10.267045 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.201519 26655 raft_consensus.cc:2468] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:10.267731 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.248442 26657 raft_consensus.cc:1240] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.268512 26660 raft_consensus.cc:2393] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:10.268270 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.269049 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.269341 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.269479 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.269898 26657 raft_consensus.cc:2393] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:10.270237 26653 raft_consensus.cc:2393] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:10.270346 26656 raft_consensus.cc:2393] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:10.235332 27580 raft_consensus.cc:2804] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:10.270824 27580 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:10.271225 27580 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.271472 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.252848 26658 raft_consensus.cc:1240] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.252856 26476 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:10.279527 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 72497.5us
W20260709 12:29:10.281033 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.282101 27610 raft_consensus.cc:2804] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:29:10.288321 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 61844.6us
I20260709 12:29:10.289171 27621 raft_consensus.cc:2749] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:10.289737 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.326454 27352 raft_consensus.cc:2393] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:10.327693 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.328485 27352 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:10.329530 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:10.330302 27352 raft_consensus.cc:2393] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:10.289915 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.331053 27348 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:10.331481 27302 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.332361 27348 raft_consensus.cc:1240] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.333884 27348 raft_consensus.cc:1240] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.289294 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.291080 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.335028 27346 raft_consensus.cc:2393] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:10.335899 27345 raft_consensus.cc:1240] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.337204 27345 raft_consensus.cc:1240] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.337448 27591 consensus_queue.cc:1048] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:10.338063 27346 raft_consensus.cc:1240] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.291093 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.292510 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.335108 27588 consensus_queue.cc:1048] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:29:10.292773 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.293867 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.294251 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.295699 27353 raft_consensus.cc:1240] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.254305 27578 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.299772 27581 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.324136 27610 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
W20260709 12:29:10.301047 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 48670.2us
I20260709 12:29:10.346015 27610 raft_consensus.cc:3060] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.339900 27350 raft_consensus.cc:2393] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:10.348879 27581 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:10.349582 27581 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.339134 26655 raft_consensus.cc:2393] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
W20260709 12:29:10.339082 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.345350 26661 raft_consensus.cc:1240] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.303865 27592 raft_consensus.cc:2749] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.306908 26510 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:10.307492 26659 raft_consensus.cc:1275] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:10.311501 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.312584 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.312928 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.316633 27598 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.325001 27622 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.358989 26653 raft_consensus.cc:2393] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:10.325543 27585 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:10.359607 26476 leader_election.cc:336] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.813s (SENT)
I20260709 12:29:10.359373 27622 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:10.360314 26476 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.864s (SENT)
W20260709 12:29:10.361151 26476 leader_election.cc:336] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.004s (SENT)
I20260709 12:29:10.359997 27585 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.361691 27622 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:10.362213 26476 leader_election.cc:336] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.109s (SENT)
W20260709 12:29:10.340795 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 76550.1us
I20260709 12:29:10.340204 27347 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:10.341050 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
W20260709 12:29:10.293824 27515 consensus_meta.cc:287] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent flushing consensus metadata: real 1.916s	user 0.010s	sys 0.027s
I20260709 12:29:10.339452 27354 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
W20260709 12:29:10.354781 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 87793.2us
I20260709 12:29:10.358330 27349 raft_consensus.cc:1240] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.338547 27345 raft_consensus.cc:1240] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.318421 27580 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.362560 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.358505 26658 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.359027 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.388991 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:10.394791 27350 raft_consensus.cc:1240] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.390187 27515 raft_consensus.cc:2749] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.384408 27348 raft_consensus.cc:1240] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.384722 27585 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:10.390280 27578 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:10.403338 27352 raft_consensus.cc:1240] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.409337 26551 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:10.409900 26583 raft_consensus.cc:1240] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:10.410342 26552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.410511 27353 raft_consensus.cc:1240] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.410884 27351 raft_consensus.cc:1240] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.411521 26581 raft_consensus.cc:1240] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.406740 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.412563 26653 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:10.412868 27579 raft_consensus.cc:2749] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.414381 27349 raft_consensus.cc:1275] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:10.417135 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:10.359025 27598 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.410732 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.420657 27598 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:10.423367 26584 raft_consensus.cc:1240] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.424715 26654 raft_consensus.cc:2393] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:10.426409 26551 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:10.406296 26477 leader_election.cc:336] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Timed out: RequestConsensusVote RPC to 127.20.109.67:38163 timed out after 1.702s (SENT)
I20260709 12:29:10.340638 27602 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:10.431231 26477 leader_election.cc:336] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Timed out: RequestConsensusVote RPC to 127.20.109.65:39541 timed out after 1.702s (SENT)
I20260709 12:29:10.431742 27585 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:10.433396 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.431202 26582 raft_consensus.cc:2468] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:10.435695 26581 raft_consensus.cc:1240] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.435156 26332 catalog_manager.cc:5697] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 3 to 4, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 4 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.434263 27615 raft_consensus.cc:2804] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:10.436995 27615 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.437430 27615 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.438033 26653 raft_consensus.cc:1240] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.434253 27585 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:10.439294 27585 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.433589 26477 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.447297 27621 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.448129 27580 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:29:10.450446 26477 leader_election.cc:336] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Timed out: RequestConsensusVote RPC to 127.20.109.65:39541 timed out after 1.750s (SENT)
I20260709 12:29:10.450977 26477 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:10.434720 26550 leader_election.cc:336] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.715s (SENT)
I20260709 12:29:10.452222 27346 raft_consensus.cc:1240] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.452251 26551 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.455538 26550 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.459771 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:10.460078 26654 raft_consensus.cc:1240] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.461076 27623 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:10.461609 27623 raft_consensus.cc:697] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.461777 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.462576 27623 consensus_queue.cc:237] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.437016 26332 catalog_manager.cc:5697] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.464395 26332 catalog_manager.cc:5697] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 2 to 3, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 3 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:10.469080 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 44426.1us
I20260709 12:29:10.470840 27622 raft_consensus.cc:2749] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.471101 27602 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:10.471743 27615 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.472988 26581 raft_consensus.cc:1240] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 4. Ops: []
I20260709 12:29:10.473958 27615 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:10.452714 27581 raft_consensus.cc:2749] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:10.476506 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 145265us
I20260709 12:29:10.465945 26551 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
W20260709 12:29:10.476927 26476 leader_election.cc:336] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.224s (SENT)
I20260709 12:29:10.477413 27302 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:10.477634 27351 raft_consensus.cc:1240] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.477442 26476 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.479518 26658 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.481221 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.482415 26653 raft_consensus.cc:2393] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
W20260709 12:29:10.482686 26550 leader_election.cc:336] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.772s (SENT)
I20260709 12:29:10.482950 27622 raft_consensus.cc:2804] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:10.483260 26550 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.484320 27619 raft_consensus.cc:2749] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:10.484100 27624 consensus_queue.cc:1059] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:10.483538 27622 raft_consensus.cc:697] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
W20260709 12:29:10.484807 26550 leader_election.cc:336] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.783s (SENT)
I20260709 12:29:10.485368 27588 raft_consensus.cc:3055] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.485839 27588 raft_consensus.cc:740] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.479535 27302 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:10.486974 27621 raft_consensus.cc:2749] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:10.486155 26550 leader_election.cc:336] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.885s (SENT)
I20260709 12:29:10.487542 27582 raft_consensus.cc:2749] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:10.488569 26550 leader_election.cc:336] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.892s (SENT)
I20260709 12:29:10.488095 27588 consensus_queue.cc:260] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:10.489116 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.485582 27622 consensus_queue.cc:237] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.489699 27588 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:10.487358 26477 leader_election.cc:336] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Timed out: RequestConsensusVote RPC to 127.20.109.67:38163 timed out after 1.813s (SENT)
I20260709 12:29:10.475982 26659 raft_consensus.cc:2468] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
W20260709 12:29:10.489604 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.487498 27302 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.492663 26477 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.475435 26332 catalog_manager.cc:5697] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.497596 27582 raft_consensus.cc:2749] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:10.498020 26477 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Timed out: RequestConsensusVote RPC to 127.20.109.65:39541 timed out after 1.864s (SENT)
I20260709 12:29:10.498451 26477 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.500020 27582 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.500195 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.502084 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.503891 26654 raft_consensus.cc:1240] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.506100 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.494581 27581 raft_consensus.cc:2804] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:10.509099 27581 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:10.496726 26332 catalog_manager.cc:5697] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.499100 27301 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.511994 27627 raft_consensus.cc:2764] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:29:10.512346 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.513079 26653 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:10.513794 27581 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:10.509506 26477 leader_election.cc:336] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Timed out: RequestConsensusVote RPC to 127.20.109.67:38163 timed out after 2.004s (SENT)
I20260709 12:29:10.514700 26477 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.504056 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.497200 27615 consensus_queue.cc:1059] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:29:10.513249 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.515697 26332 catalog_manager.cc:5697] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:10.518123 27582 raft_consensus.cc:2749] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.510739 27602 raft_consensus.cc:2764] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:29:10.519717 27627 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:10.521936 26658 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.525635 27617 consensus_queue.cc:1059] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:10.522850 27618 consensus_queue.cc:1048] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:29:10.520627 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.528429 27302 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.541131 27627 raft_consensus.cc:697] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:10.528553 27591 raft_consensus.cc:3055] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.541674 26653 raft_consensus.cc:2468] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:10.541390 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.541731 27591 raft_consensus.cc:740] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.543056 26505 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:10.541270 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.541244 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.543555 27591 consensus_queue.cc:260] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.542033 27617 raft_consensus.cc:3055] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.544739 26477 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.545106 27591 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.544778 27617 raft_consensus.cc:740] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.546136 27617 consensus_queue.cc:260] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.547042 26659 raft_consensus.cc:1240] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.542129 27627 consensus_queue.cc:237] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.535765 27347 raft_consensus.cc:1275] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:10.536897 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:10.548532 27585 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.538174 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.549777 26506 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.539551 27352 raft_consensus.cc:1240] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.518963 27619 consensus_queue.cc:1059] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:29:10.547793 26504 raft_consensus.cc:2468] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:10.542007 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:10.531656 26550 leader_election.cc:336] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.009s (SENT)
I20260709 12:29:10.556346 26550 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.550397 27302 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.557876 27610 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.551764 27602 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.567430 26654 raft_consensus.cc:1240] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.568635 27301 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.569550 27598 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:10.569923 27598 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.570271 27598 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.547264 27617 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.572305 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.572503 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.573127 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.573720 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.573868 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.549309 27345 raft_consensus.cc:3060] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.574316 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.574510 26661 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:10.575003 26655 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:10.575609 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.576334 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.555794 27351 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:10.553036 26580 raft_consensus.cc:1240] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:10.558545 27302 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:10.558779 27587 consensus_queue.cc:1059] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:10.577917 27587 raft_consensus.cc:3055] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.578248 27587 raft_consensus.cc:740] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.579216 27587 consensus_queue.cc:260] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.554014 27621 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.560287 27619 raft_consensus.cc:3055] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.560969 27582 consensus_queue.cc:1059] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:10.580677 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.581138 27582 raft_consensus.cc:3055] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.581532 27582 raft_consensus.cc:740] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.581660 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.582924 27582 consensus_queue.cc:260] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.584317 27579 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:10.584774 27579 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:10.585263 27579 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.584372 27582 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.561885 27618 raft_consensus.cc:2749] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.562306 27599 consensus_queue.cc:1059] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:10.591723 27599 raft_consensus.cc:3055] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.592119 27599 raft_consensus.cc:740] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.593083 27599 consensus_queue.cc:260] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.594300 27599 raft_consensus.cc:3060] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.597991 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.598488 27585 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:10.598734 26654 raft_consensus.cc:2468] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:10.600701 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.576961 26655 raft_consensus.cc:2468] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:10.558771 27580 raft_consensus.cc:2749] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.586699 27619 raft_consensus.cc:740] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.583747 27587 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.602811 27619 consensus_queue.cc:260] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:10.561362 26550 leader_election.cc:336] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.011s (SENT)
I20260709 12:29:10.600802 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.580240 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.597369 27302 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.563174 26551 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:10.606115 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 44805.6us
I20260709 12:29:10.566308 26477 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:10.606101 27619 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.611056 27595 raft_consensus.cc:2804] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:10.611580 27595 raft_consensus.cc:697] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.612450 27595 consensus_queue.cc:237] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.613575 27579 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.608497 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.615774 27579 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:10.616060 26550 leader_election.cc:336] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.014s (SENT)
W20260709 12:29:10.610512 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 44279.4us
I20260709 12:29:10.617061 27302 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:10.619211 26550 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.609464 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:10.607306 26551 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.619515 27580 raft_consensus.cc:2764] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:29:10.562175 27581 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.638706 27346 raft_consensus.cc:2468] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
W20260709 12:29:10.638959 26479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.639130 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.641489 27345 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:10.638573 26551 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:10.642095 27578 raft_consensus.cc:2764] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:29:10.618074 26506 raft_consensus.cc:2468] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:10.642709 26551 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:10.643546 27618 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:10.643893 27618 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.644202 27618 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:10.644683 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.645449 27623 raft_consensus.cc:2804] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:10.645785 27623 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.646099 27623 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.649075 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:10.649844 27302 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:10.651232 27302 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.651738 27580 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:10.652163 27580 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:10.652544 27580 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.653086 27578 raft_consensus.cc:2749] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:10.647660 27602 raft_consensus.cc:2749] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.655110 27619 consensus_queue.cc:1048] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:10.607730 27622 raft_consensus.cc:2749] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.632952 27583 consensus_queue.cc:1059] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:29:10.633806 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.622138 27588 raft_consensus.cc:2749] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.634654 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:10.635293 26550 leader_election.cc:336] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.062s (SENT)
I20260709 12:29:10.618273 27621 raft_consensus.cc:2749] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.636299 27610 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:10.637991 27617 raft_consensus.cc:2749] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.659742 26550 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.652559 27302 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:10.653882 27623 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.661787 27348 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:10.663096 27351 raft_consensus.cc:2393] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:10.663514 27623 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:10.648995 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.668229 27617 raft_consensus.cc:2749] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.668830 27613 consensus_queue.cc:1059] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:10.672538 27610 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:10.673126 27610 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:10.673491 27610 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.674700 27598 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:10.676908 26550 leader_election.cc:336] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.103s (SENT)
I20260709 12:29:10.677387 26550 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.675746 27624 raft_consensus.cc:3055] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.678840 27624 raft_consensus.cc:740] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.681573 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.681793 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:10.682271 26506 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:10.682803 27623 raft_consensus.cc:2749] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.682560 27624 consensus_queue.cc:260] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.682430 26654 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.684080 27624 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.679885 26551 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.692068 27619 raft_consensus.cc:2804] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:10.693935 26654 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
W20260709 12:29:10.694887 26550 leader_election.cc:336] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.103s (SENT)
I20260709 12:29:10.698578 26550 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.699820 26580 raft_consensus.cc:1240] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.678478 27599 raft_consensus.cc:3055] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.700680 27599 raft_consensus.cc:740] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.701083 26582 raft_consensus.cc:1240] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.701217 26581 raft_consensus.cc:1240] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.701715 27599 consensus_queue.cc:260] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.702277 27581 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:10.703563 26506 raft_consensus.cc:1240] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:10.703878 27619 raft_consensus.cc:697] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.705143 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:10.705504 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.706142 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.706907 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.707506 26583 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.700066 27591 raft_consensus.cc:2749] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.709753 27599 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:10.710716 26550 leader_election.cc:336] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.113s (SENT)
I20260709 12:29:10.711203 26550 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.711913 27591 raft_consensus.cc:2749] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.712111 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.712387 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.713896 26584 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.714725 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.715529 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:10.696806 27618 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.715083 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:10.717002 27301 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.718441 26581 raft_consensus.cc:2468] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:10.703605 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.716939 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.717582 27598 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:10.718755 27581 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:10.722818 27581 raft_consensus.cc:697] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:10.717775 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.723711 27581 consensus_queue.cc:237] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.726169 26583 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:10.728416 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.727625 27618 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:10.727675 27619 consensus_queue.cc:237] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.736425 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.740233 26513 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.737150 26551 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.744731 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.750092 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:10.750738 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.750820 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:10.751302 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:10.751978 27350 raft_consensus.cc:2393] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:10.752622 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.753104 27347 raft_consensus.cc:1275] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:10.753993 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:10.754253 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.752622 27352 raft_consensus.cc:1240] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:10.751935 27351 raft_consensus.cc:3060] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.767951 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:10.768396 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.772459 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.775906 26507 raft_consensus.cc:1275] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:10.765630 26581 raft_consensus.cc:2393] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:10.728459 27580 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.750142 27618 raft_consensus.cc:2749] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:10.768312 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.795149 26510 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.799376 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.801044 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.802910 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.804416 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.806849 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.807045 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
W20260709 12:29:10.807957 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.810024 27613 consensus_queue.cc:1048] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:10.814380 26584 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
W20260709 12:29:10.786262 26477 leader_election.cc:336] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Timed out: RequestConsensusVote RPC to 127.20.109.65:39541 timed out after 2.168s (SENT)
I20260709 12:29:10.788946 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.790843 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.792651 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.811477 27613 consensus_queue.cc:1059] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:10.820778 26513 raft_consensus.cc:2468] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:10.818940 26582 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.821482 26580 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:10.816699 26477 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:10.770164 27610 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:10.830559 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.830798 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:10.825088 27599 raft_consensus.cc:2749] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:10.832921 26582 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.831087 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.825629 26505 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:10.843345 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 57166.7us
I20260709 12:29:10.843989 26477 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.844969 26580 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.848060 27302 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.849599 27302 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.851356 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.852809 26508 raft_consensus.cc:1275] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:10.853952 27627 raft_consensus.cc:2749] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.854910 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.855687 26581 raft_consensus.cc:2393] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:10.856592 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.857266 26581 raft_consensus.cc:2368] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3.
I20260709 12:29:10.857805 27599 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:10.858227 27599 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:10.858685 27599 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.859230 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.861346 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.864568 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.865420 26509 raft_consensus.cc:2368] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3.
I20260709 12:29:10.865918 27618 raft_consensus.cc:3055] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.866375 27618 raft_consensus.cc:740] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.867151 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.867272 27618 consensus_queue.cc:260] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.867835 26587 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.868057 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.868495 27618 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.867992 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.869199 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.870106 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.872049 27580 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:10.875730 26507 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.876204 26583 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.868678 27302 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:10.877776 27580 raft_consensus.cc:2749] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:10.878067 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.878350 27302 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.878811 27627 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:10.879191 27580 raft_consensus.cc:2804] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:10.879660 26584 raft_consensus.cc:3060] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.880471 27302 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.879637 27580 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:10.881424 27580 raft_consensus.cc:3060] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.883842 27610 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:10.884546 27347 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.885706 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.886438 26582 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.890228 26584 raft_consensus.cc:2468] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:10.822269 27617 consensus_queue.cc:1048] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 12:29:10.904556 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 92855.1us
W20260709 12:29:10.906481 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.892339 27302 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.894661 26586 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:10.841672 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.858271 26510 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.841045 27351 raft_consensus.cc:2468] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:10.911057 26551 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:10.913769 26582 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.879362 27627 raft_consensus.cc:697] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:10.919090 26580 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:10.916250 27598 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:10.919314 27613 raft_consensus.cc:2804] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:10.921598 27610 raft_consensus.cc:2804] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:10.921173 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:29:10.932570 26552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:10.933099 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.939970 27302 leader_election.cc:400] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3.
I20260709 12:29:10.921567 27591 consensus_queue.cc:1048] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:29:10.941797 26587 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:10.951288 27302 leader_election.cc:403] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:29:10.940459 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.934420 27598 raft_consensus.cc:697] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:10.955260 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:10.953038 27613 raft_consensus.cc:697] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:10.939133 27582 consensus_queue.cc:1059] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:29:10.958658 27627 consensus_queue.cc:237] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.960201 27598 consensus_queue.cc:237] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.961974 27583 consensus_queue.cc:1059] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:10.962535 27621 raft_consensus.cc:3055] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.962968 27621 raft_consensus.cc:740] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.963191 27583 raft_consensus.cc:3055] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.963601 27583 raft_consensus.cc:740] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.967810 27621 consensus_queue.cc:260] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:10.968393 27587 consensus_queue.cc:1059] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:10.969553 27587 consensus_queue.cc:1059] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:10.970639 27595 raft_consensus.cc:3055] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.971019 27595 raft_consensus.cc:740] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:10.971977 27595 consensus_queue.cc:260] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:10.973194 27595 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.980367 26654 raft_consensus.cc:1275] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:10.941131 27610 raft_consensus.cc:697] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:10.939005 26578 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.976279 26583 raft_consensus.cc:2393] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:10.981736 27582 raft_consensus.cc:3055] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.986621 27582 raft_consensus.cc:740] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
W20260709 12:29:10.988309 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 62563.8us
I20260709 12:29:10.991974 27302 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:10.997025 27302 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:10.988878 27581 raft_consensus.cc:2749] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3.
I20260709 12:29:11.002017 27602 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:11.002337 27621 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.987617 27579 consensus_queue.cc:1048] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:29:11.007308 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:11.008111 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:10.964028 27613 consensus_queue.cc:237] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:11.001609 27347 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:11.009907 27302 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.029508 26550 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:11.018029 27652 consensus_queue.cc:1059] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:10.996819 26585 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:10.989894 27583 consensus_queue.cc:260] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:10.988507 27582 consensus_queue.cc:260] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:11.051174 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 67508.5us
I20260709 12:29:11.053973 26505 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:11.056051 27583 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.056833 26551 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:11.033274 27617 consensus_queue.cc:1048] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:29:11.059198 27345 raft_consensus.cc:1275] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.059908 27617 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:11.060449 27617 raft_consensus.cc:697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:11.030635 27627 raft_consensus.cc:2804] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:11.038440 27622 raft_consensus.cc:2804] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:11.038291 27581 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:11.067380 27351 raft_consensus.cc:1275] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.066960 27587 consensus_queue.cc:1059] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:11.068140 27617 consensus_queue.cc:237] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:11.033347 27599 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:11.066960 27582 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:11.077207 27570 consensus_queue.cc:1048] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:29:11.079787 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 70025.6us
I20260709 12:29:11.078100 27656 consensus_queue.cc:1059] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:29:11.080331 27652 consensus_queue.cc:1059] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:29:11.085431 26507 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:11.071718 27622 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:11.070757 27627 raft_consensus.cc:697] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:11.088137 27302 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.077903 27595 consensus_queue.cc:1059] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:29:11.095474 26509 raft_consensus.cc:1240] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:11.037721 27610 consensus_queue.cc:237] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:11.094908 27302 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:11.071712 27588 consensus_queue.cc:1048] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:29:11.076272 27581 raft_consensus.cc:697] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:11.098490 27302 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.092963 27622 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.095353 27578 raft_consensus.cc:2804] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:11.109369 26477 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:11.112264 26477 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:11.116106 27595 consensus_queue.cc:1059] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:11.119598 27578 raft_consensus.cc:697] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:11.120272 27599 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:11.099989 27579 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:11.099723 27602 raft_consensus.cc:697] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:11.098372 27580 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.120695 27578 consensus_queue.cc:237] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.096570 27655 consensus_queue.cc:1059] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 12:29:11.195508 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.126312 27657 raft_consensus.cc:2804] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:11.166106 27587 raft_consensus.cc:3055] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.193205 27583 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:11.210321 27346 raft_consensus.cc:1240] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:11.205653 27351 raft_consensus.cc:1240] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:11.211588 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.203143 27579 raft_consensus.cc:697] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:11.214622 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
W20260709 12:29:11.212330 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 100176us
I20260709 12:29:11.127543 27627 consensus_queue.cc:237] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.217873 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.218526 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.230154 27346 raft_consensus.cc:1240] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:11.205681 27587 raft_consensus.cc:740] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.204301 27668 raft_consensus.cc:2749] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:11.223227 26477 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:11.208607 27583 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:11.193671 27581 consensus_queue.cc:237] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.241660 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
W20260709 12:29:11.242985 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.246505 27661 consensus_queue.cc:1059] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:29:11.248059 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.254694 27659 raft_consensus.cc:3055] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.254966 27665 raft_consensus.cc:3055] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.255318 27665 raft_consensus.cc:740] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.256126 27665 consensus_queue.cc:260] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.256789 27658 raft_consensus.cc:3055] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:11.257158 27658 raft_consensus.cc:740] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.258419 27664 consensus_queue.cc:1059] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:29:11.258881 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.260265 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.261392 27346 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:11.262307 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.263306 27580 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:11.239836 27583 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:11.257964 27658 consensus_queue.cc:260] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.263331 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.235682 27652 raft_consensus.cc:3055] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.276384 27652 raft_consensus.cc:740] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.277334 27652 consensus_queue.cc:260] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.278702 27652 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:11.284682 27649 log.cc:927] Time spent T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.242s	user 0.004s	sys 0.000s
I20260709 12:29:11.285537 27668 consensus_queue.cc:1059] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.286674 27668 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:11.288260 27665 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.292747 27346 raft_consensus.cc:2393] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:11.225921 27602 consensus_queue.cc:237] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:11.302728 27664 consensus_queue.cc:1059] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:11.304409 27354 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:11.271176 27351 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:11.305079 27673 raft_consensus.cc:3055] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.305014 27353 raft_consensus.cc:2468] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:11.305493 27673 raft_consensus.cc:740] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.306489 27582 consensus_queue.cc:1059] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.307016 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.307257 27349 raft_consensus.cc:2468] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:11.271873 27659 raft_consensus.cc:740] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.329895 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
W20260709 12:29:11.337450 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 114306us
I20260709 12:29:11.297050 27655 consensus_queue.cc:1059] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:29:11.357172 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:11.297279 27579 consensus_queue.cc:237] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:11.353231 27658 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:11.315111 27583 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.306361 27673 consensus_queue.cc:260] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.369652 27346 raft_consensus.cc:1275] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:11.309772 27659 consensus_queue.cc:260] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.361824 27657 raft_consensus.cc:697] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
W20260709 12:29:11.381642 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 90940.8us
I20260709 12:29:11.388664 26661 raft_consensus.cc:1275] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:11.391741 27348 raft_consensus.cc:1240] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:11.392515 27677 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.380290 27350 raft_consensus.cc:1240] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:11.400099 27583 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:11.400785 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.387312 26507 raft_consensus.cc:1275] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.393059 27677 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.395653 27627 consensus_queue.cc:1048] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:11.413698 27677 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:11.414618 27668 raft_consensus.cc:2749] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:11.421423 27570 consensus_queue.cc:1048] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:11.422346 27659 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.429224 27349 raft_consensus.cc:1240] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:11.430761 26511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:11.431387 27353 raft_consensus.cc:1275] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.431607 26511 raft_consensus.cc:606] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:11.432348 26511 raft_consensus.cc:614] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:11.431618 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
W20260709 12:29:11.436532 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.440012 26579 raft_consensus.cc:1275] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.440557 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.441190 27353 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:11.394582 26510 raft_consensus.cc:1275] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:11.402514 27673 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.439921 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:29:11.456887 27672 log.cc:927] Time spent T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:29:11.459616 27345 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:11.461365 27624 consensus_queue.cc:1048] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.461867 26477 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:11.463680 27618 consensus_queue.cc:1048] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:11.465047 27657 consensus_queue.cc:237] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.467115 27349 raft_consensus.cc:1240] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:11.461503 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.475844 27346 raft_consensus.cc:2393] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:11.477234 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.478057 27347 raft_consensus.cc:2393] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:11.451516 27658 consensus_queue.cc:1048] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:29:11.477253 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.500679 27302 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.500698 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.502750 27346 raft_consensus.cc:2393] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:11.484231 27655 raft_consensus.cc:2749] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:11.482652 27668 consensus_queue.cc:1048] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:29:11.514642 27302 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.499708 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.513396 27353 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:11.498078 27617 consensus_queue.cc:1059] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:29:11.483134 27613 consensus_queue.cc:1048] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 12:29:11.515939 26625 connection.cc:256] RPC call timeout handler was delayed by -3.9566631580000831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 12:29:11.523219 26625 connection.cc:256] RPC call timeout handler was delayed by -3.887363157999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 12:29:11.520768 27302 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:11.524904 27302 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
W20260709 12:29:11.525892 26625 connection.cc:256] RPC call timeout handler was delayed by -3.792863158000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:29:11.526496 26625 connection.cc:256] RPC call timeout handler was delayed by -3.7919631580002715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 12:29:11.527182 27683 raft_consensus.cc:2764] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:29:11.526446 26477 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:11.522895 27349 raft_consensus.cc:2393] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
W20260709 12:29:11.530431 26625 connection.cc:256] RPC call timeout handler was delayed by -3.7604631580002206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 12:29:11.531271 26625 connection.cc:256] RPC call timeout handler was delayed by -3.6974631580001187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 12:29:11.531611 26625 connection.cc:256] RPC call timeout handler was delayed by -3.6947631580001143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:29:11.531903 26625 connection.cc:256] RPC call timeout handler was delayed by -3.6695631580000736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 12:29:11.532195 26625 connection.cc:256] RPC call timeout handler was delayed by -3.6290631580000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:29:11.532490 26625 connection.cc:256] RPC call timeout handler was delayed by -3.6290631580000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 12:29:11.533411 27581 raft_consensus.cc:2749] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:11.535214 27622 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:11.538995 26578 raft_consensus.cc:1240] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:11.539834 27622 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:11.533259 27655 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:29:11.532761 26625 connection.cc:256] RPC call timeout handler was delayed by -3.6272631580000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 12:29:11.541297 27655 raft_consensus.cc:697] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
W20260709 12:29:11.541838 26625 connection.cc:256] RPC call timeout handler was delayed by -3.6272631580000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:29:11.542167 26625 connection.cc:256] RPC call timeout handler was delayed by -3.6155133790002765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 12:29:11.542506 26625 connection.cc:256] RPC call timeout handler was delayed by -3.580820661999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 12:29:11.535390 27345 raft_consensus.cc:2393] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
W20260709 12:29:11.542845 26625 connection.cc:256] RPC call timeout handler was delayed by -3.580820661999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 12:29:11.543164 27579 raft_consensus.cc:2749] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:11.542312 27655 consensus_queue.cc:237] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.534268 27302 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
W20260709 12:29:11.543226 26625 connection.cc:256] RPC call timeout handler was delayed by -3.5597631579998961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 12:29:11.546820 26625 connection.cc:256] RPC call timeout handler was delayed by -3.5597631579998961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 12:29:11.547132 26625 connection.cc:256] RPC call timeout handler was delayed by -3.5534631579998859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 12:29:11.547421 26625 connection.cc:256] RPC call timeout handler was delayed by -3.5111631580002722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:29:11.547698 26625 connection.cc:256] RPC call timeout handler was delayed by -3.4458206620001874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:29:11.547971 26625 connection.cc:256] RPC call timeout handler was delayed by -3.405320662000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 12:29:11.550523 26625 connection.cc:256] RPC call timeout handler was delayed by -3.3941631580000831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 12:29:11.551240 26625 connection.cc:256] RPC call timeout handler was delayed by -3.3851631580000685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 12:29:11.551540 26625 connection.cc:256] RPC call timeout handler was delayed by -3.3437631580000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 12:29:11.551808 26625 connection.cc:256] RPC call timeout handler was delayed by -3.3027206619999561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 12:29:11.552390 27302 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.553352 27578 raft_consensus.cc:2749] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.552410 26625 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:11.554109 27578 raft_consensus.cc:2749] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.555480 27302 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.556016 27677 raft_consensus.cc:2749] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:11.557222 27302 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.558043 27581 raft_consensus.cc:2749] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.557174 27578 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.559818 27302 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:11.561600 27302 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.579751 27302 leader_election.cc:400] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3.
I20260709 12:29:11.580722 27302 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:11.578310 27578 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:11.585988 27687 log.cc:927] Time spent T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:29:11.587307 26625 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:11.587831 27610 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:11.588465 27610 raft_consensus.cc:697] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:11.589191 26625 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:11.589955 27677 raft_consensus.cc:2749] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.590664 27677 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.593524 27646 raft_consensus.cc:3055] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:11.593997 27646 raft_consensus.cc:740] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:11.583721 27581 raft_consensus.cc:2749] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.594913 27646 consensus_queue.cc:260] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:11.596318 27348 raft_consensus.cc:1240] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:11.590487 26625 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:11.603700 27694 raft_consensus.cc:2804] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:11.604156 26625 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:11.605849 26625 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:11.604171 27694 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:11.607086 26660 raft_consensus.cc:1275] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:11.607120 27694 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.608321 27690 raft_consensus.cc:2804] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:11.608770 27690 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:11.609110 27690 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.610800 27677 raft_consensus.cc:2804] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:11.611207 27677 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:11.611548 27677 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.611966 27578 consensus_queue.cc:1048] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:11.589421 27610 consensus_queue.cc:237] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:11.614759 26625 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:11.616596 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:11.622416 27599 consensus_queue.cc:1059] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.622157 27667 raft_consensus.cc:3055] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.627022 27302 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.637684 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:11.596410 27646 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:11.642906 27347 raft_consensus.cc:1275] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:11.643100 26513 raft_consensus.cc:1275] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:11.651160 26513 raft_consensus.cc:1275] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:29:11.675279 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 48320.5us
I20260709 12:29:11.671829 26476 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:11.646533 27578 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:11.683673 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:11.645918 27667 raft_consensus.cc:740] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.685376 26587 raft_consensus.cc:3060] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.639537 27665 consensus_queue.cc:1059] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:29:11.686636 26476 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:11.692754 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 78138.3us
I20260709 12:29:11.680230 27627 raft_consensus.cc:2749] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.695412 26586 raft_consensus.cc:1275] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.684448 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:11.666373 27570 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:29:11.691028 27599 raft_consensus.cc:2749] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:11.696681 27349 raft_consensus.cc:1275] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:11.704749 26578 raft_consensus.cc:2393] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:11.693073 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:11.682328 27613 consensus_queue.cc:1048] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:29:11.691581 27578 raft_consensus.cc:697] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:11.693835 27652 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:11.711633 26587 raft_consensus.cc:2468] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:11.704927 26579 raft_consensus.cc:1275] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:11.721068 27302 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:11.722573 26476 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:11.726785 26625 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:11.726702 27587 consensus_queue.cc:260] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.728817 27587 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.729857 27618 consensus_queue.cc:1048] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:29:11.731338 27677 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:11.733623 27677 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:11.715655 27585 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:29:11.738193 27694 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:11.702975 27667 consensus_queue.cc:260] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.713371 27657 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:29:11.748523 27683 raft_consensus.cc:2804] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:29:11.776711 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 56169.8us
W20260709 12:29:11.766657 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 44175.2us
I20260709 12:29:11.768234 27652 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.769541 26583 raft_consensus.cc:1275] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:11.789665 27346 raft_consensus.cc:1240] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:11.753923 27677 raft_consensus.cc:2804] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:11.815997 26579 raft_consensus.cc:1275] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:11.816615 26578 raft_consensus.cc:1275] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:11.817826 27670 raft_consensus.cc:2749] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:11.816000 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:11.818907 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:11.806350 27677 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:11.819831 27677 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.812212 27599 consensus_queue.cc:1059] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:29:11.822857 27595 raft_consensus.cc:3055] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:11.823284 27595 raft_consensus.cc:740] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.805004 27683 raft_consensus.cc:697] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:11.824237 27595 consensus_queue.cc:260] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.824458 27683 consensus_queue.cc:237] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.825496 27595 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:11.828040 26335 catalog_manager.cc:5697] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:11.829638 27682 log.cc:927] Time spent T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.408s	user 0.003s	sys 0.000s
I20260709 12:29:11.747799 27578 consensus_queue.cc:237] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:11.835954 27677 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:11.836439 27673 raft_consensus.cc:3055] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.836802 27673 raft_consensus.cc:740] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:11.837584 27673 consensus_queue.cc:260] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:11.838145 27677 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:11.840368 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.841293 27667 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.841611 27690 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:11.809362 27580 consensus_queue.cc:1048] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:29:11.843067 26625 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:11.848018 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.850036 26335 catalog_manager.cc:5697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 2 to 4, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 4 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:11.819607 26510 raft_consensus.cc:2368] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4.
I20260709 12:29:11.865828 26625 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:11.869628 26504 raft_consensus.cc:1275] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:29:11.874713 26479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.843748 27690 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:11.856132 26335 catalog_manager.cc:5697] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 2 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:11.858991 27677 raft_consensus.cc:2749] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:11.902314 26587 raft_consensus.cc:1275] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:11.904804 26579 raft_consensus.cc:1275] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:11.906236 26583 raft_consensus.cc:1275] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.907486 27676 consensus_queue.cc:1048] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:29:11.907858 26661 raft_consensus.cc:3055] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.908234 26661 raft_consensus.cc:740] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:11.908987 26661 consensus_queue.cc:260] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.909272 27694 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:11.909942 26661 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:11.910032 27706 log.cc:927] Time spent T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:29:11.911202 27703 raft_consensus.cc:2804] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:11.911621 27703 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:11.911507 27581 consensus_queue.cc:1048] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:11.912062 27703 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:11.913436 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 47727.2us
I20260709 12:29:11.899816 26335 catalog_manager.cc:5697] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 2 to 4, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 4 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:11.885486 27680 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:11.920189 26335 catalog_manager.cc:5697] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 3, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 3 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:11.926177 27302 leader_election.cc:400] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4.
I20260709 12:29:11.926738 27302 leader_election.cc:403] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:29:11.923475 27598 consensus_queue.cc:1048] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:29:11.930810 27580 consensus_queue.cc:1048] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.931025 27657 consensus_queue.cc:1048] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:29:11.932495 27676 consensus_queue.cc:1048] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:11.932780 27581 consensus_queue.cc:1048] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:11.934984 26580 raft_consensus.cc:1275] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.922065 27694 consensus_queue.cc:1059] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:29:11.944357 27673 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.952414 26660 raft_consensus.cc:3055] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.955935 26660 raft_consensus.cc:740] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:11.956714 26660 consensus_queue.cc:260] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:11.958393 26660 raft_consensus.cc:3060] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.961042 27690 consensus_queue.cc:1059] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:11.961319 27707 consensus_queue.cc:1059] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.962026 26625 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
W20260709 12:29:11.970749 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.003446 26660 raft_consensus.cc:1275] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.002341 27598 raft_consensus.cc:2749] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4.
I20260709 12:29:11.961898 27670 consensus_queue.cc:1059] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:29:12.009341 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.925644 27680 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:12.007963 27652 raft_consensus.cc:2749] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:12.120870 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 194830us
I20260709 12:29:12.005275 27677 consensus_queue.cc:1059] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 12:29:12.117089 27659 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.133421 26507 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
W20260709 12:29:12.296918 26477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:12.297670 26477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.305019 27302 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:12.299916 27708 log.cc:927] Time spent T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.139s	user 0.000s	sys 0.016s
W20260709 12:29:12.319615 27709 log.cc:927] Time spent T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 12:29:12.151631 27659 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:12.160897 27578 consensus_queue.cc:1048] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.141s
I20260709 12:29:12.300957 27652 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:12.331094 27683 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:12.373996 26661 raft_consensus.cc:1275] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:29:12.375090 27705 log.cc:927] Time spent T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 12:29:12.375634 27713 log.cc:927] Time spent T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:29:12.304230 27704 consensus_queue.cc:1059] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.380s
I20260709 12:29:12.298831 27587 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:12.355702 27690 raft_consensus.cc:2764] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:29:12.355405 27670 consensus_queue.cc:1243] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer 4ecb621c9f7f4c6698e141f131a14c4e log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:12.402119 27683 raft_consensus.cc:697] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
W20260709 12:29:12.412887 27711 log.cc:927] Time spent T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:29:12.406005 27724 raft_consensus.cc:3055] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:29:12.440994 26550 leader_election.cc:336] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.698s (SENT)
I20260709 12:29:12.375540 27680 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:12.444422 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 482457us
I20260709 12:29:12.452750 26625 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
W20260709 12:29:12.446041 27703 consensus_meta.cc:287] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
I20260709 12:29:12.442256 27704 consensus_queue.cc:1243] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer 4ecb621c9f7f4c6698e141f131a14c4e log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:12.427429 27599 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.471382 27599 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:12.472002 27716 log.cc:927] Time spent T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:29:12.473650 27599 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.478228 27725 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.478892 27725 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.481246 27646 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.481470 27725 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.482548 26587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21"
dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:52818
I20260709 12:29:12.482214 27703 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.483160 26587 raft_consensus.cc:606] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:12.483538 26587 raft_consensus.cc:614] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:12.484812 27703 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:12.488786 27595 consensus_meta.cc:287] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.001s
I20260709 12:29:12.490115 27683 consensus_queue.cc:237] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:12.456918 27610 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.497118 27610 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.499516 27610 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:12.450778 27724 raft_consensus.cc:740] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.463186 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:12.501318 27724 consensus_queue.cc:260] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.464830 27732 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.465566 27723 raft_consensus.cc:3055] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:29:12.465160 27710 log.cc:927] Time spent T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 12:29:12.466940 26506 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:12.504599 27722 log.cc:927] Time spent T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:29:12.404979 27587 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.467512 27726 raft_consensus.cc:3055] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:12.507398 27726 raft_consensus.cc:740] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.378973 27652 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.468611 26625 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:12.467278 27690 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:12.508339 27726 consensus_queue.cc:260] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.509477 27726 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.509328 27732 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.469826 26511 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:29:12.500465 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.508836 27690 raft_consensus.cc:697] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.511919 27732 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.512313 27690 consensus_queue.cc:237] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.514372 27652 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:12.465596 27617 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:12.514818 27715 log.cc:927] Time spent T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 12:29:12.515087 27617 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.515748 27724 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:12.517184 27617 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:12.502389 27723 raft_consensus.cc:740] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.501914 26510 raft_consensus.cc:2468] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:12.519332 27670 raft_consensus.cc:3055] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:12.519025 27723 consensus_queue.cc:260] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.508340 27587 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.489880 27707 raft_consensus.cc:3055] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:12.519846 27670 raft_consensus.cc:740] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.520179 27707 raft_consensus.cc:740] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.520354 27723 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.520810 27670 consensus_queue.cc:260] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.522182 27670 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.488987 27591 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.523396 27591 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.525815 26511 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.526014 26510 raft_consensus.cc:1275] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:12.526490 26513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:12.527099 26513 raft_consensus.cc:606] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:12.527436 26513 raft_consensus.cc:614] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:12.527691 27704 raft_consensus.cc:2749] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:12.527395 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 58876.7us
W20260709 12:29:12.531270 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 54505.8us
I20260709 12:29:12.535671 27302 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:12.497503 27659 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:12.545502 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.481920 27646 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.536442 27652 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.541815 27598 raft_consensus.cc:2804] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:12.545298 27610 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.542707 27578 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:29:12.542042 27657 consensus_queue.cc:1048] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:29:12.579502 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.571167 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:12.580770 26504 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.583289 27353 raft_consensus.cc:1275] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:29:12.583926 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.584658 27707 consensus_queue.cc:260] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.585731 27707 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.564934 27623 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.609293 27623 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.610258 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.611681 27623 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:12.564642 27652 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.614127 27652 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.599606 27659 consensus_queue.cc:1048] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:29:12.614279 26550 leader_election.cc:336] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.735s (SENT)
I20260709 12:29:12.597435 27617 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.564407 27598 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
W20260709 12:29:12.616396 26550 leader_election.cc:336] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.758s (SENT)
I20260709 12:29:12.617165 26625 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:12.615943 27617 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:12.608860 27613 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:12.634553 26550 leader_election.cc:336] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.897s (SENT)
I20260709 12:29:12.597529 27591 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.627353 27598 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.656133 27734 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:12.656867 27734 raft_consensus.cc:697] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.657755 27734 consensus_queue.cc:237] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.660660 27617 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:12.662559 26660 raft_consensus.cc:1275] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.663275 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.663779 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:12.664033 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:12.664427 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.664951 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.665098 26658 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.609452 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.634343 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.662832 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:12.666239 27354 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:12.666326 27350 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
W20260709 12:29:12.666826 26550 leader_election.cc:336] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.012s (SENT)
I20260709 12:29:12.572535 27610 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.663928 26659 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.667493 26506 raft_consensus.cc:1275] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:29:12.667910 27714 log.cc:927] Time spent T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.288s	user 0.000s	sys 0.004s
I20260709 12:29:12.668113 27347 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.668372 27587 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.667068 27652 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.668903 27587 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:12.669256 27652 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.643477 27646 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:12.670502 27345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42142 (request call id 293) took 1036 ms. Trace:
I20260709 12:29:12.671331 27652 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.667815 26477 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:12.671859 27680 consensus_queue.cc:1048] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:12.672941 26477 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:12.673722 27587 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:12.674230 27587 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:12.668919 27610 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:12.674721 27599 raft_consensus.cc:2804] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:12.676159 27599 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.676496 27599 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.677016 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.677645 27347 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:12.679008 26477 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:12.679733 26477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.665740 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:12.680279 27659 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:12.680682 27659 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.681013 27659 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.681173 27598 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:12.683051 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.670938 27345 rpcz_store.cc:276] 0709 12:29:11.633883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.636709 (+  2826us) service_pool.cc:224] Handling call
0709 12:29:11.871854 (+235145us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1eee 000000000036eb39 00007ff1916551e0 00007ff19171e0c4 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:11.872036 (+   182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:11.888966 (+ 16930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:11.897041 (+  8075us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:11.907110 (+ 10069us) log.cc:844] Serialized 26 byte log entry
0709 12:29:12.145480 (+238370us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:12.157762 (+ 12282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:12.157859 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:12.670191 (+512332us) raft_consensus.cc:1685] finished
0709 12:29:12.670209 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:12.670441 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6350,"raft.queue_time_us":24361,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":18560,"spinlock_wait_cycles":9166208,"thread_start_us":225098,"threads_started":1,"wal-append.queue_time_us":399939}
I20260709 12:29:12.686040 27346 raft_consensus.cc:2468] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:12.704825 26653 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.707306 27599 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.708801 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:12.708932 26652 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.709697 26655 raft_consensus.cc:2393] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:12.709930 26657 raft_consensus.cc:1275] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.711323 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.712145 26655 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.713043 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:12.713804 27345 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.690340 26660 raft_consensus.cc:2468] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.725319 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.674552 27587 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.637554 27613 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:12.741717 27677 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.015s	sys 0.014s
I20260709 12:29:12.716766 27652 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.744987 27347 raft_consensus.cc:1240] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:12.771993 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:12.774817 27677 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.015s	sys 0.014s
I20260709 12:29:12.774413 27680 consensus_queue.cc:1048] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:29:12.775578 26654 raft_consensus.cc:2468] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.751981 26477 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:12.777899 27658 raft_consensus.cc:2804] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:12.778328 27658 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.778676 27658 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:12.782227 26550 leader_election.cc:336] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.063s (SENT)
I20260709 12:29:12.783375 26654 raft_consensus.cc:1240] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:12.795095 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:12.726608 27595 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.800551 26509 raft_consensus.cc:1240] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:12.802201 26477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.820946 26660 raft_consensus.cc:1240] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:12.822206 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.727100 27599 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.844038 26507 raft_consensus.cc:1240] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:12.845504 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:12.847865 27350 raft_consensus.cc:1240] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:12.848106 27728 log.cc:927] Time spent T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:29:12.798353 27680 consensus_queue.cc:1048] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:29:12.848917 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.849575 26655 raft_consensus.cc:2468] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:12.850031 26657 raft_consensus.cc:1240] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:12.850726 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.851395 26655 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:12.852401 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.854889 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:12.856043 27613 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:12.796079 27652 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.857296 27610 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.857803 27610 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.858609 27652 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.859536 27658 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:12.859927 27610 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:12.860241 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.852480 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.861248 27694 raft_consensus.cc:3055] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:12.861678 27694 raft_consensus.cc:740] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.861296 26660 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:12.836660 27595 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.851106 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.863133 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.868156 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60298 (request call id 469) took 1016 ms. Trace:
I20260709 12:29:12.862541 27694 consensus_queue.cc:260] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.868387 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.862195 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:12.868813 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 85495.1us
I20260709 12:29:12.869166 27694 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.869629 27739 consensus_queue.cc:1048] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:12.865067 27595 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.871316 26661 raft_consensus.cc:1275] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:12.873195 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:12.865556 27665 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.874293 27665 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:12.853048 26655 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:12.876447 27665 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:12.865954 27673 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.877511 27673 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.866210 26511 raft_consensus.cc:1275] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:12.876400 26655 raft_consensus.cc:1240] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:12.879480 27673 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.866271 26510 raft_consensus.cc:1240] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:12.880865 27659 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.866734 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:12.883754 26550 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:12.844122 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.884932 27733 raft_consensus.cc:2749] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:12.885720 26550 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:12.886070 27741 consensus_queue.cc:1048] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:12.774377 27587 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:12.868620 26660 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:12.867653 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:12.888913 26660 raft_consensus.cc:1240] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:12.889338 26652 raft_consensus.cc:3055] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:12.889729 26652 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.863983 26657 raft_consensus.cc:2468] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:12.890009 26660 raft_consensus.cc:3055] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:12.885756 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:12.890517 26660 raft_consensus.cc:740] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.868607 26578 rpcz_store.cc:276] 0709 12:29:11.851718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.852459 (+   741us) service_pool.cc:224] Handling call
0709 12:29:11.860686 (+  8227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:11.896377 (+ 35691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:11.896410 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:11.992430 (+ 96020us) log.cc:844] Serialized 26 byte log entry
0709 12:29:12.356968 (+364538us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:12.502502 (+145534us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:29:12.743695 (+241193us) log.cc:844] Serialized 14 byte log entry
0709 12:29:12.867777 (+124082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:12.867862 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:12.867904 (+    42us) raft_consensus.cc:1685] finished
0709 12:29:12.867991 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:12.868103 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49918,"prepare.queue_time_us":28664,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2176,"raft.queue_time_us":120728,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":18118,"spinlock_wait_cycles":52651392,"thread_start_us":538769,"threads_started":2,"wal-append.queue_time_us":433790}
I20260709 12:29:12.844383 27598 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:12.891070 26657 raft_consensus.cc:1275] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:12.867412 27301 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:12.893035 27610 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:12.893502 27610 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.893677 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:12.893891 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.894017 27610 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.894331 27349 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.895232 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.895836 27347 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:12.867074 26654 raft_consensus.cc:1240] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:12.897301 27578 consensus_queue.cc:1048] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:12.891287 26512 raft_consensus.cc:2368] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3.
I20260709 12:29:12.894302 27680 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:29:12.890558 26652 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.900008 26654 raft_consensus.cc:3055] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:12.869086 26658 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:12.900378 26654 raft_consensus.cc:740] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.900449 27302 leader_election.cc:400] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3.
I20260709 12:29:12.900836 27302 leader_election.cc:403] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:29:12.893293 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:12.874186 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:12.901968 27354 raft_consensus.cc:2468] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:12.894550 27353 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:12.866701 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:12.891607 26660 consensus_queue.cc:260] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:12.899098 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:12.901990 26477 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:12.893004 26657 raft_consensus.cc:3055] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:12.915529 26477 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:12.915184 26657 raft_consensus.cc:740] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.918948 27301 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:12.861580 27658 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:12.880162 26655 raft_consensus.cc:3055] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:12.900475 26652 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.925529 26660 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.901117 26654 consensus_queue.cc:260] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:12.920075 26657 consensus_queue.cc:260] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:12.927532 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 104641us
I20260709 12:29:12.916539 27733 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:12.911540 27665 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.917922 27652 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:12.909931 27349 raft_consensus.cc:2468] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:12.921695 27599 raft_consensus.cc:2804] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:12.920411 26511 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:12.927054 27578 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:12.955406 26654 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.959313 27578 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.959762 27578 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:12.960777 26579 raft_consensus.cc:1275] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:12.961669 26583 raft_consensus.cc:1275] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.928247 26655 raft_consensus.cc:740] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:12.933727 27733 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:12.945573 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.958360 27659 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:12.944010 27599 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.964394 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:12.943740 27585 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:12.943497 27602 raft_consensus.cc:2749] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3.
I20260709 12:29:12.966275 26508 raft_consensus.cc:2468] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:12.971101 27717 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:12.972627 27610 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:13.045552 26654 raft_consensus.cc:1275] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:12.933136 27724 consensus_queue.cc:1059] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:29:12.990862 26660 raft_consensus.cc:1275] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:12.936733 27652 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.955631 26625 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:12.962366 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:13.025341 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 468413us
I20260709 12:29:13.038841 26584 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:12.991616 27733 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:12.943612 27665 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.011309 27599 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:13.063910 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:13.064620 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.056740 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:13.065573 27349 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
W20260709 12:29:13.073758 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 118202us
I20260709 12:29:13.074745 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:13.076099 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:13.079882 26586 raft_consensus.cc:1275] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.970995 26655 consensus_queue.cc:260] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.087291 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:13.087692 26578 raft_consensus.cc:1275] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:13.053679 27652 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:13.089692 27665 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:13.066980 26579 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:13.075721 26585 raft_consensus.cc:2393] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:13.091954 26505 raft_consensus.cc:1275] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:13.093700 27581 consensus_queue.cc:1048] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:13.096077 27610 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:29:13.097096 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.097301 27581 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.097872 27581 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.100276 27581 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:13.092182 26653 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:13.107863 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:13.108539 26584 raft_consensus.cc:2468] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:13.109488 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:13.110132 26652 raft_consensus.cc:1275] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:13.112426 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:13.112705 27346 raft_consensus.cc:1240] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:13.087339 26655 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.063030 27717 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:13.116614 27717 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:13.062039 27736 raft_consensus.cc:2749] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:13.023295 27585 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:13.117656 27627 consensus_queue.cc:1048] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:13.120664 26657 raft_consensus.cc:3060] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:13.063342 27676 consensus_queue.cc:1048] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:29:13.126582 26550 leader_election.cc:336] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855): Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 2.192s (SENT)
I20260709 12:29:13.119649 27585 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:13.128588 27665 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.110185 26584 raft_consensus.cc:2393] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:13.065012 27345 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
W20260709 12:29:13.139273 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.140308 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:13.112785 27741 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.141877 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:13.152522 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:13.142558 27737 log.cc:927] Time spent T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:29:13.152586 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:13.147462 27741 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:13.160363 26586 raft_consensus.cc:3060] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.162537 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52816 (request call id 63) took 1031 ms. Trace:
I20260709 12:29:13.163010 26580 rpcz_store.cc:276] 0709 12:29:12.131445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.132052 (+   607us) service_pool.cc:224] Handling call
0709 12:29:12.147864 (+ 15812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:12.471705 (+323841us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4800439758. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff19162faa1 00007ff191626b37 00007ff1916269ca 00007ff19171e26f 00007ff19171df37 00007ff19173255c 00007ff191732508 00007ff191732488 00007ff191732443 00007ff1917316ec 00007ff19065ba96
0709 12:29:12.541003 (+ 69298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:12.541035 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:12.541489 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:29:12.926639 (+385150us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:12.926679 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:12.926743 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:13.162229 (+235486us) raft_consensus.cc:1685] finished
0709 12:29:13.162250 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.162467 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2886,"raft.queue_time_us":172728,"raft.run_cpu_time_us":1555,"raft.run_wall_time_us":137524,"spinlock_wait_cycles":25597312,"thread_start_us":743159,"threads_started":2,"wal-append.queue_time_us":610475}
I20260709 12:29:13.138455 27717 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:29:13.168859 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:13.169567 26584 raft_consensus.cc:2468] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
W20260709 12:29:13.170764 26626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.171973 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:13.172616 26652 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.172976 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:13.173731 26511 raft_consensus.cc:2393] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 4: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:13.174652 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:13.175222 26511 raft_consensus.cc:2468] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 1.
I20260709 12:29:13.176108 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:13.176673 26511 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:13.176995 27741 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:13.177695 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:13.178339 26660 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
W20260709 12:29:13.181195 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 106576us
I20260709 12:29:13.184716 27733 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:13.185228 26551 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:13.185961 26581 raft_consensus.cc:2393] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:13.189698 26586 raft_consensus.cc:2468] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:13.137002 26507 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:13.192688 26657 raft_consensus.cc:1275] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:13.125262 27578 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.194200 26625 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:13.150466 27570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.019s	sys 0.010s
I20260709 12:29:13.187752 27724 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:13.139940 27665 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.248668 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:13.249464 26512 raft_consensus.cc:2468] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:13.256146 27750 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.256732 27750 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:13.193153 27598 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
W20260709 12:29:13.248028 27570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.020s	sys 0.010s
W20260709 12:29:13.259073 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 64968.5us
I20260709 12:29:13.259541 27734 raft_consensus.cc:2749] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:13.260293 27724 raft_consensus.cc:697] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:13.261183 27724 consensus_queue.cc:237] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.192245 27657 consensus_queue.cc:1048] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:29:13.263024 26652 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:13.259820 26625 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:13.264680 27690 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:13.265228 27690 raft_consensus.cc:697] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:13.266217 27690 consensus_queue.cc:237] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.270076 26625 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:13.191890 27680 consensus_queue.cc:1048] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:29:13.271513 27585 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:13.254773 27739 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:13.275560 26656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.045s
W20260709 12:29:13.275315 27351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.012s	sys 0.055s
I20260709 12:29:13.302456 26625 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:13.277421 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:13.289048 27658 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:13.300889 27351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.012s	sys 0.055s
W20260709 12:29:13.301007 26656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.011s	sys 0.045s
I20260709 12:29:13.295991 27585 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.297860 27736 raft_consensus.cc:2804] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:29:13.336792 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 421184us
W20260709 12:29:13.357195 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:13.355381 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 53020.1us
I20260709 12:29:13.362753 26625 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:13.362890 26477 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:13.365227 26477 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:13.317611 27750 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:13.369720 26477 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:13.313519 27673 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:13.375455 27673 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:13.397480 26513 raft_consensus.cc:1240] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:13.397713 27736 raft_consensus.cc:697] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:13.398808 27694 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:13.388953 27578 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:13.354509 27734 raft_consensus.cc:2804] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:13.397256 26625 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:13.314808 27739 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:13.360822 27585 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.418047 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52816 (request call id 64) took 1268 ms. Trace:
I20260709 12:29:13.422225 26582 rpcz_store.cc:276] 0709 12:29:12.134223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.134354 (+   131us) service_pool.cc:224] Handling call
0709 12:29:12.150636 (+ 16282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:12.549677 (+399041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:12.549715 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:12.558518 (+  8803us) log.cc:844] Serialized 26 byte log entry
0709 12:29:13.046640 (+488122us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:13.046680 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.046742 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:13.402462 (+355720us) raft_consensus.cc:1685] finished
0709 12:29:13.402483 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.402678 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11197,"raft.queue_time_us":169500,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5496,"thread_start_us":801395,"threads_started":2,"wal-append.queue_time_us":766380}
I20260709 12:29:13.424913 26625 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:13.373625 27595 raft_consensus.cc:2804] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:13.373301 27659 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:13.339964 27658 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:13.419672 27765 log.cc:927] Time spent T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:29:13.420009 27587 consensus_meta.cc:287] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 12:29:13.435463 27750 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:13.436661 27736 consensus_queue.cc:237] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.430431 27659 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.443005 27659 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:13.445664 26625 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:13.454042 27665 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:13.454782 27665 raft_consensus.cc:2804] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:13.455096 27739 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:13.455248 27665 raft_consensus.cc:697] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:13.456285 27665 consensus_queue.cc:237] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.437317 27733 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:13.429387 27744 raft_consensus.cc:2749] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:13.467942 27744 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:29:13.461658 27755 log.cc:927] Time spent T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:29:13.473308 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 316754us
I20260709 12:29:13.449127 27587 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.449651 27750 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:13.473349 26655 raft_consensus.cc:1275] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:13.471978 27744 raft_consensus.cc:697] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
W20260709 12:29:13.490151 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 294949us
W20260709 12:29:13.480123 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 294941us
W20260709 12:29:13.495976 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.497166 27301 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:13.494546 27302 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:13.480188 27652 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.524482 27579 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:13.525775 27301 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:13.527871 27658 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:13.498550 27602 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:29:13.503163 26551 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:13.527832 27579 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.524878 27578 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:29:13.566008 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:13.593752 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:13.598263 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 95178.7us
I20260709 12:29:13.577608 27581 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:13.528273 27680 consensus_queue.cc:1048] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:29:13.604951 27733 raft_consensus.cc:2804] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:13.605443 27733 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.605799 27733 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:13.606909 27756 log.cc:927] Time spent T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 12:29:13.607967 27770 log.cc:927] Time spent T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:29:13.609537 27773 log.cc:927] Time spent T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:29:13.615459 27733 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:13.617671 27733 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:13.627878 27581 raft_consensus.cc:697] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:13.629068 27581 consensus_queue.cc:237] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:13.587195 27599 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:13.633651 27599 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:13.589967 27578 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.645756 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:13.577133 27676 consensus_queue.cc:1048] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:29:13.651620 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:13.604025 27690 raft_consensus.cc:2749] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:13.684334 26586 raft_consensus.cc:1240] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:13.645974 27578 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.645699 27741 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.691105 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:13.692910 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:29:13.693219 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 323588us
W20260709 12:29:13.672971 26476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.892s (SENT) [suppressed 49 similar messages]
I20260709 12:29:13.696419 26586 raft_consensus.cc:1240] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:13.592908 27579 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:13.711985 26477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:13.712425 26477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.685655 27657 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.724606 26551 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:13.698748 27778 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.602202 27744 consensus_queue.cc:237] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.737059 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:13.729336 26477 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:13.787822 26587 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
W20260709 12:29:13.773746 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.717486 27599 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.713816 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:29:13.747049 26626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.731271 27694 raft_consensus.cc:697] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:13.722239 27734 raft_consensus.cc:697] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:13.727015 27673 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:13.709349 27741 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:13.804081 27683 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.815752 26585 raft_consensus.cc:1240] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:13.810052 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:13.736171 27657 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.814574 27587 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:13.826833 26626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.820261 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:13.822564 27617 raft_consensus.cc:2804] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:13.819111 27771 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.822724 27785 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.796759 27778 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.812052 27599 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.824837 27673 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
W20260709 12:29:13.877578 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 431854us
I20260709 12:29:13.866303 26581 raft_consensus.cc:2393] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:13.892875 26625 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:13.880966 27353 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:13.899115 27781 log.cc:927] Time spent T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:29:13.866778 27351 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.906136 27734 consensus_queue.cc:237] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:13.874226 27617 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.873126 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60780 (request call id 378) took 1175 ms. Trace:
I20260709 12:29:13.872987 27652 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:13.906733 27759 log.cc:927] Time spent T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.474s	user 0.005s	sys 0.000s
W20260709 12:29:13.913566 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 188986us
W20260709 12:29:13.872958 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 200025us
W20260709 12:29:13.888607 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 159333us
I20260709 12:29:13.875645 27595 raft_consensus.cc:697] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:13.853569 27683 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:13.899137 27587 raft_consensus.cc:2749] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:13.933743 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.932402 26625 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:13.934865 26551 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:13.945325 26551 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:13.918346 27617 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.944219 26477 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:13.948925 27750 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:13.951272 26551 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:13.980471 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 48280.4us
I20260709 12:29:13.981487 26625 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:13.985970 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:13.987212 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:13.987809 27347 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:13.926512 27690 raft_consensus.cc:2749] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:29:13.945034 27783 log.cc:927] Time spent T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:29:13.990200 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:13.995399 26509 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:13.997491 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 182579us
I20260709 12:29:14.004405 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:14.005369 26582 raft_consensus.cc:2393] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:14.006618 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:14.007398 27346 raft_consensus.cc:2468] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:14.008812 26477 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:14.009341 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:13.902163 27673 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.008833 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:13.887552 27785 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:14.032624 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 51219.2us
W20260709 12:29:14.033563 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 82397.8us
I20260709 12:29:14.036980 27347 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:14.050194 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:13.987509 27751 raft_consensus.cc:2804] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:13.987380 27622 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:14.046211 26477 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:13.887277 27771 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:13.988083 27790 raft_consensus.cc:2749] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:13.987761 27799 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:13.990770 27797 raft_consensus.cc:2804] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:14.080307 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:14.089139 26513 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:14.080727 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:14.090068 27346 raft_consensus.cc:2393] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:14.091092 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:14.091706 27346 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:14.061339 27751 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.091867 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.092286 27751 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:14.067901 27750 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.095008 27750 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:14.081771 27587 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:14.037899 27591 raft_consensus.cc:2749] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:14.037343 27724 raft_consensus.cc:2749] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:13.927091 27694 consensus_queue.cc:237] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:14.112521 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:14.054399 27717 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.053390 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:14.072108 27348 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:14.106940 26625 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:14.070955 27622 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.091267 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.069845 27627 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.072911 27803 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
W20260709 12:29:14.097119 27659 consensus_meta.cc:287] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.000s
W20260709 12:29:14.123637 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 118038us
I20260709 12:29:14.054759 27793 raft_consensus.cc:2804] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:14.087839 27797 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.141515 26509 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:14.097095 27750 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:14.086273 27652 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.244942 27652 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.246649 27657 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:14.162750 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:14.247254 27652 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:14.249027 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.250854 26659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
mode: GRACEFUL
new_leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
 from {username='slave'} at 127.0.0.1:44542
I20260709 12:29:14.251536 26659 raft_consensus.cc:606] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:14.251886 26659 raft_consensus.cc:614] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:14.099864 27799 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.226943 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:14.231359 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 124532us
W20260709 12:29:14.147327 27774 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.010s
I20260709 12:29:14.116484 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.122882 26507 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:14.235360 27627 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:14.167294 26513 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:14.257139 26551 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:14.148604 27741 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:14.151222 27352 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:14.151109 27622 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:14.247807 27652 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.141312 27802 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.218417 27724 raft_consensus.cc:2749] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:14.265758 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:14.085312 27595 consensus_queue.cc:237] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.230232 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52816 (request call id 72) took 1210 ms. Trace:
I20260709 12:29:14.283157 26551 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:14.232564 27793 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:14.262253 27774 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.009s	sys 0.011s
I20260709 12:29:14.140829 27717 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.275516 27750 consensus_queue.cc:1048] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:14.259133 27797 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:14.297535 26551 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:14.240092 27659 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:14.309051 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:14.291224 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:14.321552 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:14.323818 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:14.324841 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:14.288823 27353 raft_consensus.cc:2468] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
W20260709 12:29:14.325235 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:14.301810 27793 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:14.307823 27741 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:14.307461 27683 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:14.307224 27599 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:14.292558 27657 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.331619 26625 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:14.313784 27805 log.cc:927] Time spent T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:29:14.236845 27803 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.315306 27778 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:14.327746 27798 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.327811 27796 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.331784 27740 raft_consensus.cc:2749] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:14.355253 27812 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.359529 27823 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
W20260709 12:29:14.360400 27794 log.cc:927] Time spent T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:29:14.361369 27810 log.cc:927] Time spent T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:29:14.365613 26625 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:14.383706 27673 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:13.918208 26656 rpcz_store.cc:276] 0709 12:29:12.692024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.698695 (+  6671us) service_pool.cc:224] Handling call
0709 12:29:12.712979 (+ 14284us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800200a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:12.713168 (+   189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:12.713612 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:12.713644 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:12.714180 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:29:13.368979 (+654799us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:13.752026 (+383047us) log.cc:844] Serialized 14 byte log entry
0709 12:29:13.809018 (+ 56992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.816615 (+  7597us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:13.820124 (+  3509us) raft_consensus.cc:1685] finished
0709 12:29:13.852666 (+ 32542us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.867040 (+ 14374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86,"prepare.queue_time_us":77098,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":10453,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":182,"spinlock_wait_cycles":28217600,"thread_start_us":918612,"threads_started":2,"wal-append.queue_time_us":713710}
I20260709 12:29:14.294710 27652 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:14.369585 27352 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:14.370237 27803 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:14.371011 27799 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:14.372964 27351 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:14.376489 27785 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:14.379662 27790 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.335309 27752 raft_consensus.cc:2804] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:14.381063 26506 raft_consensus.cc:1275] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:14.327965 27788 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.326795 27813 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.344338 26476 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:14.333258 27676 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.346890 27741 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.333516 27734 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
W20260709 12:29:14.359221 27791 log.cc:927] Time spent T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:29:14.299113 27802 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:14.411363 27665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.014s	sys 0.023s
I20260709 12:29:14.384665 27657 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.294953 26583 rpcz_store.cc:276] 0709 12:29:13.009610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:13.010202 (+   592us) service_pool.cc:224] Handling call
0709 12:29:13.063224 (+ 53022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:13.148474 (+ 85250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:13.153022 (+  4548us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:13.268732 (+115710us) log.cc:844] Serialized 26 byte log entry
0709 12:29:13.593146 (+324414us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:13.600140 (+  6994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.662111 (+ 61971us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:14.123326 (+461215us) raft_consensus.cc:1685] finished
0709 12:29:14.123353 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:14.219859 (+ 96506us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107432,"raft.queue_time_us":46574,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9918,"thread_start_us":315231,"threads_started":1,"wal-append.queue_time_us":457441}
I20260709 12:29:14.415244 27798 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.366807 27690 raft_consensus.cc:2749] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:14.432632 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 67090.2us
I20260709 12:29:14.477502 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.478293 26654 raft_consensus.cc:2393] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:14.436981 27724 raft_consensus.cc:2749] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:14.484474 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.485677 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.459667 27587 raft_consensus.cc:697] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
W20260709 12:29:14.469883 27665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.014s	sys 0.023s
I20260709 12:29:14.490085 27817 consensus_queue.cc:1059] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:29:14.491338 27817 raft_consensus.cc:3055] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:14.491699 27817 raft_consensus.cc:740] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:14.437449 27771 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:14.465687 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 121448us
W20260709 12:29:14.455793 27578 consensus_meta.cc:287] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.000s
W20260709 12:29:14.458771 27579 consensus_meta.cc:287] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.004s
I20260709 12:29:14.430792 27823 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.416169 27796 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.464895 26551 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:14.466210 27680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.016s
I20260709 12:29:14.482491 26625 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:14.463699 27752 raft_consensus.cc:697] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:14.466641 27741 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:29:14.460865 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 230971us
I20260709 12:29:14.488137 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.491864 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:14.468252 27599 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:14.501365 26476 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:14.483369 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:14.492601 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:14.485072 27627 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:14.484915 27717 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:14.488194 27659 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:14.544763 26512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46320 (request call id 61) took 1447 ms. Trace:
I20260709 12:29:14.538811 26657 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:14.540051 27302 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:14.542012 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.472823 27734 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:14.514710 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 50286us
I20260709 12:29:14.499397 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:14.507282 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
W20260709 12:29:14.539825 27680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.007s	sys 0.016s
I20260709 12:29:14.553072 27743 raft_consensus.cc:2749] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:14.553781 27802 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:14.552012 27585 consensus_meta.cc:287] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent flushing consensus metadata: real 1.120s	user 0.012s	sys 0.002s
I20260709 12:29:14.498831 27578 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:14.553995 27823 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:14.566828 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 84426.2us
W20260709 12:29:14.554013 27816 log.cc:927] Time spent T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:29:14.574159 26625 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:14.547906 26512 rpcz_store.cc:276] 0709 12:29:13.097081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:13.255394 (+158313us) service_pool.cc:224] Handling call
0709 12:29:13.288131 (+ 32737us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5800312f98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:13.288346 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:13.288748 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:13.288778 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:13.313315 (+ 24537us) log.cc:844] Serialized 26 byte log entry
0709 12:29:13.823544 (+510229us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:13.823585 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.823651 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:14.537901 (+714250us) raft_consensus.cc:1685] finished
0709 12:29:14.537926 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:14.544691 (+  6765us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":624,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":9961,"spinlock_wait_cycles":50048384,"thread_start_us":454751,"threads_started":1,"wal-append.queue_time_us":802833}
W20260709 12:29:14.564325 27658 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.014s	sys 0.011s
I20260709 12:29:14.508895 27665 consensus_queue.cc:1059] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:29:14.584195 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:14.575958 26657 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:14.511976 27771 consensus_queue.cc:1059] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:29:14.592517 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:14.556608 27796 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:14.515362 27673 consensus_queue.cc:1059] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:29:14.598124 26512 raft_consensus.cc:1240] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:29:14.599061 27784 log.cc:927] Time spent T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.956s	user 0.004s	sys 0.011s
I20260709 12:29:14.554466 27345 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:14.601203 27351 raft_consensus.cc:1275] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:14.571389 27659 raft_consensus.cc:2804] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:14.511147 27579 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:14.639178 27352 raft_consensus.cc:1275] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:14.640100 27665 raft_consensus.cc:3055] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:14.641497 27796 raft_consensus.cc:2749] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:14.569608 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:14.591426 27658 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.015s	sys 0.011s
W20260709 12:29:14.650563 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 78203.6us
I20260709 12:29:14.588027 27744 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.643764 26652 raft_consensus.cc:2393] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
W20260709 12:29:14.652876 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 55033.4us
W20260709 12:29:14.659282 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 158011us
W20260709 12:29:14.665274 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 91372.3us
I20260709 12:29:14.577598 27585 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:14.649523 27750 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.647029 27570 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.587016 27587 consensus_queue.cc:237] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:14.649559 27659 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:14.654023 27665 raft_consensus.cc:740] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:14.466671 27813 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.664197 26505 raft_consensus.cc:1240] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:14.667433 26625 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:14.431258 27812 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:14.688570 27302 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:14.466929 27676 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.462816 27788 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.690270 26580 raft_consensus.cc:1240] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:14.666290 27779 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:14.666904 27652 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:14.694865 26625 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:14.669709 27694 raft_consensus.cc:2749] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:14.457141 27790 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.665896 27744 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:14.700981 27820 log.cc:927] Time spent T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 12:29:14.788816 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 93971.6us
I20260709 12:29:14.687425 27659 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:14.492508 27817 consensus_queue.cc:260] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.685710 27771 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:14.801461 26625 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:14.704082 27837 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.681324 27750 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:14.783366 27345 raft_consensus.cc:1240] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:14.707784 27740 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:14.683804 27570 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:14.709842 27673 consensus_queue.cc:1048] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 12:29:14.829264 27790 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:14.807870 27657 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:14.835005 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 148531us
W20260709 12:29:14.838231 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:14.818096 27694 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.666411 27752 consensus_queue.cc:237] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.826084 27779 raft_consensus.cc:697] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
W20260709 12:29:14.835534 27824 log.cc:927] Time spent T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 12:29:14.697402 27796 raft_consensus.cc:2749] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:14.819276 27803 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:14.835943 27798 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:14.873749 27694 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.902523 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:14.875455 27836 log.cc:927] Time spent T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:29:14.863718 27832 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:14.878113 27744 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:14.883665 27797 consensus_meta.cc:287] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.003s
W20260709 12:29:14.893798 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 65716.7us
I20260709 12:29:14.900528 27585 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:14.871726 27790 raft_consensus.cc:2804] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:14.937458 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.826759 27771 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.861521 27793 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:14.897979 27828 log.cc:927] Time spent T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:29:14.834444 27837 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:14.891204 27843 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.824873 27665 consensus_queue.cc:260] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.936219 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.917405 27803 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.934824 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.903467 26512 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
W20260709 12:29:14.917261 27751 consensus_meta.cc:287] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.004s
I20260709 12:29:14.964295 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.952881 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.953197 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:14.936270 27832 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:14.949156 27741 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.938968 27578 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:14.974469 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.975859 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.850548 27740 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.975035 26657 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:14.974579 27821 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.990959 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:14.977419 27741 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:14.991214 27780 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:14.979058 27579 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:14.991787 27780 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:14.992219 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:14.968876 27825 log.cc:927] Time spent T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:29:15.009615 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:15.013523 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:15.007714 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:15.015309 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:14.973457 27617 consensus_meta.cc:287] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent flushing consensus metadata: real 0.981s	user 0.010s	sys 0.000s
I20260709 12:29:14.973523 27803 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:14.974751 27829 raft_consensus.cc:3055] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:14.970814 27839 raft_consensus.cc:2749] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:14.977051 27832 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:14.970736 27827 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:14.938362 27797 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.966526 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.025382 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.966687 27790 raft_consensus.cc:697] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:14.973726 27750 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:14.975405 27812 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:14.973850 26505 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:14.962380 27744 consensus_queue.cc:1048] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:29:15.028559 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:14.965080 27798 consensus_queue.cc:1059] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:29:14.974222 27659 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:14.994019 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.989019 26506 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:15.037824 26507 raft_consensus.cc:2393] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:15.060189 26654 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:14.971385 27843 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.063642 26512 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:14.973964 27751 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.065652 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:14.990805 27834 consensus_queue.cc:1059] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:29:15.099531 27834 raft_consensus.cc:3055] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:15.099954 27834 raft_consensus.cc:740] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:15.100831 27834 consensus_queue.cc:260] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.102031 27834 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.022496 27617 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.036895 27676 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.072746 26657 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:15.103704 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.104315 27617 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.104753 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.038893 27694 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.038604 27813 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.076627 26505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:14.990999 27821 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:15.111218 27821 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.111704 27821 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.112114 27821 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.008148 27779 consensus_queue.cc:237] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.115358 26505 raft_consensus.cc:606] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:15.115880 26505 raft_consensus.cc:614] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:15.078215 27740 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.116766 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:15.079952 27659 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.083410 27843 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:15.081545 27622 consensus_meta.cc:287] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent flushing consensus metadata: real 0.786s	user 0.002s	sys 0.007s
I20260709 12:29:15.085099 27796 raft_consensus.cc:3055] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:15.075981 27771 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.087297 27793 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.123601 26512 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 5.
I20260709 12:29:15.093032 27751 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.038686 27829 raft_consensus.cc:740] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:15.061012 27827 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:15.105459 26657 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:15.076123 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
W20260709 12:29:15.119057 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 175342us
W20260709 12:29:15.091118 27835 log.cc:927] Time spent T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:29:15.124850 26551 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:15.127683 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:15.129374 26654 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:15.141369 27751 raft_consensus.cc:2804] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:15.141840 27751 raft_consensus.cc:697] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:15.143090 27797 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.142721 27751 consensus_queue.cc:237] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:15.146167 27346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42142 (request call id 323) took 1086 ms. Trace:
I20260709 12:29:15.146698 27346 rpcz_store.cc:276] 0709 12:29:14.059624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.351399 (+291775us) service_pool.cc:224] Handling call
0709 12:29:14.351724 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.815052 (+463328us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:29:14.835827 (+ 20775us) log.cc:844] Serialized 14 byte log entry
0709 12:29:15.044211 (+208384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:15.044269 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:29:15.044311 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.145697 (+101386us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400007b54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:15.145747 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.145883 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39392,"prepare.queue_time_us":21912,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":16197,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5041,"spinlock_wait_cycles":1064989568,"thread_start_us":207692,"threads_started":1}
I20260709 12:29:15.148234 26654 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:15.130208 27827 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:15.151599 27734 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.150422 27821 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.130895 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.155637 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:15.128684 27570 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.156164 27353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42142 (request call id 326) took 1063 ms. Trace:
I20260709 12:29:15.156594 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.158166 26654 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.106242 27788 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.132433 27837 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.125525 27622 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:15.133457 27790 consensus_queue.cc:237] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.134528 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:15.072803 26652 raft_consensus.cc:2468] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:15.139562 27829 consensus_queue.cc:260] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.125665 27796 raft_consensus.cc:740] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:15.166220 26512 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.156208 26657 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:15.163668 26477 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.190650 26477 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.194175 26477 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.198387 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.199246 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:15.212251 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:15.213446 26477 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.220264 26512 raft_consensus.cc:2468] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:15.220865 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.223304 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.233672 26551 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:15.234508 26512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:15.235334 26512 raft_consensus.cc:606] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:15.235710 26512 raft_consensus.cc:614] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:15.241057 26477 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:15.229457 26657 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:15.186717 27570 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:15.195026 27821 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:15.279243 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.201081 27829 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.200765 27793 raft_consensus.cc:2804] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:15.280871 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:15.278990 26477 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.285280 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:15.288003 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 54451.9us
I20260709 12:29:15.342244 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.228595 27797 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:15.344368 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.344851 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:15.353360 26509 raft_consensus.cc:2393] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:15.354002 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.284593 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.348193 27347 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:15.348296 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 69410.1us
I20260709 12:29:15.156620 27353 rpcz_store.cc:276] 0709 12:29:14.092738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.358950 (+266212us) service_pool.cc:224] Handling call
0709 12:29:14.359321 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.818538 (+459217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.822048 (+  3510us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:14.834161 (+ 12113us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:14.836969 (+  2808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.155917 (+318948us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540003fcd4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:15.155985 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.156110 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006604160}
I20260709 12:29:15.358659 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.281723 27788 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:15.286190 26583 raft_consensus.cc:1240] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:29:15.281417 27740 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:15.409731 27740 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.412106 27740 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.287062 27821 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:15.371796 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.413429 27821 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.281893 27570 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.419355 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.420559 27570 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:29:15.367259 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 83882.7us
I20260709 12:29:15.426157 27349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42142 (request call id 329) took 1332 ms. Trace:
I20260709 12:29:15.382956 27347 raft_consensus.cc:2468] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:15.253435 27352 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:15.340714 27837 consensus_queue.cc:1048] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:29:15.427157 27349 rpcz_store.cc:276] 0709 12:29:14.093626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.434668 (+341042us) service_pool.cc:224] Handling call
0709 12:29:14.434969 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.704068 (+269099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.704100 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:14.704145 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:14.704176 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.425907 (+721731us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400004454. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:15.425955 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.426092 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618419968}
I20260709 12:29:15.384852 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.340745 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:15.386379 27801 log.cc:927] Time spent T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 1.119s	user 0.002s	sys 0.000s
I20260709 12:29:15.350709 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:15.440141 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.440668 27350 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:15.441272 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.441536 27353 raft_consensus.cc:2393] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:15.441908 26661 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:15.442720 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.365733 27857 raft_consensus.cc:2804] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:15.401841 27622 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:15.403280 27854 log.cc:927] Time spent T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260709 12:29:15.436710 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:15.438813 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:15.439011 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.443266 26661 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:15.548769 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.549762 26582 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:15.436304 27866 raft_consensus.cc:2804] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:29:15.554179 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:15.555316 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.342893 27796 consensus_queue.cc:260] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.551847 27690 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.582676 27690 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.584692 27690 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.446990 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:15.585898 27863 log.cc:927] Time spent T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:29:15.586395 26654 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:15.587301 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:15.587673 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52816 (request call id 88) took 1006 ms. Trace:
I20260709 12:29:15.588274 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.447666 26477 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.588083 26583 rpcz_store.cc:276] 0709 12:29:14.581277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.587863 (+  6586us) service_pool.cc:224] Handling call
0709 12:29:14.598315 (+ 10452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:15.399037 (+800722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.587419 (+188382us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540051d454. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:15.587613 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373401472}
I20260709 12:29:15.365229 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.589632 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60780 (request call id 391) took 1113 ms. Trace:
W20260709 12:29:15.483860 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:15.438863 27856 log.cc:927] Time spent T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:29:15.555671 27866 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:15.590853 27866 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:15.591770 27861 log.cc:927] Time spent T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:29:15.581699 27827 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:15.465487 26509 raft_consensus.cc:2393] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 3: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:15.592912 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:15.593463 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:15.595369 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:15.596540 26582 raft_consensus.cc:2393] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:15.597062 27796 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:15.592447 27734 consensus_queue.cc:1175] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:29:15.445201 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.570238 27857 raft_consensus.cc:697] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:15.621064 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:15.623064 26512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac3baa350f54fe492420693918644a7"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:15.623826 26512 raft_consensus.cc:606] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:15.624208 26512 raft_consensus.cc:614] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:15.630666 26512 raft_consensus.cc:1240] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:29:15.635234 27871 log.cc:927] Time spent T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:29:15.594756 27652 raft_consensus.cc:2749] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:15.640218 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.640518 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.641551 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.641898 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.642477 26584 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:15.643962 27587 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:15.644943 26509 raft_consensus.cc:1275] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.645857 27587 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:15.626524 27834 consensus_meta.cc:287] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent flushing consensus metadata: real 0.524s	user 0.013s	sys 0.000s
I20260709 12:29:15.633211 27346 raft_consensus.cc:2468] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:15.663770 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.664677 27301 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.665756 27301 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.668589 27301 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.590004 26656 rpcz_store.cc:276] 0709 12:29:14.475951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.483745 (+  7794us) service_pool.cc:224] Handling call
0709 12:29:14.493039 (+  9294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:14.569259 (+ 76220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.572657 (+  3398us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:14.594139 (+ 21482us) log.cc:844] Serialized 26 byte log entry
0709 12:29:15.149886 (+555747us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b18001f6a80. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff189619522 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:29:15.195262 (+ 45376us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:15.402558 (+207296us) log.cc:844] Serialized 14 byte log entry
0709 12:29:15.446784 (+ 44226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.485498 (+ 38714us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:15.589332 (+103834us) raft_consensus.cc:1685] finished
0709 12:29:15.589448 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.589575 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28272,"prepare.queue_time_us":129378,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":56169,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":31162,"spinlock_wait_cycles":5065600,"thread_start_us":550319,"threads_started":2,"wal-append.queue_time_us":714354}
I20260709 12:29:15.677219 27857 consensus_queue.cc:237] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.683681 27827 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.684448 27827 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:15.684867 27827 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:15.695961 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.696878 26582 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:15.697253 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.698405 27587 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.691011 27717 raft_consensus.cc:2804] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:15.716761 27717 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:15.717195 27717 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.717314 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60780 (request call id 395) took 1240 ms. Trace:
I20260709 12:29:15.717859 26658 rpcz_store.cc:276] 0709 12:29:14.477074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.483638 (+  6564us) service_pool.cc:224] Handling call
0709 12:29:14.490284 (+  6646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.601847 (+111563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.606795 (+  4948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:14.647239 (+ 40444us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:14.649363 (+  2124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.716984 (+1067621us) spinlock_profiling.cc:243] Waited 97.6 ms on lock 0x7b5400581e54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:15.717038 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.717241 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224400640}
I20260709 12:29:15.673712 27829 raft_consensus.cc:2804] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:15.686287 27602 raft_consensus.cc:2804] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:15.685185 27827 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.724310 27350 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:15.725350 27602 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:15.722607 27829 raft_consensus.cc:697] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:15.729230 27807 consensus_queue.cc:1059] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 12:29:15.747475 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 299866us
I20260709 12:29:15.735718 27602 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.751094 27829 consensus_queue.cc:237] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:15.749619 26479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:15.774214 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:15.742245 27793 raft_consensus.cc:697] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:15.744102 27788 raft_consensus.cc:697] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:15.793154 27302 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:15.743794 27821 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.797052 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:29:15.811766 26550 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:15.812448 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.814853 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:15.819988 27302 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:15.822227 26550 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:15.824008 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.819365 26582 raft_consensus.cc:2393] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:15.820739 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.775815 27797 raft_consensus.cc:697] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:15.834197 27302 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:15.827515 26509 raft_consensus.cc:1240] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:29:15.776435 27834 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:15.829116 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:15.800338 27843 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:15.817303 27802 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.816483 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.821193 27740 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.817768 27570 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:15.816840 27813 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:15.830776 27855 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:15.830924 27741 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.844551 27750 raft_consensus.cc:2749] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:15.834084 27676 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:15.849253 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:15.852020 27855 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:15.851382 27683 raft_consensus.cc:2749] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:15.851293 27881 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:15.852933 27793 consensus_queue.cc:237] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.893412 27881 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:15.895677 27881 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.896155 26652 raft_consensus.cc:1240] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:15.845999 27834 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.848795 27843 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.847945 27802 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.851703 27570 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.849529 27740 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.844139 27788 consensus_queue.cc:237] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.853338 27813 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.890332 27855 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.867795 26581 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:15.924516 27823 raft_consensus.cc:3055] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:15.924286 27797 consensus_queue.cc:237] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.924871 26661 raft_consensus.cc:1275] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:15.925479 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60780 (request call id 393) took 1449 ms. Trace:
W20260709 12:29:15.920521 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 86399.1us
I20260709 12:29:15.925844 26659 rpcz_store.cc:276] 0709 12:29:14.476515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.478861 (+  2346us) service_pool.cc:224] Handling call
0709 12:29:14.479197 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.549520 (+ 70323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.549556 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:14.549602 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:14.549633 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.925247 (+1375614us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b54007f0b54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:15.925297 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.925419 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161240448}
I20260709 12:29:15.933638 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.935266 27349 raft_consensus.cc:1240] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:15.940712 27349 raft_consensus.cc:1240] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:15.943043 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:15.944034 27809 log.cc:927] Time spent T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 1.833s	user 0.038s	sys 0.042s
I20260709 12:29:15.944519 27353 raft_consensus.cc:1240] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:15.945211 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52816 (request call id 84) took 2151 ms. Trace:
I20260709 12:29:15.945843 27350 raft_consensus.cc:1240] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:15.947832 27802 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.945618 26578 rpcz_store.cc:276] 0709 12:29:13.793909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:13.796710 (+  2801us) service_pool.cc:224] Handling call
0709 12:29:13.819094 (+ 22384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:13.901032 (+ 81938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:13.901067 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:13.901612 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:29:13.995766 (+ 94154us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:13.995817 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.276096 (+1280279us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b54003dc054. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:15.289520 (+ 13424us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:15.860737 (+571217us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:29:15.944982 (+ 84245us) raft_consensus.cc:1685] finished
0709 12:29:15.945009 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.945138 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2803,"raft.queue_time_us":13693,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":23500,"spinlock_wait_cycles":116812288,"thread_start_us":93711,"threads_started":1,"wal-append.queue_time_us":149173}
I20260709 12:29:15.942382 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:15.948618 27813 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:15.950094 27570 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.951714 27834 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.929010 27750 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:15.955005 27750 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:15.955794 27821 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.957224 27750 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:15.958122 27837 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:15.959108 27843 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.961320 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:15.961997 26661 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
W20260709 12:29:15.962059 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:15.963721 27837 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.965886 27837 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:15.966571 27815 consensus_queue.cc:1048] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.967803 27740 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.963801 27741 raft_consensus.cc:2749] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:15.958356 27602 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:15.970355 27301 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:15.926775 27823 raft_consensus.cc:740] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:15.974467 27823 consensus_queue.cc:260] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.975612 27823 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.975935 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:15.976576 26657 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.982087 27807 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:15.982700 27807 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:15.983067 27807 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:15.986618 27837 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:15.987332 27837 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.989632 27837 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.991675 27602 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:15.991847 27837 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:15.992503 27837 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:15.968003 27717 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:15.994630 27837 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:15.996207 27717 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:15.996533 26578 raft_consensus.cc:1240] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:29:15.997175 27807 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.000118 27302 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:16.001061 26657 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:16.023012 27302 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:16.024051 27301 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:16.026098 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 203954us
I20260709 12:29:16.028214 26512 raft_consensus.cc:1240] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:16.026945 26550 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.007469 27779 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:16.011802 27866 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.028888 27889 raft_consensus.cc:2749] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.030092 27741 raft_consensus.cc:2749] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.039019 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
W20260709 12:29:16.096619 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:16.195973 26479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.031963 26550 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:16.261567 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 223895us
I20260709 12:29:16.036289 27893 raft_consensus.cc:2804] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:16.266160 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.273386 26661 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.277984 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:16.033533 27866 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:16.035594 27807 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.034478 27815 raft_consensus.cc:2749] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.033788 27683 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.322319 27893 raft_consensus.cc:697] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:16.325068 27676 consensus_queue.cc:1059] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:29:16.326694 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.039979 27779 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:16.352571 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:16.330964 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 299049us
I20260709 12:29:16.335979 27734 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.338405 26661 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:16.339217 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.340756 27741 raft_consensus.cc:2749] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.341244 27889 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:16.341244 27683 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.329775 27813 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:16.359880 27813 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:16.360299 27779 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.361986 27780 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.362030 27683 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.344521 26511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55310 (request call id 428) took 2046 ms. Trace:
W20260709 12:29:16.346886 26626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.378877 27855 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.347383 27345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42140 (request call id 404) took 1124 ms. Trace:
I20260709 12:29:16.383180 27813 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.033453 27827 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.384610 27855 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.386014 27827 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.386744 27345 rpcz_store.cc:276] 0709 12:29:15.222562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.230324 (+  7762us) service_pool.cc:224] Handling call
0709 12:29:16.038821 (+808497us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:16.347282 (+308461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22734208}
W20260709 12:29:16.348858 27885 log.cc:927] Time spent T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.441s	user 0.002s	sys 0.002s
I20260709 12:29:16.348589 27893 consensus_queue.cc:237] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.356606 27734 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.389580 27734 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.358716 27889 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:16.359308 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46320 (request call id 66) took 1468 ms. Trace:
I20260709 12:29:16.383937 27790 consensus_queue.cc:1059] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:16.390990 26507 rpcz_store.cc:276] 0709 12:29:14.890674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.893213 (+  2539us) service_pool.cc:224] Handling call
0709 12:29:16.359056 (+1465843us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54003a3c54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:16.359215 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66812160}
I20260709 12:29:16.391846 27790 raft_consensus.cc:3055] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:16.392009 27889 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:16.392393 27790 raft_consensus.cc:740] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:16.393486 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.393321 27790 consensus_queue.cc:260] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:16.394142 26661 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:16.399107 27790 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.407135 27717 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.379245 26653 raft_consensus.cc:2410] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:29:16.411813 26625 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:16.419575 26625 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:16.424458 26661 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:16.427503 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:16.427608 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 97301.1us
I20260709 12:29:16.428004 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.428649 26657 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:16.429631 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.432613 26659 raft_consensus.cc:2410] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:29:16.432354 27301 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:16.439054 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.440421 26625 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:16.416230 27734 raft_consensus.cc:2804] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:29:16.431659 26653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60790 (request call id 611) took 1464 ms (client timeout 1660 ms). Trace:
I20260709 12:29:16.425652 27837 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.431972 27724 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:16.415781 27717 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.453956 26625 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:16.440680 27893 raft_consensus.cc:2804] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:16.436260 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.447865 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.443485 26661 raft_consensus.cc:3060] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.472985 27807 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:16.485711 27807 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:16.478754 27790 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:16.470939 27837 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:16.488106 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.489948 27837 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.479828 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.490240 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:16.491250 27345 raft_consensus.cc:2393] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:16.491500 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.492156 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.492600 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.444258 27734 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:16.443778 27796 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:16.482717 27581 raft_consensus.cc:493] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:16.484449 27676 raft_consensus.cc:3055] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:16.485159 27602 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.478973 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.493419 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55310 (request call id 423) took 2385 ms. Trace:
I20260709 12:29:16.488047 27807 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.498425 27734 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.480620 26625 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:16.445152 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.471706 27724 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
W20260709 12:29:16.501175 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 54375.8us
I20260709 12:29:16.445860 27352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42140 (request call id 408) took 1219 ms. Trace:
I20260709 12:29:16.509310 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.498281 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:16.414666 26511 rpcz_store.cc:276] 0709 12:29:14.298425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.323542 (+ 25117us) service_pool.cc:224] Handling call
0709 12:29:14.367690 (+ 44148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.553094 (+185404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.553129 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:14.553180 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:14.553213 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.343838 (+1790625us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540038fed4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:16.344013 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.344397 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413466880}
I20260709 12:29:16.511178 26661 raft_consensus.cc:2468] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:16.502247 27676 raft_consensus.cc:740] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:16.505669 27906 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:16.520954 26625 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:16.505568 27893 raft_consensus.cc:697] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:16.512352 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55310 (request call id 424) took 2383 ms. Trace:
I20260709 12:29:16.520457 27724 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.507831 27602 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.531358 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.504160 27581 raft_consensus.cc:515] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:16.540119 26661 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.524129 27796 raft_consensus.cc:2749] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.527208 27905 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:16.506037 26504 rpcz_store.cc:276] 0709 12:29:14.107841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.110014 (+  2173us) service_pool.cc:224] Handling call
0709 12:29:14.229220 (+119206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.498383 (+269163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.498439 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:14.498499 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:14.498541 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.493131 (+1994590us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54005bf754. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:16.493182 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.493342 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610740096}
I20260709 12:29:16.532080 27837 raft_consensus.cc:3060] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:16.444523 26653 rpcz_store.cc:269] 0709 12:29:14.951890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.955488 (+  3598us) service_pool.cc:224] Handling call
0709 12:29:16.339033 (+1383545us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b5800200a98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:16.416222 (+ 77189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61567232}
I20260709 12:29:16.534895 27676 consensus_queue.cc:260] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:16.547245 27676 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.548599 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55310 (request call id 436) took 1617 ms. Trace:
I20260709 12:29:16.549045 26506 rpcz_store.cc:276] 0709 12:29:14.931536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.547689 (+1616153us) service_pool.cc:224] Handling call
0709 12:29:16.548028 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.548216 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:16.548242 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:16.548285 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:16.548329 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.548401 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.548537 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:16.531857 26508 rpcz_store.cc:276] 0709 12:29:14.128687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.139786 (+ 11099us) service_pool.cc:224] Handling call
0709 12:29:14.255780 (+115994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.835441 (+579661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.845910 (+ 10469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:14.851851 (+  5941us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:29:14.862166 (+ 10315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.512051 (+1649885us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54003124d4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:16.512131 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.512284 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278226688}
I20260709 12:29:16.555212 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.555998 26652 raft_consensus.cc:2468] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:16.536942 27790 consensus_queue.cc:1059] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:29:16.531119 27906 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:16.560065 27796 consensus_queue.cc:1048] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:29:16.565558 26661 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:16.570772 27893 consensus_queue.cc:237] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:16.520906 27352 rpcz_store.cc:276] 0709 12:29:15.224838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.440163 (+215325us) service_pool.cc:224] Handling call
0709 12:29:16.365138 (+924975us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:16.372613 (+  7475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.414354 (+ 41741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:16.415667 (+  1313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:16.426805 (+ 11138us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:16.429979 (+  3174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.434724 (+  4745us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.444554 (+  9830us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1509,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3077,"spinlock_wait_cycles":10485120}
I20260709 12:29:16.573167 27717 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.574854 27602 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.581115 27581 leader_election.cc:290] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.583420 27906 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:16.569015 27837 raft_consensus.cc:2749] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.583457 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:16.588142 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.588985 26657 raft_consensus.cc:2368] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3.
I20260709 12:29:16.590361 27790 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.590967 27790 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:16.592135 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.593155 27790 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.594935 27346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42140 (request call id 402) took 1394 ms. Trace:
I20260709 12:29:16.595314 27346 rpcz_store.cc:276] 0709 12:29:15.200572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.220556 (+ 19984us) service_pool.cc:224] Handling call
0709 12:29:16.594758 (+1374202us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54001aead4. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:16.594874 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920020736}
I20260709 12:29:16.597080 27345 raft_consensus.cc:2410] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:29:16.598860 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.546001 27905 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.593055 27351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42140 (request call id 407) took 1368 ms. Trace:
I20260709 12:29:16.601406 27351 rpcz_store.cc:276] 0709 12:29:15.224518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.230449 (+  5931us) service_pool.cc:224] Handling call
0709 12:29:16.358539 (+1128090us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:16.591982 (+233443us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1e9c 00007ff1895e1a5b 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:16.592989 (+  1007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26976896}
I20260709 12:29:16.602046 27905 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:16.602542 26477 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.604624 26477 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.609498 27734 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:16.611562 27658 raft_consensus.cc:2749] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:16.612344 27658 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:16.613117 27301 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:16.614502 27724 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:16.616941 26479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.617355 27301 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:16.617818 27724 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:16.614719 26477 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:16.615954 27858 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:29:16.618337 27860 log.cc:927] Time spent T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 1.488s	user 0.012s	sys 0.008s
W20260709 12:29:16.626744 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 129616us
W20260709 12:29:16.628289 26476 connection.cc:256] RPC call timeout handler was delayed by -1.1220877670002665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 12:29:16.629175 26476 connection.cc:256] RPC call timeout handler was delayed by -1.0773540139998659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
I20260709 12:29:16.630438 27301 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:16.631690 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.638665 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.611884 27734 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:16.637246 26477 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:16.642539 26477 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:16.644672 26477 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.648371 26477 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.640455 27676 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:16.650905 27823 raft_consensus.cc:2749] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:16.650341 26477 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:16.649665 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 117294us
I20260709 12:29:16.637368 27658 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.640424 27797 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:16.637076 27812 raft_consensus.cc:2804] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:16.663929 27812 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:16.646416 27587 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:16.664556 27587 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:16.664970 27587 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:16.665913 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.657742 26586 raft_consensus.cc:1275] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:16.659230 26658 raft_consensus.cc:1240] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:16.660375 26661 raft_consensus.cc:1240] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:16.666548 26657 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:16.669035 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.663416 27797 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:16.669883 27797 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:16.670084 26657 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:16.671766 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.672420 26657 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:16.672984 27837 raft_consensus.cc:3055] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:16.673393 27837 raft_consensus.cc:740] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
W20260709 12:29:16.673844 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.674291 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.661428 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.675040 26511 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:16.661818 26513 raft_consensus.cc:1240] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:16.641925 27858 raft_consensus.cc:697] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:16.677142 26513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41114 (request call id 289) took 2379 ms. Trace:
I20260709 12:29:16.677309 27858 consensus_queue.cc:237] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.650189 27771 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:16.679773 26477 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.662783 27823 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:16.664206 27658 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:16.650878 27676 raft_consensus.cc:697] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:16.660616 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.674423 27812 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.650605 27599 raft_consensus.cc:2749] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.680562 26513 rpcz_store.cc:276] 0709 12:29:14.297592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.297984 (+   392us) service_pool.cc:224] Handling call
0709 12:29:14.298394 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.661660 (+2363266us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54005ace20. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c67ddc0 00007ff18c7081c0 00007ff18c709231 00007ff18c705d8f 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c
0709 12:29:16.675984 (+ 14324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.676898 (+   914us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54003a5554. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:16.677082 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319325312}
I20260709 12:29:16.655201 27302 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:16.660868 27665 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.691172 26477 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:16.680495 27771 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:16.685426 27823 raft_consensus.cc:697] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
W20260709 12:29:16.702631 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 170402us
I20260709 12:29:16.688962 27595 raft_consensus.cc:2749] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.711834 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.721500 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41114 (request call id 300) took 1377 ms. Trace:
W20260709 12:29:16.721755 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.721737 26660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60780 (request call id 390) took 2238 ms. Trace:
I20260709 12:29:16.698737 27354 raft_consensus.cc:1240] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:16.730017 26509 rpcz_store.cc:276] 0709 12:29:15.344547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.650270 (+305723us) service_pool.cc:224] Handling call
0709 12:29:15.650619 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:15.836394 (+185775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.721249 (+884855us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540058b954. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:16.721443 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406235904}
I20260709 12:29:16.732367 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:16.715230 27599 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:16.729961 26660 rpcz_store.cc:276] 0709 12:29:14.475619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.475765 (+   146us) service_pool.cc:224] Handling call
0709 12:29:14.476085 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:14.486811 (+ 10726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.486838 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:14.489704 (+  2866us) log.cc:844] Serialized 26 byte log entry
0709 12:29:14.564927 (+ 75223us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:16.559977 (+1995050us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b18003dea00. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff18c2ae4bc 00007ff1895fc48b 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189616455 00007ff1900fe3c7 00007ff18c7109a7 00007ff18c7200bf
0709 12:29:16.561048 (+  1071us) log.cc:844] Serialized 14 byte log entry
0709 12:29:16.702713 (+141665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.702815 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:16.702865 (+    50us) raft_consensus.cc:1685] finished
0709 12:29:16.714152 (+ 11287us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.714293 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":308959,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":17785,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":11378,"spinlock_wait_cycles":6113152,"thread_start_us":280461,"threads_started":3,"wal-append.queue_time_us":161601,"wal-append.run_cpu_time_us":3379,"wal-append.run_wall_time_us":1335918}
I20260709 12:29:16.731875 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.733558 27599 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:16.723610 27724 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.723522 27734 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.720103 27793 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.735653 27724 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:16.736080 27676 consensus_queue.cc:237] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.737286 27734 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:16.738173 27724 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.739248 27734 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.735694 27599 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:16.739464 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.701535 27912 raft_consensus.cc:2749] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.740521 26661 raft_consensus.cc:2410] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:29:16.741529 27587 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:16.741786 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.742560 26513 raft_consensus.cc:1240] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:16.742729 26661 raft_consensus.cc:2393] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:16.743609 27587 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.736470 27793 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.744177 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.745129 26661 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:16.746141 27793 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:16.701807 27771 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.746436 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.747568 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.759311 26661 raft_consensus.cc:2393] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:16.700755 27659 raft_consensus.cc:2764] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:29:16.747874 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.749058 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.750170 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.750489 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.751619 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.751960 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.752240 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.752976 26654 raft_consensus.cc:1275] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:16.754091 27734 consensus_queue.cc:1059] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:16.754401 27724 consensus_queue.cc:1059] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:16.674209 27837 consensus_queue.cc:260] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.757328 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.762960 26625 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.764952 26657 raft_consensus.cc:2393] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:16.780808 27683 consensus_queue.cc:1059] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:16.747975 26507 raft_consensus.cc:2468] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:16.781525 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.781769 27598 raft_consensus.cc:3055] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:16.781378 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.782202 27598 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:16.782618 27350 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:16.782786 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.783233 27598 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:16.783587 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.783972 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.784430 27598 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.785286 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:16.783612 26511 raft_consensus.cc:2368] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 4. Current term is 5.
I20260709 12:29:16.786787 26652 raft_consensus.cc:2393] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 2: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:16.764766 27911 consensus_queue.cc:1059] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:29:16.766299 27912 consensus_queue.cc:1059] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:29:16.780006 27301 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:16.777807 27812 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:16.782258 27815 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:16.790530 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.786413 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.797889 27301 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:16.801977 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 92530.4us
I20260709 12:29:16.802209 27348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42140 (request call id 406) took 1578 ms. Trace:
I20260709 12:29:16.787818 27914 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.803118 27683 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:16.803648 27683 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:16.804026 27683 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:16.790714 26512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41114 (request call id 299) took 1447 ms. Trace:
I20260709 12:29:16.770933 27734 raft_consensus.cc:3055] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:16.799713 26625 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:16.807502 26512 rpcz_store.cc:276] 0709 12:29:15.343220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.631550 (+288330us) service_pool.cc:224] Handling call
0709 12:29:15.631802 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.028654 (+396852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.790419 (+761765us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540031db54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c706e01 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:16.790651 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911235328}
I20260709 12:29:16.812003 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.810259 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.735328 27823 consensus_queue.cc:237] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:16.848716 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.814574 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.858898 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.859113 26587 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:16.859570 26584 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
W20260709 12:29:16.851665 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 51987.6us
I20260709 12:29:16.862497 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.862784 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.863929 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.864845 26656 raft_consensus.cc:2410] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:29:16.863867 26654 raft_consensus.cc:1275] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:29:16.784631 26510 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:16.802865 27812 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:16.854699 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.855882 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.872539 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:16.857563 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 46674.2us
I20260709 12:29:16.873087 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.873541 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.803225 27914 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:16.874809 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:16.875959 27817 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.876396 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.877079 27914 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:16.878348 27914 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:16.878912 27914 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:16.869971 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52816 (request call id 97) took 1054 ms. Trace:
I20260709 12:29:16.879397 27914 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:16.865859 27581 consensus_queue.cc:1048] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:29:16.858268 27906 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:16.881371 27906 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:16.881781 27906 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:16.883069 27658 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:16.873145 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.857983 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.874385 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:16.803964 27837 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:16.814699 27301 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:16.891168 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 76595.1us
I20260709 12:29:16.892411 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:16.800796 27724 raft_consensus.cc:2749] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:16.865446 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.898605 26660 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:16.813081 27353 raft_consensus.cc:1240] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:16.868613 26657 raft_consensus.cc:1240] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:29:16.853777 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.849488 27659 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.811350 27734 raft_consensus.cc:740] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:16.853996 26579 raft_consensus.cc:1275] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:16.888571 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.897081 26656 raft_consensus.cc:2393] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:16.897279 26587 raft_consensus.cc:1240] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:29:16.807014 27815 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:16.882929 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.911861 26661 raft_consensus.cc:1275] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:16.912147 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.916483 27734 consensus_queue.cc:260] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:16.918640 27913 log.cc:927] Time spent T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.181s	user 0.002s	sys 0.000s
I20260709 12:29:16.919657 26658 raft_consensus.cc:2468] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:16.919857 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:16.900146 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:16.874410 26653 raft_consensus.cc:1240] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:16.876009 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:16.921720 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:16.923825 26551 connection.cc:256] RPC call timeout handler was delayed by -1.0410910319997129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260709 12:29:16.992507 26551 connection.cc:256] RPC call timeout handler was delayed by -1.0180944689996068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 12:29:16.811623 27348 rpcz_store.cc:276] 0709 12:29:15.224116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.230390 (+  6274us) service_pool.cc:224] Handling call
0709 12:29:16.800181 (+1569791us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:16.801627 (+  1446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.801823 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:16.801857 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:16.801900 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:16.801931 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.801998 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.802129 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23240960}
I20260709 12:29:16.907166 27812 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:16.959585 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:16.994367 26551 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.964148 26477 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.955909 27892 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:16.984736 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.910910 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:16.987905 27346 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:16.930805 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.000725 26587 raft_consensus.cc:2468] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:17.001013 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:16.896915 27797 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:16.961880 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:16.998308 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 104557us
I20260709 12:29:16.993112 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.928728 27724 consensus_queue.cc:1059] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:29:17.000109 26551 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:16.928813 27659 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.005425 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:16.982311 26655 raft_consensus.cc:2376] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4. Re-sending same reply.
I20260709 12:29:17.003823 26477 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:16.965595 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52816 (request call id 102) took 1152 ms. Trace:
I20260709 12:29:17.006368 26509 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:16.999406 27734 raft_consensus.cc:3060] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.005808 26625 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:17.011255 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:16.996167 27812 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.014271 27587 raft_consensus.cc:2804] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:17.003418 27892 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:17.009519 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.024907 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:17.006356 27617 raft_consensus.cc:2749] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:16.879469 26583 rpcz_store.cc:276] 0709 12:29:15.811795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.817987 (+  6192us) service_pool.cc:224] Handling call
0709 12:29:16.350469 (+532482us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800003998. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1eee 000000000036eb39 00007ff1916551e0 00007ff19171e0c4 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:16.350681 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.350914 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:29:16.351238 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:29:16.808217 (+456979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:16.811509 (+  3292us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:29:16.848461 (+ 36952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.855348 (+  6887us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.866166 (+ 10818us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293942,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":288804,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":6180608,"thread_start_us":157618,"threads_started":1,"wal-append.queue_time_us":182344}
W20260709 12:29:17.020659 27919 log.cc:927] Time spent T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:29:17.021463 27921 log.cc:927] Time spent T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:29:17.027101 27812 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.023867 27587 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:17.027884 27587 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:17.031733 27302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.022051 27815 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:17.025641 26504 raft_consensus.cc:2393] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:17.029773 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:17.035792 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:17.036036 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:17.036876 26504 raft_consensus.cc:2393] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:17.037084 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.037647 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.040910 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:17.005939 27911 consensus_queue.cc:1059] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:29:17.038301 26504 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:17.010327 26582 rpcz_store.cc:276] 0709 12:29:15.813120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.834316 (+ 21196us) service_pool.cc:224] Handling call
0709 12:29:16.800626 (+966310us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800003998. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:16.800844 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.801052 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:29:16.852155 (+ 51103us) log.cc:844] Serialized 14 byte log entry
0709 12:29:16.965104 (+112949us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:16.965163 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:16.965211 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.965284 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.965526 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51756,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":40,"raft.queue_time_us":82,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6332,"spinlock_wait_cycles":6104320,"thread_start_us":112530,"threads_started":1,"wal-append.queue_time_us":143872}
I20260709 12:29:16.999755 27658 raft_consensus.cc:2749] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.059036 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.062965 26506 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.067119 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:17.053898 27812 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:17.141310 27812 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:17.069545 27351 raft_consensus.cc:1240] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:29:17.143354 27351 raft_consensus.cc:1275] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.144945 27351 raft_consensus.cc:1275] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.008718 27724 raft_consensus.cc:3055] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:17.146456 27724 raft_consensus.cc:740] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:17.147433 27724 consensus_queue.cc:260] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.148707 27724 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.075070 27796 raft_consensus.cc:2804] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:17.150871 27796 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.151299 27796 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.153779 26657 raft_consensus.cc:1275] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:29:17.154253 26657 pending_rounds.cc:85] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting all ops after (but not including) 2
I20260709 12:29:17.001893 27591 raft_consensus.cc:2749] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:17.075579 27587 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.155527 27627 raft_consensus.cc:3055] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:17.155977 27627 raft_consensus.cc:740] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:17.156599 27587 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:29:17.078145 26626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.156813 27627 consensus_queue.cc:260] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:17.157989 27627 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.079782 26660 raft_consensus.cc:1275] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.158768 27837 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.082229 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.162076 26510 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:17.163316 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.164721 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.042116 26508 raft_consensus.cc:1240] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:17.002699 27652 consensus_queue.cc:1048] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:29:17.090265 26512 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:17.097150 27346 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:17.106873 26584 raft_consensus.cc:1275] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:17.073769 27914 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.110860 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:17.169991 26658 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.172935 27683 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.175577 27797 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:17.176718 27914 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:17.113689 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.025638 27892 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:17.117738 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.118402 27659 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:17.119954 26511 raft_consensus.cc:1240] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:17.119968 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:17.202291 26582 raft_consensus.cc:3055] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:17.202704 26582 raft_consensus.cc:740] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:17.202919 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:17.203532 26582 consensus_queue.cc:260] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:17.204324 27350 raft_consensus.cc:3060] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:17.124001 27911 consensus_queue.cc:1243] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:17.125546 26507 raft_consensus.cc:1275] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:17.126515 26505 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:17.128551 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.205641 26581 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:17.130287 27817 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.206571 27817 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.207324 26507 raft_consensus.cc:1275] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:17.131377 26506 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:17.132484 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:17.209178 27869 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.209385 27349 raft_consensus.cc:2393] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:17.209760 26507 raft_consensus.cc:1275] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.133464 27658 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.136662 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:17.139297 27352 raft_consensus.cc:1240] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:17.154470 26657 pending_rounds.cc:107] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:29:17.159509 27924 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.227046 27924 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:17.227087 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:17.229293 26586 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.079926 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:17.084201 26625 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.181214 26580 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:17.186498 26658 raft_consensus.cc:2468] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:17.187884 27346 raft_consensus.cc:1275] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.167258 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.112588 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.177398 27914 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:17.191720 27587 consensus_queue.cc:1048] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:29:17.191677 27837 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.195485 27665 consensus_queue.cc:1059] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:29:17.210255 26504 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:17.200218 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca2070ba0446fd83db9a1ac2b7f3b8" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.200814 27353 raft_consensus.cc:1240] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:17.201498 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.236379 26512 raft_consensus.cc:1240] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:29:17.235195 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 151184us
I20260709 12:29:17.256035 26625 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:17.238361 26659 raft_consensus.cc:1275] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:29:17.257040 26659 pending_rounds.cc:85] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting all ops after (but not including) 1
I20260709 12:29:17.257364 26659 pending_rounds.cc:107] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:29:17.257635 26659 raft_consensus.cc:2889] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:17.204452 26582 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.123739 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:17.131011 26513 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:17.207489 26652 raft_consensus.cc:2368] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5.
I20260709 12:29:17.130285 26476 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.181457 27920 raft_consensus.cc:3055] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:17.212779 26477 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.221832 26657 raft_consensus.cc:2889] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:17.223779 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:17.220233 27869 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.245244 26335 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45822 (request call id 114) took 5579 ms. Trace:
W20260709 12:29:17.266006 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 251326us
I20260709 12:29:17.267081 26625 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.247972 26332 catalog_manager.cc:5697] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 2 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:17.287082 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 74464.6us
I20260709 12:29:17.286669 26332 catalog_manager.cc:5697] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 3, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:17.247231 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:29:17.280709 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 150495us
I20260709 12:29:17.291440 26476 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.288911 26477 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:17.296615 26625 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.297677 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.297932 26625 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.242462 27790 raft_consensus.cc:3055] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:29:17.281788 27771 consensus_meta.cc:287] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.005s
I20260709 12:29:17.300972 26550 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:17.264181 26586 raft_consensus.cc:2468] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:17.238795 26508 raft_consensus.cc:1275] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.237020 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.239821 26583 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:17.230078 27924 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:17.191244 27797 consensus_queue.cc:1048] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:29:17.244011 27837 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:17.243191 27665 consensus_queue.cc:1243] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer baa04b33c4e846e49c1e22e5f9bfe644 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:29:17.311842 26582 raft_consensus.cc:1275] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:29:17.239367 26505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55310 (request call id 442) took 2161 ms (client timeout 2097 ms). Trace:
I20260709 12:29:17.282331 27920 raft_consensus.cc:740] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:17.316143 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:17.245551 27817 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:17.323205 27924 raft_consensus.cc:2749] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:17.325120 27646 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.320715 27771 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.325558 26578 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 1.
I20260709 12:29:17.333197 27837 raft_consensus.cc:2749] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.318320 26550 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:17.281787 27734 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:17.284617 27788 raft_consensus.cc:2749] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:17.319223 26476 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.285727 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:17.296574 27683 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:17.294934 27652 raft_consensus.cc:2749] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:17.241612 27906 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.240094 27914 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.245626 27658 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.301088 27659 raft_consensus.cc:2749] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:17.304062 27790 raft_consensus.cc:740] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:17.333570 27665 raft_consensus.cc:2804] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:29:17.319219 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 313592us
I20260709 12:29:17.284832 26335 rpcz_store.cc:276] 0709 12:29:11.687434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.693780 (+  6346us) service_pool.cc:224] Handling call
0709 12:29:17.245036 (+5551256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:12.462973 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:12.463502 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:12.463536 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:29:12.463553 (+    17us) tablet.cc:662] Decoding operations
0709 12:29:12.464226 (+   673us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:12.464278 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:12.464304 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:29:12.464842 (+   538us) tablet.cc:701] Row locks acquired
0709 12:29:12.464860 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:29:12.465010 (+   150us) write_op.cc:270] Start()
0709 12:29:12.465131 (+   121us) write_op.cc:276] Timestamp: P: 1783600152464964 usec, L: 0
0709 12:29:12.465154 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:29:12.465816 (+   662us) log.cc:844] Serialized 2093 byte log entry
0709 12:29:12.501738 (+ 35922us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff1895fc0ac 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff18c2a020b
0709 12:29:13.611417 (+1109679us) op_driver.cc:464] REPLICATION: finished
0709 12:29:13.949997 (+338580us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff1895fc0ac 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189618c02 00007ff19013cef0
0709 12:29:14.299359 (+349362us) write_op.cc:301] APPLY: starting
0709 12:29:14.308006 (+  8647us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:14.332291 (+ 24285us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:14.349025 (+ 16734us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:14.377504 (+ 28479us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:14.377693 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:29:14.377739 (+    46us) write_op.cc:312] APPLY: finished
0709 12:29:14.377990 (+   251us) log.cc:844] Serialized 46 byte log entry
0709 12:29:14.378155 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:14.378264 (+   109us) write_op.cc:454] Released schema lock
0709 12:29:14.378308 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:14.378713 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:14.378740 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":673019,"apply.run_cpu_time_us":2571,"apply.run_wall_time_us":87641,"num_ops":5,"prepare.queue_time_us":315787,"prepare.run_cpu_time_us":12084,"prepare.run_wall_time_us":253761,"raft.queue_time_us":618226,"raft.run_cpu_time_us":21615,"raft.run_wall_time_us":715035,"replication_time_us":1146086,"spinlock_wait_cycles":146401408,"thread_start_us":1563428,"threads_started":4,"wal-append.queue_time_us":466855,"wal-append.run_cpu_time_us":23660,"wal-append.run_wall_time_us":2452529}]]}
I20260709 12:29:17.396492 26551 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:17.355993 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 57108.8us
I20260709 12:29:17.351953 26550 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:17.348053 27924 raft_consensus.cc:2749] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:17.371474 27303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.371246 26509 raft_consensus.cc:2393] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:17.358449 27591 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:17.397567 26476 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:17.328670 26505 rpcz_store.cc:269] 0709 12:29:15.078422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.116512 (+ 38090us) service_pool.cc:224] Handling call
0709 12:29:17.239125 (+2122613us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54005be354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:17.239255 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4620594944}
I20260709 12:29:17.352847 27734 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
W20260709 12:29:17.407397 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 55530.7us
I20260709 12:29:17.408298 26550 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:17.361582 27823 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:17.405169 26476 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.406862 26551 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.341086 27920 consensus_queue.cc:260] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:17.413825 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 115978us
I20260709 12:29:17.361294 27892 consensus_queue.cc:1048] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:29:17.416992 26551 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.413506 26476 leader_election.cc:400] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Vote denied by peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855) with higher term. Message: Invalid argument: T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3.
I20260709 12:29:17.418895 26476 leader_election.cc:403] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:29:17.414676 26625 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.398664 27665 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.361447 27779 consensus_queue.cc:1048] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:29:17.405364 27591 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:17.410292 27817 raft_consensus.cc:2749] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.410748 27351 raft_consensus.cc:1240] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:17.410260 27734 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:17.426118 26551 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.426584 26476 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.413918 27740 raft_consensus.cc:2749] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.410110 27823 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.418587 27652 raft_consensus.cc:2804] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:17.416837 27925 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.429419 27920 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.412559 27928 raft_consensus.cc:2749] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:17.421962 27741 raft_consensus.cc:2749] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.475864 27796 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.477428 26506 raft_consensus.cc:3055] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:17.464728 27823 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:17.423322 26625 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:17.424116 27911 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:17.477850 26506 raft_consensus.cc:740] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:17.425136 27665 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.420778 27926 raft_consensus.cc:2749] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.427486 27591 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:17.427532 27793 raft_consensus.cc:2749] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855) with higher term. Message: Invalid argument: T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 2. Current term is 3.
I20260709 12:29:17.434753 27622 raft_consensus.cc:2749] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.434424 27788 raft_consensus.cc:2804] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:17.429639 27797 consensus_queue.cc:1048] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:29:17.427412 27837 consensus_queue.cc:1048] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 12:29:17.488382 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 65152.9us
I20260709 12:29:17.534996 26625 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:17.536059 26625 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:17.462342 26551 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.424214 27922 raft_consensus.cc:2749] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.549635 26657 raft_consensus.cc:1240] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:17.527014 27788 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.551074 27788 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:17.550987 27771 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:17.490433 27931 raft_consensus.cc:2804] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:17.554281 27893 consensus_queue.cc:1048] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:17.554948 27931 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.555371 27931 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.557013 27301 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.560302 27893 raft_consensus.cc:2804] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:17.560904 27893 raft_consensus.cc:697] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:17.561507 27350 raft_consensus.cc:1275] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:17.561932 27893 consensus_queue.cc:237] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:17.568675 26652 raft_consensus.cc:1275] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:17.602573 26661 raft_consensus.cc:1275] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.571244 27864 raft_consensus.cc:2749] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:17.605242 27658 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:17.606752 27598 consensus_queue.cc:1048] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:29:17.503597 27911 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:17.607761 27911 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:17.512135 27302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.610069 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 74089.1us
I20260709 12:29:17.611939 26661 raft_consensus.cc:1240] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:17.474057 27652 raft_consensus.cc:697] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:17.425595 27790 consensus_queue.cc:260] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:17.479624 27796 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:17.522258 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:17.522586 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:17.469277 27817 consensus_queue.cc:1059] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:29:17.523413 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 90171.4us
I20260709 12:29:17.529772 26654 raft_consensus.cc:1275] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:29:17.537490 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 75224.8us
W20260709 12:29:17.539124 27930 log.cc:927] Time spent T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:29:17.542884 27937 raft_consensus.cc:2804] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:17.547065 27914 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:17.547989 27906 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:17.607149 27934 log.cc:927] Time spent T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.125s	user 0.003s	sys 0.000s
I20260709 12:29:17.613240 26656 raft_consensus.cc:1240] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:17.613804 26660 raft_consensus.cc:1275] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.495414 27940 consensus_queue.cc:1048] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:17.613845 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:17.618474 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:17.638800 26657 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:17.639902 26625 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.617843 26658 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:17.620998 26551 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:17.629057 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.642311 27303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.651420 26551 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.617673 27837 raft_consensus.cc:2804] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:17.672175 26657 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 5.
I20260709 12:29:17.628100 27937 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:17.683573 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 394751us
I20260709 12:29:17.685873 26477 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:17.692004 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 52305.1us
I20260709 12:29:17.665570 27751 raft_consensus.cc:2749] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.696050 26509 raft_consensus.cc:1240] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:29:17.681646 27790 raft_consensus.cc:3060] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.697683 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:17.712563 26513 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:17.698287 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:17.706883 27301 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.690297 26477 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.715217 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
W20260709 12:29:17.706722 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.676564 27837 raft_consensus.cc:493] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.723337 27837 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.727022 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:17.730758 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 115413us
I20260709 12:29:17.731951 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.732479 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.697263 26658 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 5.
I20260709 12:29:17.686743 27617 raft_consensus.cc:2749] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:17.717271 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.739043 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:17.739300 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:17.687440 27937 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.734470 26587 raft_consensus.cc:1240] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:29:17.688622 27817 raft_consensus.cc:2749] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.690243 27906 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.733392 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.741155 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:17.726843 27659 raft_consensus.cc:2749] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.752537 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:17.758314 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:17.703603 27796 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:17.696400 27869 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:17.717818 26655 raft_consensus.cc:1240] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:17.760205 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:17.761103 26625 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:17.763666 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:17.720605 27914 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:17.762681 27924 consensus_queue.cc:1059] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:29:17.737352 27932 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.703351 27740 consensus_queue.cc:1048] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:29:17.748533 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:17.736542 27797 consensus_queue.cc:1048] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:29:17.762981 27796 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.743736 27683 consensus_queue.cc:1048] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:29:17.748275 27581 consensus_queue.cc:1048] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:29:17.746368 27793 consensus_queue.cc:1059] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:29:17.710397 27652 consensus_queue.cc:237] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.764055 27906 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:17.765262 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 58464.5us
I20260709 12:29:17.773207 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:17.773427 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 81737.7us
W20260709 12:29:17.802013 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 90504.3us
I20260709 12:29:17.832633 26509 raft_consensus.cc:1275] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:17.835894 26661 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:17.772516 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:17.840029 26658 raft_consensus.cc:2393] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:17.841364 26658 raft_consensus.cc:1240] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:17.839207 27301 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:17.842363 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:17.842543 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:17.765494 27627 raft_consensus.cc:2749] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.844211 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:17.854352 27351 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:17.781046 27817 consensus_queue.cc:1059] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:29:17.851300 27858 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:17.855697 27858 raft_consensus.cc:697] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:17.855919 27817 raft_consensus.cc:3055] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:17.856374 27817 raft_consensus.cc:740] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:17.853045 27354 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:17.850014 27866 raft_consensus.cc:3055] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:17.857424 27866 raft_consensus.cc:740] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:17.774953 27926 consensus_queue.cc:1048] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:29:17.858918 27858 consensus_queue.cc:237] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.805912 27734 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:17.811537 27925 raft_consensus.cc:2749] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:17.844471 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:17.783107 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:17.861120 26660 raft_consensus.cc:1240] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:17.861512 26653 raft_consensus.cc:2376] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3. Re-sending same reply.
I20260709 12:29:17.846585 26661 raft_consensus.cc:1240] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:29:17.848698 27793 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:17.863097 27793 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:17.795365 27724 consensus_meta.cc:287] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent flushing consensus metadata: real 0.643s	user 0.014s	sys 0.000s
I20260709 12:29:17.824254 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:17.782124 27348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42140 (request call id 425) took 1014 ms. Trace:
I20260709 12:29:17.865168 27793 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:17.808889 27922 raft_consensus.cc:2804] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:17.865825 27922 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.866230 27922 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.803891 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:17.817750 26506 consensus_queue.cc:260] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.868454 26506 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:17.847201 27807 consensus_queue.cc:1048] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:29:17.858373 27866 consensus_queue.cc:260] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:17.797503 27796 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:17.845268 26551 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:17.865298 27348 rpcz_store.cc:276] 0709 12:29:16.767261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:17.166296 (+399035us) service_pool.cc:224] Handling call
0709 12:29:17.192995 (+ 26699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:17.245645 (+ 52650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:17.245684 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:17.246342 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 12:29:17.404085 (+157743us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:17.404138 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:17.405776 (+  1638us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:17.606607 (+200831us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4400022b4c. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff18953fc85 00007ff1895406a2 00007ff18c2b21db 00007ff18c2adaaf 00007ff18c2a186e 00007ff18c2a0bb6 00007ff18c2a07d8 00007ff18c2aa221 00007ff18c2aa1d9 00007ff18c2aa169
0709 12:29:17.737123 (+130516us) raft_consensus.cc:1685] finished
0709 12:29:17.737148 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:17.778506 (+ 41358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4317568,"thread_start_us":151998,"threads_started":1,"wal-append.queue_time_us":185415}
I20260709 12:29:17.873538 27866 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:17.786280 27932 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.852584 27301 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:17.834506 27302 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
W20260709 12:29:17.852438 27646 consensus_meta.cc:287] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
W20260709 12:29:17.891659 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 57237.5us
I20260709 12:29:17.893148 27302 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.894387 26477 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.846266 27837 raft_consensus.cc:515] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.908969 27302 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:17.910380 26476 leader_election.cc:400] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855) with higher term. Message: Invalid argument: T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5.
I20260709 12:29:17.912693 27302 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.905230 27948 consensus_queue.cc:1059] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:29:17.914499 27932 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:17.915539 27893 raft_consensus.cc:2749] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.917089 27302 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:17.917881 27893 raft_consensus.cc:2749] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:17.862233 27665 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:17.920545 27665 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:17.920493 27893 consensus_queue.cc:1059] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:17.922191 27813 raft_consensus.cc:3055] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:17.922544 27813 raft_consensus.cc:740] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:17.830076 27823 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
W20260709 12:29:17.924106 26479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.963362 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 118146us
I20260709 12:29:17.964293 26551 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.965564 26551 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.897818 27581 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:17.925274 26477 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
W20260709 12:29:17.979008 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 53804.7us
I20260709 12:29:17.924057 27302 leader_election.cc:400] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 4. Current term is 5.
I20260709 12:29:17.980024 27302 leader_election.cc:403] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:29:17.905447 27627 raft_consensus.cc:2804] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:17.906378 27646 raft_consensus.cc:2749] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:17.923928 27676 raft_consensus.cc:2749] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:17.924778 27779 raft_consensus.cc:2749] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:17.867905 27817 consensus_queue.cc:260] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:17.995826 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 239241us
I20260709 12:29:17.967350 27940 raft_consensus.cc:2749] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:17.898960 27793 consensus_queue.cc:1048] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:29:17.997752 26659 raft_consensus.cc:1275] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:29:17.966804 27914 raft_consensus.cc:697] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:17.979285 27943 raft_consensus.cc:2749] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:18.002485 26659 pending_rounds.cc:85] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting all ops after (but not including) 1
I20260709 12:29:17.968374 27734 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:17.980762 27740 raft_consensus.cc:2804] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:17.981974 27652 raft_consensus.cc:2804] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:18.011384 26659 pending_rounds.cc:107] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 12:29:18.022809 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 57313.1us
I20260709 12:29:18.015666 26476 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:17.983747 27627 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:18.022941 26659 raft_consensus.cc:2889] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:17.923326 27813 consensus_queue.cc:260] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.001380 27348 raft_consensus.cc:1240] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 3. Current term is 4. Ops: []
W20260709 12:29:18.035682 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 56644.3us
I20260709 12:29:18.026333 26476 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:17.982460 27683 consensus_queue.cc:1059] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:29:17.983413 27591 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.045296 26625 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:18.020625 27740 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:18.046726 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:18.027791 27627 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.053027 27956 raft_consensus.cc:2749] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:18.026901 27676 raft_consensus.cc:2749] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 4. Current term is 5.
I20260709 12:29:18.040794 27780 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:18.037911 27940 raft_consensus.cc:2749] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:18.046988 27813 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:18.065471 26582 raft_consensus.cc:1240] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:18.042568 27652 raft_consensus.cc:697] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:18.044577 27928 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:18.046837 27659 raft_consensus.cc:2749] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:18.068413 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 44721.3us
W20260709 12:29:18.068800 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 144887us
I20260709 12:29:18.021529 27788 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.054900 27960 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.060796 27740 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:18.088603 27302 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:18.062260 27780 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:18.131204 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:18.131662 27780 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:18.071200 26508 raft_consensus.cc:2468] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:18.065961 27581 raft_consensus.cc:697] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:18.127717 27962 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:18.129014 27946 log.cc:927] Time spent T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:29:18.142222 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:18.146360 26625 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
W20260709 12:29:18.143476 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 55986.7us
I20260709 12:29:18.140926 27598 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
W20260709 12:29:18.155175 27955 log.cc:927] Time spent T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:29:18.155109 27598 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.134931 27676 consensus_queue.cc:1059] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:29:18.157171 27598 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.159435 27349 raft_consensus.cc:2468] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:18.160192 27962 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:18.134699 27958 log.cc:927] Time spent T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:29:18.162794 27932 raft_consensus.cc:2804] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:18.163295 27932 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.162350 27962 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.164742 26551 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:18.089228 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52816 (request call id 127) took 1197 ms. Trace:
I20260709 12:29:18.170351 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:18.084605 27948 consensus_queue.cc:1048] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:29:18.191592 26509 raft_consensus.cc:1240] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:29:18.176208 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.134574 26655 raft_consensus.cc:1240] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:29:18.062422 27953 consensus_queue.cc:1059] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:29:18.160743 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:18.150329 27924 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.142845 27869 raft_consensus.cc:493] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.193033 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:18.148207 27906 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.089128 27928 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.163669 27932 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.191118 26505 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:18.209151 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 120620us
I20260709 12:29:18.195619 27741 raft_consensus.cc:2804] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:18.125972 27943 consensus_queue.cc:1059] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:29:18.217775 27302 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:18.077019 27914 consensus_queue.cc:237] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.221603 27302 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:18.171674 27622 consensus_queue.cc:1048] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:29:18.219944 27837 leader_election.cc:290] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.240095 27346 raft_consensus.cc:1240] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:18.244552 27346 raft_consensus.cc:1240] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:18.219004 27931 consensus_meta.cc:287] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.003s
I20260709 12:29:18.249778 27302 leader_election.cc:304] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:18.252874 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 58734.8us
I20260709 12:29:18.194170 27937 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.201759 27922 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.241519 27676 raft_consensus.cc:2749] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:18.215721 27780 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.219841 27741 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:18.217605 27823 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:18.152782 27960 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.240412 27788 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:18.251420 27779 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:18.211035 27924 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.288046 26654 raft_consensus.cc:2393] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:18.210574 27869 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.299866 26625 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:18.301429 26625 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:18.290478 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 264250us
W20260709 12:29:18.292024 27301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.204627 27652 consensus_queue.cc:237] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.293156 26661 raft_consensus.cc:2393] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:18.230872 27906 consensus_queue.cc:1048] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:29:18.289655 27741 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.306633 26476 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:18.287289 27813 raft_consensus.cc:2749] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:18.259946 27931 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.311748 26476 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:18.294610 27779 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.251721 27581 consensus_queue.cc:237] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:18.297856 27591 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:18.309087 27837 raft_consensus.cc:2749] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:18.309315 27953 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:18.328223 27975 raft_consensus.cc:2749] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:18.328826 27974 consensus_queue.cc:1059] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:18.329241 27924 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.330557 27960 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:18.334710 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:18.192770 26579 rpcz_store.cc:276] 0709 12:29:16.892306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:17.003188 (+110882us) service_pool.cc:224] Handling call
0709 12:29:17.017073 (+ 13885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:17.377106 (+360033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:17.394277 (+ 17171us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:17.428987 (+ 34710us) log.cc:844] Serialized 26 byte log entry
0709 12:29:17.757902 (+328915us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:17.976887 (+218985us) log.cc:844] Serialized 14 byte log entry
0709 12:29:18.054689 (+ 77802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:18.064901 (+ 10212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:18.066304 (+  1403us) raft_consensus.cc:1685] finished
0709 12:29:18.069684 (+  3380us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:18.086946 (+ 17262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87611,"prepare.queue_time_us":221315,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":8574,"raft.queue_time_us":80555,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":6490,"thread_start_us":766214,"threads_started":3,"wal-append.queue_time_us":381847}
I20260709 12:29:18.343704 26476 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:18.314582 27788 raft_consensus.cc:2804] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:18.353785 26506 raft_consensus.cc:1275] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:18.324225 27779 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:18.302840 27968 consensus_queue.cc:1048] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:29:18.362520 26660 raft_consensus.cc:1275] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.368366 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:18.368975 26513 raft_consensus.cc:2376] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3. Re-sending same reply.
I20260709 12:29:18.369231 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:18.368144 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:18.369910 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 80755us
I20260709 12:29:18.341678 27953 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.395292 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:18.397336 26660 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:18.357362 27893 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.355194 27974 consensus_queue.cc:1243] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer 4b371ddb5e924d6e8b56b476a69a27d0 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:29:18.400293 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:18.357632 27793 raft_consensus.cc:2749] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:18.357849 27788 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.402402 26509 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:18.401587 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:18.320923 27967 consensus_queue.cc:1048] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:29:18.414968 27780 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:18.417588 27911 consensus_meta.cc:287] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0: Time spent flushing consensus metadata: real 0.809s	user 0.010s	sys 0.002s
I20260709 12:29:18.419070 27928 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:18.422708 27931 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.406139 27893 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.405305 27788 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.424799 27893 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:18.426477 27617 raft_consensus.cc:3055] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:18.427037 27617 raft_consensus.cc:740] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:18.427992 27617 consensus_queue.cc:260] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.429064 27922 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.429267 27617 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.362282 27740 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.361546 27796 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:18.432425 27740 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:18.433087 26656 raft_consensus.cc:1240] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:18.434180 27796 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:18.434710 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:18.398380 27953 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:18.409767 27970 log.cc:927] Time spent T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:29:18.444687 27866 consensus_meta.cc:287] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 12:29:18.409485 27950 consensus_queue.cc:1059] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.401247 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46320 (request call id 102) took 1269 ms. Trace:
I20260709 12:29:18.405031 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:18.410955 26660 raft_consensus.cc:2468] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:18.411464 27937 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:18.412078 27354 consensus_meta.cc:287] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.001s
W20260709 12:29:18.394189 27587 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:29:18.399454 27843 consensus_queue.cc:1059] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:29:18.394793 27940 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.456395 26511 raft_consensus.cc:2410] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
W20260709 12:29:18.456073 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 151245us
I20260709 12:29:18.430078 27627 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:18.418047 27911 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.444968 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:18.399129 27864 consensus_queue.cc:1059] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 12:29:18.542097 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 135707us
I20260709 12:29:18.461454 27354 raft_consensus.cc:2468] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
I20260709 12:29:18.549821 27350 raft_consensus.cc:1240] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:18.466710 27724 raft_consensus.cc:3055] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:18.547327 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:18.466092 27843 consensus_queue.cc:1243] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer baa04b33c4e846e49c1e22e5f9bfe644 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:18.551054 26657 raft_consensus.cc:2410] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:29:18.545723 26477 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:18.554229 26661 raft_consensus.cc:1275] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 12:29:18.555033 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 45952.7us
I20260709 12:29:18.508312 27866 raft_consensus.cc:493] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.463089 27932 raft_consensus.cc:515] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.547685 27906 consensus_queue.cc:1048] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:29:18.551954 27724 raft_consensus.cc:740] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:18.570369 27724 consensus_queue.cc:260] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.571200 27926 raft_consensus.cc:3055] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:18.571708 27926 raft_consensus.cc:740] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:18.572647 27926 consensus_queue.cc:260] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.574056 27926 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.579154 27627 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:18.580951 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:18.584028 26505 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:18.455755 26506 rpcz_store.cc:276] 0709 12:29:17.128764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:17.251018 (+122254us) service_pool.cc:224] Handling call
0709 12:29:17.251309 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:17.477307 (+225998us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b54005ace20. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c67ddc0 00007ff18c7081c0 00007ff18c709231 00007ff18c705d8f 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c
0709 12:29:17.817359 (+340052us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54005ace20. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c68406f 00007ff18c6fcf60 00007ff18c6fe7de 00007ff18c708b49 00007ff18c709416 00007ff18c705d8f 00007ff18c70583e 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62
0709 12:29:18.358178 (+540819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:18.398404 (+ 40226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431822976}
I20260709 12:29:18.584944 27817 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:18.586441 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:18.587235 27349 raft_consensus.cc:2393] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:18.589814 27598 raft_consensus.cc:3055] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:18.590266 27598 raft_consensus.cc:740] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:18.591226 27968 consensus_queue.cc:1059] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:18.591471 27598 consensus_queue.cc:260] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.592497 27598 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:18.464311 27940 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.551805 27963 raft_consensus.cc:2749] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:18.591928 26504 raft_consensus.cc:1240] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:18.584244 27779 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.602872 26625 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:18.560838 27793 raft_consensus.cc:2804] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:18.604651 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:18.561283 27914 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:18.617238 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 58740.5us
I20260709 12:29:18.618430 26625 leader_election.cc:304] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:18.620765 26512 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:18.590142 27953 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.623492 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:18.624656 26654 raft_consensus.cc:1240] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
W20260709 12:29:18.626674 26552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.600623 27734 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.566702 27866 raft_consensus.cc:515] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.617573 27793 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.618157 27937 raft_consensus.cc:2804] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:18.565805 27741 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.654170 27922 raft_consensus.cc:2804] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:29:18.716851 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.728667 27302 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:18.731704 27302 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:18.737443 27302 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:18.740537 27302 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:18.728329 27793 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:18.738278 27961 log.cc:927] Time spent T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:29:18.759979 26478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.794168 26582 raft_consensus.cc:1240] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:18.737933 27937 raft_consensus.cc:697] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:18.741328 27922 raft_consensus.cc:697] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:18.654186 27914 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:18.737859 27717 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:18.747997 27971 raft_consensus.cc:2749] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:18.669799 27734 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:18.800145 27304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.751997 27788 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.840627 27741 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:18.752851 27968 consensus_queue.cc:1048] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:29:18.841607 27922 consensus_queue.cc:237] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:18.842772 27866 leader_election.cc:290] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.846371 27937 consensus_queue.cc:237] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:18.848058 27779 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.799701 27659 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:18.751829 27906 raft_consensus.cc:2749] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:18.852044 27911 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:18.799353 27823 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:18.892282 26585 raft_consensus.cc:1275] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:29:18.869364 27990 log.cc:927] Time spent T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 12:29:18.750511 27627 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:18.860704 26582 raft_consensus.cc:1240] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:18.877682 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:18.895565 26587 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:18.877921 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:29:18.879755 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 129181us
I20260709 12:29:18.882318 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:18.896799 26586 raft_consensus.cc:2393] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 4: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:18.882373 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:18.897503 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf253f7acbf409180c569cd29f50cee" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:18.898164 26586 raft_consensus.cc:3060] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.868515 27771 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:18.901897 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:18.902547 26513 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:18.897379 26584 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:18.870587 27717 raft_consensus.cc:697] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:18.909232 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:18.910238 26582 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.880741 27617 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:18.915824 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:18.918149 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:18.919684 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:18.903374 27627 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:18.928813 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:18.929024 26586 raft_consensus.cc:2468] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:18.937522 27914 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:18.948843 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:18.949198 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:18.950538 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:18.951335 26654 raft_consensus.cc:2368] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3.
I20260709 12:29:18.952684 26660 raft_consensus.cc:1240] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:18.956024 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:18.956353 26656 raft_consensus.cc:1240] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:18.957605 26513 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 5.
I20260709 12:29:18.894665 27659 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:18.931488 26652 raft_consensus.cc:1240] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:29:18.902704 27823 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.961833 27302 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:18.938946 27627 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:18.915846 27771 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:18.955488 26587 raft_consensus.cc:1275] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:18.974093 26582 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:18.956193 27353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42140 (request call id 432) took 1001 ms. Trace:
I20260709 12:29:18.928253 27617 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:18.974299 27302 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:18.972715 27914 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.989303 26477 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:18.966504 27906 consensus_queue.cc:1059] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:29:18.965658 27893 consensus_queue.cc:1048] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:29:18.994724 27971 raft_consensus.cc:2749] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:18.974542 27940 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:18.990715 27717 consensus_queue.cc:237] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:18.998172 27866 raft_consensus.cc:2804] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:18.999143 27788 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:18.999739 27598 consensus_queue.cc:1059] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:29:19.000362 27997 log.cc:927] Time spent T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:29:18.979666 28002 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:19.002069 27796 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:19.005970 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.010082 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.001752 27823 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.021538 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:18.996744 27817 consensus_queue.cc:1048] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:29:19.022367 27866 raft_consensus.cc:697] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:19.033494 27866 consensus_queue.cc:237] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.031311 27734 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:19.038901 27771 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.040318 27617 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:19.002060 27914 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.042744 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.044173 27914 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:19.047957 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:19.049026 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 68130.7us
I20260709 12:29:19.049194 26585 raft_consensus.cc:2393] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 4: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:19.019984 28002 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.053412 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:19.023983 27796 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.050958 28002 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.062076 27932 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.062292 27302 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.054358 26652 raft_consensus.cc:2393] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 4: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:19.071297 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.072979 28008 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:18.979919 27353 rpcz_store.cc:276] 0709 12:29:17.955348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:17.960185 (+  4837us) service_pool.cc:224] Handling call
0709 12:29:18.020239 (+ 60054us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:18.220924 (+200685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:18.223166 (+  2242us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:18.298313 (+ 75147us) log.cc:844] Serialized 26 byte log entry
0709 12:29:18.551254 (+252941us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:29:18.551308 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:18.551389 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:18.928193 (+376804us) raft_consensus.cc:1685] finished
0709 12:29:18.932261 (+  4068us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:18.953458 (+ 21197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39117,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":20349,"thread_start_us":379979,"threads_started":2,"wal-append.queue_time_us":414010}
I20260709 12:29:19.078933 27302 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.047644 27627 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.097503 26659 raft_consensus.cc:1240] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:19.097419 28002 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.118209 27906 raft_consensus.cc:2804] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:19.097404 27964 raft_consensus.cc:3055] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:19.120102 27627 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.119803 27793 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.121115 27964 raft_consensus.cc:740] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.106776 28008 raft_consensus.cc:697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.108978 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.122061 27964 consensus_queue.cc:260] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.122401 28008 consensus_queue.cc:237] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.093600 27817 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.123833 27817 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.112213 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.114473 28003 raft_consensus.cc:3055] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:29:19.116044 27985 log.cc:927] Time spent T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 12:29:19.116567 27928 raft_consensus.cc:3055] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:29:19.104568 27982 log.cc:927] Time spent T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.558s	user 0.000s	sys 0.001s
I20260709 12:29:19.128862 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.129155 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.129570 26513 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.129920 26587 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.145094 26512 raft_consensus.cc:1275] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:29:19.145648 26512 pending_rounds.cc:85] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Aborting all ops after (but not including) 2
I20260709 12:29:19.145891 26512 pending_rounds.cc:107] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:29:19.146116 26512 raft_consensus.cc:2889] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:19.118713 28002 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.159377 27817 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.127030 28003 raft_consensus.cc:740] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.161958 28003 consensus_queue.cc:260] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.131108 27928 raft_consensus.cc:740] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
W20260709 12:29:19.170727 26476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.109.68:41855 timed out after 1.501s (SENT) [suppressed 11 similar messages]
I20260709 12:29:19.171977 26513 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
W20260709 12:29:19.191083 26552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.191263 26550 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.175488 27717 consensus_queue.cc:1048] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:29:19.173942 26587 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
W20260709 12:29:19.175145 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.196702 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.173403 27817 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.200194 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.200642 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.201122 27951 raft_consensus.cc:2749] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:19.201491 27352 raft_consensus.cc:2393] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 4: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:19.201684 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.203076 26550 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.202338 27354 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:19.203474 27817 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.182245 27968 raft_consensus.cc:3055] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:19.204572 27968 raft_consensus.cc:740] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.205443 27968 consensus_queue.cc:260] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.207060 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.207289 27906 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:19.207572 27817 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:19.208114 27906 raft_consensus.cc:3060] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:19.181469 27797 raft_consensus.cc:3055] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:19.210011 27797 raft_consensus.cc:740] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:19.210661 27345 raft_consensus.cc:1275] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:19.182408 26579 raft_consensus.cc:1240] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:19.211246 27797 consensus_queue.cc:260] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.212636 27796 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:19.212814 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:19.213131 27994 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.175501 27788 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.214037 27788 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.216336 27788 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.211257 27353 raft_consensus.cc:1240] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:19.182819 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.220607 26550 leader_election.cc:400] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Vote denied by peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855) with higher term. Message: Invalid argument: T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3.
I20260709 12:29:19.227427 26550 leader_election.cc:403] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:29:19.230280 27951 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.231917 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.232210 27906 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.232599 26512 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.228261 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.223341 27928 consensus_queue.cc:260] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.235368 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea21ef264e8c4b2d982ec57324d121ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.177340 27793 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.238508 27350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42140 (request call id 434) took 1185 ms. Trace:
I20260709 12:29:19.212867 27797 raft_consensus.cc:3060] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:19.235963 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:19.243271 26504 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:19.244261 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:19.245545 27301 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:19.244284 27717 consensus_queue.cc:1048] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:29:19.247126 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.248425 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.249610 27968 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.251283 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.252490 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.253536 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.239100 27350 rpcz_store.cc:276] 0709 12:29:18.052989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:18.053915 (+   926us) service_pool.cc:224] Handling call
0709 12:29:18.549668 (+495753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:18.550209 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:19.238294 (+688085us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400006250. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c7058ad 00007ff1916ca419 00007ff18ac41bd4 00007ff18ac41b62 00007ff18ac41a91 00007ff18ac41a0c 00007ff18ac40cc2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:19.238443 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102144896}
I20260709 12:29:19.254112 27346 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:19.180864 27659 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:19.261919 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:19.256019 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.243155 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.248293 27717 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:29:19.259174 27996 log.cc:927] Time spent T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 12:29:19.272964 27869 leader_election.cc:290] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.273936 27843 consensus_queue.cc:1059] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:19.262880 26504 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:19.277215 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.278996 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.265650 26512 raft_consensus.cc:2468] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:19.286526 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.300558 26584 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.305233 27906 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.288231 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.274708 27926 consensus_queue.cc:1059] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:19.290150 26477 leader_election.cc:304] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:19.289142 28021 log.cc:927] Time spent T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:29:19.292002 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.288906 27892 consensus_queue.cc:1059] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:29:19.286206 27796 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:19.285650 27793 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.295814 26653 raft_consensus.cc:1275] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:29:19.285823 27962 consensus_queue.cc:1059] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:29:19.259672 27994 raft_consensus.cc:2749] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:19.307686 27350 raft_consensus.cc:1240] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
W20260709 12:29:19.308979 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 45732.2us
I20260709 12:29:19.309041 26584 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:19.284598 26625 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:19.313511 27926 raft_consensus.cc:3055] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:19.314905 27788 raft_consensus.cc:2749] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:19.314957 26477 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:19.328161 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:19.328300 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 157599us
I20260709 12:29:19.328879 26550 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.330520 27302 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:19.331976 26477 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.327590 27937 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:19.334611 27937 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.334997 27937 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.324026 27717 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.336069 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:19.336688 26658 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.328081 27793 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.326457 27796 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.339303 27717 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.340133 27797 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:19.340813 27914 consensus_queue.cc:1059] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.341426 27796 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:19.327610 27926 raft_consensus.cc:740] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:19.342712 27968 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:19.343119 27352 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:19.343276 27968 raft_consensus.cc:697] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.339059 27788 raft_consensus.cc:2749] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:19.343894 27924 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:19.329974 27843 consensus_queue.cc:1059] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:29:19.341456 27717 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.345175 27843 raft_consensus.cc:3055] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:19.345530 27843 raft_consensus.cc:740] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:19.316299 26507 raft_consensus.cc:3060] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.349674 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.353725 26476 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.339082 26477 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:19.355185 26658 raft_consensus.cc:2410] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:29:19.355293 26476 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.350288 27994 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.360282 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.360977 26512 raft_consensus.cc:3060] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:19.361909 27351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42140 (request call id 437) took 1058 ms. Trace:
I20260709 12:29:19.362325 27351 rpcz_store.cc:276] 0709 12:29:18.303986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:18.308199 (+  4213us) service_pool.cc:224] Handling call
0709 12:29:19.361195 (+1052996us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1eee 000000000036eb39 00007ff1916551e0 00007ff19171e0c4 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:19.361361 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:19.361550 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:19.361576 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:19.361620 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:19.361654 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:19.361710 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:19.361836 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4671360}
I20260709 12:29:19.342733 27926 consensus_queue.cc:260] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.368297 26625 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.373078 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:19.373373 26512 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:19.373829 26656 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:19.374406 27813 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.375699 27931 raft_consensus.cc:2749] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:19.356794 27788 consensus_queue.cc:1048] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:29:19.377785 27793 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.377679 27813 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.364866 27926 raft_consensus.cc:3060] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.380679 26625 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.375385 26476 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.348076 27951 raft_consensus.cc:2749] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855) with higher term. Message: Invalid argument: T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3.
I20260709 12:29:19.346340 27843 consensus_queue.cc:260] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.365501 27797 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:29:19.387516 26476 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.344161 27968 consensus_queue.cc:237] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.390436 27587 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:19.379593 27869 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:19.389346 26625 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:19.374754 27911 raft_consensus.cc:2749] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:19.399570 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:19.399832 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:19.400127 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:19.399570 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:19.400899 26654 raft_consensus.cc:2393] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:19.401676 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:19.402515 28003 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.403501 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.405292 27598 raft_consensus.cc:3055] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:19.405714 27598 raft_consensus.cc:740] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.388895 27788 raft_consensus.cc:2804] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:19.397367 27869 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.407876 27843 raft_consensus.cc:3060] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:19.407873 27869 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:19.401491 27931 raft_consensus.cc:2804] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:19.365223 27817 consensus_queue.cc:1059] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:29:19.420583 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.420763 27302 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:19.422979 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:19.397217 27924 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:19.442409 27301 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:19.415378 27788 raft_consensus.cc:697] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:19.451298 26504 raft_consensus.cc:1240] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:19.454510 27823 raft_consensus.cc:493] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.446965 27925 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.410140 27598 consensus_queue.cc:260] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.463739 26507 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:19.481931 27869 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.484772 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.486029 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.466224 26657 raft_consensus.cc:1240] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:29:19.447593 28027 log.cc:927] Time spent T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:29:19.470890 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:19.446955 27817 consensus_queue.cc:1243] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer 4b371ddb5e924d6e8b56b476a69a27d0 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:19.425604 27931 raft_consensus.cc:697] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:19.488731 27931 consensus_queue.cc:237] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.477265 27788 consensus_queue.cc:237] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.477972 27925 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
W20260709 12:29:19.491547 26511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46320 (request call id 105) took 1658 ms (client timeout 1992 ms). Trace:
I20260709 12:29:19.463809 27813 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.493758 27928 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.474098 28002 raft_consensus.cc:2804] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:19.475793 27823 raft_consensus.cc:515] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.494750 28002 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.495147 28002 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.496196 27823 leader_election.cc:290] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.444890 27924 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.444312 28008 consensus_queue.cc:1048] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:29:19.448801 27906 raft_consensus.cc:2804] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:19.497222 27906 raft_consensus.cc:697] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.498092 27906 consensus_queue.cc:237] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.499174 26505 raft_consensus.cc:1275] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:29:19.499596 26505 pending_rounds.cc:85] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Aborting all ops after (but not including) 1
I20260709 12:29:19.499846 26505 pending_rounds.cc:107] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:29:19.500108 26505 raft_consensus.cc:2889] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:19.476408 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
W20260709 12:29:19.501945 27302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:19.492009 26511 rpcz_store.cc:269] 0709 12:29:17.833141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:17.834253 (+  1112us) service_pool.cc:224] Handling call
0709 12:29:19.491318 (+1657065us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b540031e554. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:19.491485 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364918528}
I20260709 12:29:19.502660 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:19.503249 26504 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:19.510649 26551 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:19.511624 28000 log.cc:927] Time spent T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.553s	user 0.000s	sys 0.003s
I20260709 12:29:19.513509 26551 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:19.518198 26511 raft_consensus.cc:1240] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:19.496862 27924 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.519570 26504 raft_consensus.cc:1240] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:19.528481 26511 raft_consensus.cc:1240] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:19.492401 27925 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.509557 27751 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:19.518553 26507 raft_consensus.cc:2368] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3.
I20260709 12:29:19.534963 26511 raft_consensus.cc:1240] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:19.527428 27740 raft_consensus.cc:2804] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:19.516292 27622 raft_consensus.cc:2749] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:19.531174 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.532673 27617 consensus_queue.cc:1059] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 12:29:19.531723 28028 log.cc:927] Time spent T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:29:19.550150 26511 raft_consensus.cc:1240] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:19.532820 27994 raft_consensus.cc:2749] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:19.546038 27975 raft_consensus.cc:2749] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:19.543865 27740 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.546307 27869 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.542038 27925 consensus_queue.cc:1059] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:29:19.571817 27617 raft_consensus.cc:3055] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:19.544597 27751 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:19.584986 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 54524.8us
I20260709 12:29:19.583701 27740 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.585827 27617 raft_consensus.cc:740] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:19.588049 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:19.589438 28037 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.605149 27953 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:19.605032 27924 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.613230 26551 leader_election.cc:400] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 2 election: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3.
I20260709 12:29:19.597086 27925 consensus_queue.cc:1059] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:29:19.597083 27937 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.633553 26658 raft_consensus.cc:1240] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:19.624003 27780 raft_consensus.cc:3055] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:19.634855 27780 raft_consensus.cc:740] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:19.635702 27780 consensus_queue.cc:260] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.636685 27780 raft_consensus.cc:3060] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.611379 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55310 (request call id 459) took 1440 ms. Trace:
I20260709 12:29:19.638870 26508 rpcz_store.cc:276] 0709 12:29:18.170890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:18.191224 (+ 20334us) service_pool.cc:224] Handling call
0709 12:29:19.583606 (+1392382us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b5800312f98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:19.609049 (+ 25443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9624448}
I20260709 12:29:19.640182 27751 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:19.642233 27925 raft_consensus.cc:3055] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:19.642628 27937 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:19.642905 27925 raft_consensus.cc:740] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:19.643826 27925 consensus_queue.cc:260] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.645053 27925 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.617453 27617 consensus_queue.cc:260] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.648273 27617 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:19.631525 28040 consensus_queue.cc:1059] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:29:19.651007 27741 raft_consensus.cc:3055] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:19.651439 27741 raft_consensus.cc:740] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:19.652262 27741 consensus_queue.cc:260] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.653625 27741 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:19.652043 27348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42140 (request call id 440) took 1098 ms. Trace:
I20260709 12:29:19.661026 27992 raft_consensus.cc:3055] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:19.663515 27992 raft_consensus.cc:740] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:19.602360 28037 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.664769 27992 consensus_queue.cc:260] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.666002 27992 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.669802 27866 raft_consensus.cc:3055] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:19.670445 27866 raft_consensus.cc:740] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:19.672564 28037 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.671423 27866 consensus_queue.cc:260] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.674547 27866 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.656957 27348 rpcz_store.cc:276] 0709 12:29:18.553538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:18.559967 (+  6429us) service_pool.cc:224] Handling call
0709 12:29:18.616663 (+ 56696us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916dffc0 00007ff1916ca929 00007ff1916ca3d2 00007ff18ac41bd4
0709 12:29:18.659724 (+ 43061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:18.731153 (+ 71429us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:29:19.483609 (+752456us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b18001f6a20. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895fbe07 00007ff1924569a9 00007ff18961869b 00007ff18961693f 00007ff189616455 00007ff1900fe3c7 00007ff18c7109a7 00007ff18c7200bf 00007ff18c720038
0709 12:29:19.557212 (+ 73603us) log.cc:844] Serialized 14 byte log entry
0709 12:29:19.627108 (+ 69896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:19.632611 (+  5503us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:29:19.634155 (+  1544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:19.651824 (+ 17669us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:19.651980 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1157,"prepare.queue_time_us":96102,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":4109,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":11016,"spinlock_wait_cycles":58036864,"thread_start_us":85726,"threads_started":2}
I20260709 12:29:19.678930 28002 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.681413 28002 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.680672 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46320 (request call id 112) took 1089 ms. Trace:
W20260709 12:29:19.685088 27303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.683759 26506 rpcz_store.cc:276] 0709 12:29:18.590919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:18.600156 (+  9237us) service_pool.cc:224] Handling call
0709 12:29:18.663268 (+ 63112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:18.751910 (+ 88642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:18.790205 (+ 38295us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:18.907925 (+117720us) log.cc:844] Serialized 26 byte log entry
0709 12:29:19.051091 (+143166us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:29:19.054138 (+  3047us) log.cc:844] Serialized 14 byte log entry
0709 12:29:19.058744 (+  4606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:19.065152 (+  6408us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:19.400588 (+335436us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18001f4fe0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1895e72a6 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1
0709 12:29:19.653160 (+252572us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b18001f4fe0. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1924e1ab1 00007ff1924ee281 00007ff1896193f3 00007ff18961b7c1 00007ff18961b779 00007ff18961b709 00007ff18961b6d1 00007ff18961a9cd 0000000000388634 0000000000388479 00007ff1895fc83a
0709 12:29:19.680455 (+ 27295us) raft_consensus.cc:1685] finished
0709 12:29:19.680476 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:19.680608 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":951,"prepare.queue_time_us":148,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":10973,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":42439,"spinlock_wait_cycles":28214400,"thread_start_us":74073,"threads_started":1,"wal-append.queue_time_us":103193}
I20260709 12:29:19.687084 27924 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:19.692844 27724 raft_consensus.cc:3060] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:19.700542 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.701018 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:19.701786 26652 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.701257 26513 raft_consensus.cc:3060] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:19.681331 28036 log.cc:927] Time spent T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:29:19.704465 27347 raft_consensus.cc:2468] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:19.718220 26655 raft_consensus.cc:1240] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:19.721071 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.724387 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.731709 26582 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:19.735692 26587 raft_consensus.cc:1240] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:19.736583 26551 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.739634 26587 raft_consensus.cc:1240] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:19.740900 26513 raft_consensus.cc:2468] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:19.741423 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec4b7b54d6547299b2a1a4c618afcde" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.766865 26584 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:19.748656 27892 raft_consensus.cc:2749] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:19.747716 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.755781 27740 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.775599 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.776619 26578 raft_consensus.cc:2393] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 4: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:19.777467 27740 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:19.779304 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.780177 26581 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:19.775418 27348 raft_consensus.cc:2368] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4.
W20260709 12:29:19.782130 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 158758us
W20260709 12:29:19.791656 27301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.796535 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.797186 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.798213 26579 raft_consensus.cc:2393] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:19.801986 26513 raft_consensus.cc:2393] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:19.796097 27302 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:19.804847 26504 raft_consensus.cc:1240] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:29:19.814412 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.815467 26579 raft_consensus.cc:2393] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 3: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:19.826762 26506 raft_consensus.cc:1275] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:19.827344 26652 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:19.828795 27301 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:19.829344 27975 raft_consensus.cc:493] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:19.829540 27971 raft_consensus.cc:2804] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:19.830053 27971 raft_consensus.cc:697] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.829903 27975 raft_consensus.cc:515] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.831043 27971 consensus_queue.cc:237] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:19.832054 27975 leader_election.cc:290] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.832649 26332 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45818 (request call id 118) took 7948 ms. Trace:
I20260709 12:29:19.834623 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:19.616752 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:19.837225 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:29:19.839630 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.850152 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.858911 27346 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.861162 27964 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.811833 28003 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:19.863090 28003 raft_consensus.cc:697] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:19.864018 28003 consensus_queue.cc:237] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:19.864648 28019 log.cc:927] Time spent T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.688s	user 0.003s	sys 0.000s
I20260709 12:29:19.851231 27354 raft_consensus.cc:1240] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:19.853401 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.867614 27924 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
W20260709 12:29:19.851225 28042 log.cc:927] Time spent T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:29:19.868027 27351 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:19.853176 27348 raft_consensus.cc:1275] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:19.854939 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.870616 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.872406 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.872509 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.873006 26587 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:19.873672 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:19.875274 26510 raft_consensus.cc:1217] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:29:19.858217 26583 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:19.880318 27346 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:19.842645 26476 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.857043 26578 raft_consensus.cc:1275] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:19.888222 26510 raft_consensus.cc:1240] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:29:19.852003 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.874555 26505 raft_consensus.cc:1275] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:19.874339 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.833026 26332 rpcz_store.cc:276] 0709 12:29:11.884752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.884892 (+   140us) service_pool.cc:224] Handling call
0709 12:29:19.832586 (+7947694us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:17.489368 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:17.511368 (+ 22000us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:17.511410 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:29:17.511425 (+    15us) tablet.cc:662] Decoding operations
0709 12:29:17.511846 (+   421us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:17.511918 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:17.511947 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:29:17.512263 (+   316us) tablet.cc:701] Row locks acquired
0709 12:29:17.512280 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:29:17.512438 (+   158us) write_op.cc:270] Start()
0709 12:29:17.512554 (+   116us) write_op.cc:276] Timestamp: P: 1783600157512385 usec, L: 0
0709 12:29:17.512569 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:29:17.606113 (+ 93544us) log.cc:844] Serialized 928 byte log entry
0709 12:29:18.444528 (+838415us) op_driver.cc:464] REPLICATION: finished
0709 12:29:18.958547 (+514019us) write_op.cc:301] APPLY: starting
0709 12:29:18.960494 (+  1947us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:18.964188 (+  3694us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:18.976507 (+ 12319us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:18.989635 (+ 13128us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:18.989801 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:29:18.989841 (+    40us) write_op.cc:312] APPLY: finished
0709 12:29:18.990042 (+   201us) log.cc:844] Serialized 28 byte log entry
0709 12:29:18.990224 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:18.990315 (+    91us) write_op.cc:454] Released schema lock
0709 12:29:18.990366 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:18.990777 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:18.990804 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":861524,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":509852,"apply.run_cpu_time_us":2159,"apply.run_wall_time_us":32221,"num_ops":2,"prepare.queue_time_us":161585,"prepare.run_cpu_time_us":68140,"prepare.run_wall_time_us":497490,"raft.queue_time_us":176021,"raft.run_cpu_time_us":28602,"raft.run_wall_time_us":486102,"replication_time_us":885883,"thread_start_us":903006,"threads_started":4,"wal-append.queue_time_us":394673}]]}
I20260709 12:29:19.883256 26513 raft_consensus.cc:1275] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:19.873725 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.890997 27924 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.917611 26581 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:19.918835 27984 consensus_queue.cc:1048] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.919505 27924 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:19.920957 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579a9b2cdca24a6a95444e424f03a551" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.922200 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488122ee22144275b3f537809a55060d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.878093 27922 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.923084 27922 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:19.923769 27734 raft_consensus.cc:3055] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:19.924152 27734 raft_consensus.cc:740] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:19.924651 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:19.924949 27734 consensus_queue.cc:260] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:19.883936 26476 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.925557 27922 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.926035 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.884655 26584 raft_consensus.cc:2468] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
W20260709 12:29:19.927139 27303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.923130 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.928692 26582 raft_consensus.cc:2393] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:19.883687 26625 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.881413 26477 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.925359 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:19.874339 26508 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:19.890383 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:19.929025 27349 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:19.930575 26585 raft_consensus.cc:2393] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:19.930625 26512 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.932564 26506 raft_consensus.cc:3060] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:19.933333 27922 raft_consensus.cc:2749] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:19.934255 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 50621us
W20260709 12:29:19.934924 27347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42142 (request call id 370) took 1370 ms (client timeout 1626 ms). Trace:
W20260709 12:29:19.935318 27347 rpcz_store.cc:269] 0709 12:29:18.564917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:18.575801 (+ 10884us) service_pool.cc:224] Handling call
0709 12:29:19.403345 (+827544us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:19.934755 (+531410us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400009454. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:19.934863 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540513920}
W20260709 12:29:19.935956 28045 log.cc:927] Time spent T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:29:19.934965 26625 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:19.947037 27734 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:19.947245 27922 raft_consensus.cc:2804] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:19.947902 27922 raft_consensus.cc:697] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:19.948088 27797 raft_consensus.cc:2749] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:19.949231 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 67928us
I20260709 12:29:19.939601 26625 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:19.950335 26477 leader_election.cc:304] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.953688 26477 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:19.951905 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 62289.3us
I20260709 12:29:19.957199 26625 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:19.848582 27724 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:19.962545 26477 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.965597 26659 raft_consensus.cc:1275] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:19.965801 26657 raft_consensus.cc:1275] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:29:19.966190 26657 pending_rounds.cc:85] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting all ops after (but not including) 1
I20260709 12:29:19.966442 26657 pending_rounds.cc:107] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:29:19.966702 26657 raft_consensus.cc:2889] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:19.968914 26625 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.948613 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:29:19.971180 27302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.977061 26625 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.985136 26625 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:19.891170 27866 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:19.986788 26625 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.989037 26512 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:19.974119 27302 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:19.994434 26625 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:19.995239 26625 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:19.960639 27817 raft_consensus.cc:2749] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:29:19.997109 28032 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:19.997361 27817 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.998090 27817 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:19.998517 27866 raft_consensus.cc:2749] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:20.000181 27817 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:19.960604 27658 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:20.000903 27658 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:20.001264 27658 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.001643 27963 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.997128 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:20.007743 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:20.002919 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:20.019951 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:19.972316 27924 raft_consensus.cc:2804] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:19.994009 27940 raft_consensus.cc:2749] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:20.002125 27963 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:20.017925 28032 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:20.003949 27960 raft_consensus.cc:2804] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:19.993649 28037 raft_consensus.cc:2749] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:20.005496 27911 raft_consensus.cc:2749] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:20.004462 27937 raft_consensus.cc:2749] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:19.960685 27813 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:29:20.008585 27953 raft_consensus.cc:2749] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:20.014072 27914 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:20.043164 27914 raft_consensus.cc:697] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:20.044373 27914 consensus_queue.cc:237] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:20.005231 27724 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:20.053586 27724 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:20.053982 27676 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.054611 27676 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.056851 27676 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:20.058583 27922 consensus_queue.cc:237] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:20.068861 27963 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:20.031497 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf8f563ecd14874baedead593c9a98a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:20.042189 27964 consensus_queue.cc:1048] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:29:20.071619 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.029832 27960 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.079691 27960 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.088196 27984 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:20.089167 26660 raft_consensus.cc:2393] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 3: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
W20260709 12:29:20.093776 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 98597.2us
I20260709 12:29:20.096911 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:20.097708 26657 raft_consensus.cc:2368] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4.
I20260709 12:29:20.098722 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:20.093231 27960 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:20.123503 27924 raft_consensus.cc:697] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:20.127405 28032 raft_consensus.cc:697] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:20.130769 28032 consensus_queue.cc:237] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:20.133237 27960 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:20.134852 27843 raft_consensus.cc:3055] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:20.135362 27843 raft_consensus.cc:740] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:20.135048 27924 consensus_queue.cc:237] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:20.136209 27843 consensus_queue.cc:260] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:20.137485 27843 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:20.138530 28053 log.cc:927] Time spent T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 12:29:20.020604 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:20.186231 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 223548us
I20260709 12:29:20.189165 26477 leader_election.cc:304] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:20.196221 26507 raft_consensus.cc:1275] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:20.200726 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:20.203346 26552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.204011 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97898f8f78e456084abffdb741c2b01" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:20.204418 26552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.206763 26580 raft_consensus.cc:1275] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:20.034969 26581 raft_consensus.cc:1275] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:20.101776 27351 raft_consensus.cc:2468] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 5.
I20260709 12:29:20.215802 26659 raft_consensus.cc:1240] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:20.217329 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:20.213526 26625 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
W20260709 12:29:20.222051 27303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:20.223938 27301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.231439 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:20.235291 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:20.236310 27351 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:20.242998 26550 leader_election.cc:400] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855) with higher term. Message: Invalid argument: T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4.
I20260709 12:29:20.243490 26550 leader_election.cc:403] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:20.103809 27581 consensus_queue.cc:1059] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 12:29:20.246668 26507 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:20.247324 27581 consensus_queue.cc:1243] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer 4b371ddb5e924d6e8b56b476a69a27d0 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:20.247967 27617 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.255025 26510 raft_consensus.cc:1275] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:20.259583 27658 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.260752 27659 raft_consensus.cc:2749] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:20.258476 26510 raft_consensus.cc:1240] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:29:20.265262 27676 raft_consensus.cc:493] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:20.271905 27627 raft_consensus.cc:3055] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:20.273835 27627 raft_consensus.cc:740] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:20.275497 27658 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:20.276714 27676 raft_consensus.cc:515] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:20.278861 26477 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.109.126:41885, user_credentials={real_user=slave}} blocked reactor thread for 82931.5us
I20260709 12:29:20.289387 26579 raft_consensus.cc:2468] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:20.295255 27956 raft_consensus.cc:2804] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:20.294780 27627 consensus_queue.cc:260] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:20.308727 27676 leader_election.cc:290] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:20.324340 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 78945.1us
I20260709 12:29:20.337884 27627 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.347813 27989 consensus_queue.cc:1048] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:20.348484 27302 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:20.335151 26477 leader_election.cc:304] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:20.332264 27914 consensus_queue.cc:1048] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:29:20.354363 27956 raft_consensus.cc:697] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:20.357246 27984 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:20.359992 27984 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.359717 26625 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:20.373710 26506 raft_consensus.cc:2468] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:20.374850 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:20.369457 27952 consensus_queue.cc:1048] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:29:20.377321 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:20.370728 27617 raft_consensus.cc:2749] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855) with higher term. Message: Invalid argument: T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4.
I20260709 12:29:20.379643 26477 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:20.384946 28010 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:20.384981 28059 raft_consensus.cc:2804] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:20.369521 28062 consensus_queue.cc:1048] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:29:20.386371 27931 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:20.388234 27931 raft_consensus.cc:697] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:20.389549 27931 consensus_queue.cc:237] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:20.391705 27676 consensus_queue.cc:1048] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:20.392704 26656 raft_consensus.cc:1275] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:20.357568 27956 consensus_queue.cc:237] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:20.386663 28010 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.399451 28010 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:20.407296 28062 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:20.408013 28062 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.408447 28062 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:20.418725 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:20.434309 26652 raft_consensus.cc:1275] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:29:20.434919 26652 pending_rounds.cc:85] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting all ops after (but not including) 1
I20260709 12:29:20.435058 27598 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.435377 27972 consensus_queue.cc:1048] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:29:20.433166 27617 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:20.442051 27617 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.401650 28059 raft_consensus.cc:697] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
W20260709 12:29:20.458540 27349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42158 (request call id 244) took 1868 ms (client timeout 1812 ms). Trace:
W20260709 12:29:20.459153 27349 rpcz_store.cc:269] 0709 12:29:18.589585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:18.593725 (+  4140us) service_pool.cc:224] Handling call
0709 12:29:19.182626 (+588901us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b58000d5c98. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff1894a1db1 00007ff1895e1b71 00007ff1895e1a22 00007ff1924fa8d9 00007ff191654ee0 00007ff19171e0ab 00007ff19171e131 00007ff1916cc0a0 00007ff1916cb984 00007ff18ac466d4 00007ff18ac46662
0709 12:29:20.458107 (+1275481us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400006c54. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c66f571 00007ff18c70a2fa 00007ff1916cbb17 00007ff18ac466d4 00007ff18ac46662 00007ff18ac46591 00007ff18ac4650c 00007ff18ac457c2 00007ff18aa4148c 00007ff18aa408c6 00007ff18aa4026f
0709 12:29:20.458295 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610390016}
I20260709 12:29:20.471514 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:20.474177 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:20.477461 28059 consensus_queue.cc:237] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.480479 26477 leader_election.cc:304] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:20.481818 27771 raft_consensus.cc:2749] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:20.488240 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:20.489045 26506 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.450773 26652 pending_rounds.cc:107] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:29:20.491097 26652 raft_consensus.cc:2889] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:20.493232 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:20.495337 26653 raft_consensus.cc:1275] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:20.508862 27617 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:20.512281 26578 raft_consensus.cc:2468] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:20.513173 27984 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:20.541025 26586 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:20.575049 26504 raft_consensus.cc:1240] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:20.575897 27683 consensus_queue.cc:1048] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:29:20.585490 27617 raft_consensus.cc:493] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:20.584993 28062 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:20.614199 26553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.617830 27971 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:20.619462 26336 catalog_manager.cc:5697] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.622746 26513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:20.623633 26513 raft_consensus.cc:606] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:20.610716 27617 raft_consensus.cc:515] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.625706 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:20.626484 26587 raft_consensus.cc:3060] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.626894 27617 leader_election.cc:290] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:20.627003 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:20.621649 26336 catalog_manager.cc:5697] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.598358 28010 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.633920 26506 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:20.636279 28002 consensus_queue.cc:1048] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:20.636744 26579 raft_consensus.cc:1275] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:20.635159 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:20.643467 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:20.643953 26580 raft_consensus.cc:1275] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:29:20.644410 26580 pending_rounds.cc:85] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: Aborting all ops after (but not including) 1
I20260709 12:29:20.644680 26580 pending_rounds.cc:107] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:29:20.644903 26580 raft_consensus.cc:2889] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:20.646126 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d43124d4854915a84f60d5a8d16915" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:20.647081 26582 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:20.648069 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:20.648614 26582 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:20.652925 26513 raft_consensus.cc:2368] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5.
I20260709 12:29:20.648607 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:20.647099 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:20.659300 26585 raft_consensus.cc:2393] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 4: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:20.659432 27347 raft_consensus.cc:2368] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5.
I20260709 12:29:20.660172 26584 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:20.661796 26579 raft_consensus.cc:1275] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:29:20.664104 26582 raft_consensus.cc:1275] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:20.669766 26583 raft_consensus.cc:1275] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:20.669164 26336 catalog_manager.cc:5697] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.689522 26513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:20.691352 26513 raft_consensus.cc:606] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:20.691645 26513 raft_consensus.cc:614] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:20.688927 26551 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:20.689211 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:20.690985 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:20.705493 26477 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:20.708915 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 82357.1us
I20260709 12:29:20.710069 27843 raft_consensus.cc:2749] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:29:20.710157 26336 catalog_manager.cc:5697] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.712029 27659 raft_consensus.cc:2804] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:20.715065 27659 raft_consensus.cc:697] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:20.707659 28010 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:20.720857 27302 leader_election.cc:304] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:20.718559 27659 consensus_queue.cc:237] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.712242 27351 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:20.724956 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:20.725773 26582 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:29:20.720703 26506 raft_consensus.cc:2393] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 5: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:20.729156 26587 raft_consensus.cc:2468] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:20.725234 26336 catalog_manager.cc:5697] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 1 to 2, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.739727 26336 catalog_manager.cc:5697] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 1 to 2, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.726437 27676 raft_consensus.cc:2749] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:20.740793 28062 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:20.746142 26336 catalog_manager.cc:5697] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:20.753906 28081 log.cc:927] Time spent T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
I20260709 12:29:20.760903 26582 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 5.
W20260709 12:29:20.767522 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 407978us
I20260709 12:29:20.768936 26625 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:20.769738 27931 consensus_queue.cc:1048] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:20.770493 27931 consensus_queue.cc:1243] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:29:20.770762 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:20.771576 27347 raft_consensus.cc:2393] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 5: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:20.771644 27931 raft_consensus.cc:2749] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:20.773319 27302 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:20.765532 26336 catalog_manager.cc:5697] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:20.775832 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 77449.2us
I20260709 12:29:20.782207 26336 catalog_manager.cc:5697] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 1 to 2, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.793133 27984 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:20.796769 26336 catalog_manager.cc:5697] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.806396 26477 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:20.817504 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:20.818413 26582 raft_consensus.cc:2393] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 5: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:20.823203 26625 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
W20260709 12:29:20.825609 26552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.832177 27843 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.839594 27724 raft_consensus.cc:2804] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:20.840265 27724 raft_consensus.cc:697] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:20.832827 27843 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:20.841289 27724 consensus_queue.cc:237] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:20.829873 27972 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:20.843441 26336 catalog_manager.cc:5697] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 1 to 2, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.846764 26587 raft_consensus.cc:1275] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:20.843192 27972 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.860167 27843 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:20.863098 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 122133us
I20260709 12:29:20.863197 26336 catalog_manager.cc:5697] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.866462 26582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71"
dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52818
I20260709 12:29:20.867110 26582 raft_consensus.cc:606] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:20.867444 26582 raft_consensus.cc:614] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:20.862661 27972 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:20.877295 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 44536.5us
I20260709 12:29:20.868407 27683 consensus_queue.cc:1048] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:29:20.902161 26551 leader_election.cc:400] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5.
I20260709 12:29:20.902577 26551 leader_election.cc:403] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:20.903764 26551 leader_election.cc:400] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Vote denied by peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541) with higher term. Message: Invalid argument: T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 3. Current term is 4.
I20260709 12:29:20.904985 26551 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:20.904824 27972 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:20.908556 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 102265us
I20260709 12:29:20.912211 28040 raft_consensus.cc:2749] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5.
I20260709 12:29:20.913180 28040 raft_consensus.cc:2804] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:20.913687 28040 raft_consensus.cc:697] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
W20260709 12:29:20.914084 28085 log.cc:927] Time spent T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.153s	user 0.000s	sys 0.004s
I20260709 12:29:20.917006 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:20.914824 28040 consensus_queue.cc:237] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:20.918749 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 63157.8us
I20260709 12:29:20.910699 27952 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:20.921397 27302 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:20.901130 26336 catalog_manager.cc:5697] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 4, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:20.924782 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 45964.9us
I20260709 12:29:20.928002 26582 raft_consensus.cc:1275] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:20.930671 27683 consensus_queue.cc:1048] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:29:20.933986 26510 pending_rounds.cc:85] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Aborting all ops after (but not including) 2
I20260709 12:29:20.934404 26510 pending_rounds.cc:107] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:29:20.934697 26510 raft_consensus.cc:2889] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:20.937737 26513 raft_consensus.cc:1275] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:20.937031 26336 catalog_manager.cc:5697] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 1 to 2, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.942058 26586 raft_consensus.cc:1275] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:20.939608 26506 raft_consensus.cc:1275] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:29:20.944126 28093 log.cc:927] Time spent T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:29:20.944998 26584 raft_consensus.cc:1275] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:20.945288 27962 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:20.945685 27940 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:20.953605 27940 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.947029 26336 catalog_manager.cc:5697] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 3, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.954895 27962 raft_consensus.cc:697] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:20.955860 27940 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:20.955952 27962 consensus_queue.cc:237] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.956787 27931 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:20.957340 27931 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:20.959349 27931 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:20.942770 27952 raft_consensus.cc:697] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:20.960089 28059 consensus_queue.cc:1048] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:20.961254 27952 consensus_queue.cc:237] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:20.940125 27956 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:20.962704 27956 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:20.964758 27956 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:20.926960 27984 consensus_queue.cc:1048] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:29:20.982710 27940 consensus_queue.cc:1048] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:20.986379 27627 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.986991 27627 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:20.988142 26587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:20.988750 26587 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:20.989118 27627 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:20.996147 26625 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:21.023087 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 118287us
I20260709 12:29:21.010885 27956 raft_consensus.cc:2749] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:21.027387 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 95848.6us
I20260709 12:29:21.025303 27301 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:21.010567 27683 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:21.026935 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:21.035549 27960 consensus_queue.cc:1048] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:29:21.037005 27683 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:21.038802 27345 raft_consensus.cc:1275] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:21.039215 27683 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:21.032655 27351 raft_consensus.cc:1240] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:21.045305 26587 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:21.047497 28002 raft_consensus.cc:2749] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:21.049618 27771 consensus_queue.cc:1048] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:21.051069 27931 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:21.051743 27931 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:21.052757 28094 log.cc:927] Time spent T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.166s	user 0.000s	sys 0.002s
I20260709 12:29:21.054231 27931 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:21.058380 27349 raft_consensus.cc:2376] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4. Re-sending same reply.
I20260709 12:29:21.058662 27350 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:21.065759 28088 log.cc:927] Time spent T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.181s	user 0.002s	sys 0.000s
I20260709 12:29:21.066048 26477 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:21.102800 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:21.102998 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.103829 26507 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:21.100612 27940 raft_consensus.cc:2749] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:29:21.116598 27302 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:21.103899 27345 raft_consensus.cc:2393] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 4: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:21.121897 27350 raft_consensus.cc:1275] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:21.123790 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.124557 26582 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:21.078325 27972 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.127329 27302 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:21.114463 27843 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:21.133924 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 114874us
I20260709 12:29:21.121387 27627 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:21.126760 28010 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.158178 28010 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:21.158798 27960 consensus_queue.cc:1048] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:21.160459 28010 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:21.161301 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.147504 27869 raft_consensus.cc:493] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:21.148557 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:21.128005 27952 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.151495 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.133365 27931 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:21.163322 27346 raft_consensus.cc:1275] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:21.133461 27676 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:21.188216 26580 raft_consensus.cc:3060] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:29:21.181107 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.183941 26508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:21.176168 27869 raft_consensus.cc:515] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:21.185879 27931 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
W20260709 12:29:21.180269 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 51570.9us
I20260709 12:29:21.133311 27956 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:21.212710 26477 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:21.192250 26654 raft_consensus.cc:2393] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 4: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:21.190109 27627 raft_consensus.cc:697] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:21.192890 26508 raft_consensus.cc:606] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:21.196816 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.200407 28106 consensus_queue.cc:1048] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:21.163787 27581 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.187743 27676 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:21.180768 27952 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.235984 27676 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:21.237707 27952 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.211799 26551 leader_election.cc:400] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Vote denied by peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541) with higher term. Message: Invalid argument: T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5.
I20260709 12:29:21.222823 27683 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:21.178808 27960 consensus_queue.cc:1048] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:29:21.218430 27771 consensus_queue.cc:1048] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:29:21.223567 27627 consensus_queue.cc:237] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:21.224002 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.145721 27843 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.218717 26508 raft_consensus.cc:614] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:21.224596 26655 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 2.
I20260709 12:29:21.220279 27956 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:21.247848 26659 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:21.224023 27581 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:21.230499 27869 leader_election.cc:290] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:21.233367 27931 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:21.242370 26625 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:21.252096 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:21.262481 27346 raft_consensus.cc:2368] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5.
W20260709 12:29:21.261147 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 129789us
I20260709 12:29:21.244318 27659 raft_consensus.cc:3060] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:21.273605 27931 consensus_queue.cc:1059] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:21.270354 27302 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:21.272706 27960 consensus_queue.cc:1048] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:21.272156 26625 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:21.270849 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ddf3240694c36a217b486f7f82472" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.271533 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:21.268996 28106 raft_consensus.cc:2749] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:21.279256 26551 leader_election.cc:400] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Vote denied by peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541) with higher term. Message: Invalid argument: T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5.
I20260709 12:29:21.283411 26661 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:29:21.284605 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.288412 27301 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:21.286181 27347 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:21.289383 26580 raft_consensus.cc:1275] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:21.288408 26551 leader_election.cc:403] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:21.291882 27724 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:21.292269 27581 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.292747 28059 raft_consensus.cc:993] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: : Instructing follower baa04b33c4e846e49c1e22e5f9bfe644 to start an election
I20260709 12:29:21.293196 28059 raft_consensus.cc:1081] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Signalling peer baa04b33c4e846e49c1e22e5f9bfe644 to start an election
I20260709 12:29:21.293882 27843 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.295601 27956 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:21.301265 26510 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 1.
I20260709 12:29:21.292011 27906 raft_consensus.cc:2804] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:21.287930 28010 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:21.310920 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.264072 27683 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:21.292490 27724 raft_consensus.cc:697] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:21.317073 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.317436 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.339013 26581 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:21.339010 26512 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 5.
I20260709 12:29:21.317620 28105 raft_consensus.cc:3055] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:21.324931 28110 raft_consensus.cc:2749] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541) with higher term. Message: Invalid argument: T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5.
I20260709 12:29:21.315851 26551 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:21.329432 27676 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:21.330686 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 58594.6us
W20260709 12:29:21.360391 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 44646us
I20260709 12:29:21.306406 27952 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:21.309391 27906 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.337066 27683 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:21.367216 27906 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:21.370783 28095 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:21.371284 28095 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.371770 27940 raft_consensus.cc:493] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.313637 28010 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.372292 27940 raft_consensus.cc:515] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.372786 28062 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.373548 28062 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.374687 27940 leader_election.cc:290] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.363399 28116 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.363937 27960 consensus_queue.cc:1048] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:21.366329 27952 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.371636 28095 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:21.387171 26661 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:21.389374 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.390123 26654 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:21.376835 26551 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:21.367102 26659 raft_consensus.cc:1275] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:29:21.383240 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.385133 26512 raft_consensus.cc:1275] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:21.385257 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.359308 28105 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:21.376049 28116 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:21.395598 28110 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:29:21.397753 26581 raft_consensus.cc:2393] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:21.398288 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.377839 28010 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:21.415098 26512 raft_consensus.cc:1275] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:21.405953 27302 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:21.400096 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.421355 26504 raft_consensus.cc:2393] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 5: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:21.424930 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.426458 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.427384 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.428150 26506 raft_consensus.cc:2393] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 2: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:21.428915 27724 consensus_queue.cc:237] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:21.432228 26476 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
W20260709 12:29:21.484257 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 52127.9us
W20260709 12:29:21.484720 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 51883us
I20260709 12:29:21.483450 26580 raft_consensus.cc:1275] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:29:21.498466 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 92621.7us
I20260709 12:29:21.415200 28110 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.416081 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb27c0ed64f74c578dbcd030e17d00a4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.529311 28125 consensus_queue.cc:1048] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:29:21.530203 28062 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.530979 28125 consensus_queue.cc:1048] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.532095 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.532807 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f24da90c1944079124e5b4c1ba4733" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:21.435361 27659 raft_consensus.cc:2749] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:21.534732 28099 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:29:21.535205 28099 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.535554 28099 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:21.535482 26513 raft_consensus.cc:1275] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:21.531790 28105 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:21.539625 27952 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.542027 28116 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:21.505620 27962 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:21.543740 27962 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.544152 27962 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:21.510780 28110 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:21.511251 27771 consensus_queue.cc:1048] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:29:21.570724 27676 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:21.575667 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 88415us
I20260709 12:29:21.575870 27906 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:21.581176 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 332507us
W20260709 12:29:21.581382 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 76938.6us
I20260709 12:29:21.617169 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:21.640543 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.641420 26660 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:21.646167 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.646011 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:21.651374 26656 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 1.
I20260709 12:29:21.673349 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
W20260709 12:29:21.694633 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 209222us
I20260709 12:29:21.674422 27347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:42140
I20260709 12:29:21.696507 27347 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:21.696903 27347 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:21.698957 28127 consensus_queue.cc:1048] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:29:21.660118 27627 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:29:21.713482 28128 consensus_queue.cc:1048] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:29:21.719029 26512 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:21.739110 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.746165 27350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be63fec868ca40ea8667c7fac2c3c613" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:21.740001 26584 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:21.731151 27617 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.755810 27349 raft_consensus.cc:1275] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:21.731099 28059 raft_consensus.cc:493] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.776364 27349 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:21.763707 27617 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:21.797580 27617 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:21.798317 27352 raft_consensus.cc:3060] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:21.795674 28095 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:21.771198 28010 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:21.801133 27347 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:21.801570 28095 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:21.802726 27351 raft_consensus.cc:1240] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:29:21.763864 27962 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:21.771351 28059 raft_consensus.cc:515] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.795625 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:21.804572 27347 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:21.812359 26476 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:21.823221 27347 raft_consensus.cc:1240] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:29:21.802745 28010 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.805516 27906 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:21.818197 27659 raft_consensus.cc:2804] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:21.837105 28135 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.833623 27659 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.858055 27659 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:21.838163 27962 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.838157 28135 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.873662 27724 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:21.885383 26509 raft_consensus.cc:1275] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:21.896916 27348 raft_consensus.cc:1240] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:29:21.897083 28131 log.cc:927] Time spent T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:29:21.898267 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.899329 26581 raft_consensus.cc:2368] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4.
I20260709 12:29:21.893244 28110 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.901522 26578 raft_consensus.cc:2368] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 5. Current term is 6.
I20260709 12:29:21.904085 27352 raft_consensus.cc:1275] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:21.905383 26579 raft_consensus.cc:1275] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:21.908104 28135 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.908267 28059 leader_election.cc:290] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.892406 27724 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.895454 28099 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.918426 26507 raft_consensus.cc:1275] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:21.925369 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:21.926208 26658 raft_consensus.cc:2393] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 4: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:21.936730 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:21.937395 26660 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:21.945766 28099 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.956128 27659 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:21.985342 27659 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:21.985968 27302 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:21.956655 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:21.958092 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:21.987829 26658 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:21.958571 26654 raft_consensus.cc:1275] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:21.994987 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:21.995988 27346 raft_consensus.cc:2410] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:29:21.998508 26658 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:21.960475 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:22.061805 26581 raft_consensus.cc:2393] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 6: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:21.961438 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:21.962939 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00d7cbf01954fb19c18146550c0ca07" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.964869 27906 raft_consensus.cc:493] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.064198 27906 raft_consensus.cc:515] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:21.965605 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:21.969130 28114 raft_consensus.cc:493] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:22.065359 26586 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:22.066344 28114 raft_consensus.cc:515] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:22.067783 27906 leader_election.cc:290] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:22.068181 27345 raft_consensus.cc:1275] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:22.068646 28114 leader_election.cc:290] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:21.966460 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57aa38006440444a86a6ec5138a99183" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:21.982813 28119 log.cc:927] Time spent T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: Append to log took a long time: real 0.448s	user 0.016s	sys 0.005s
W20260709 12:29:22.000675 28132 log.cc:927] Time spent T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.274s	user 0.000s	sys 0.002s
I20260709 12:29:22.072041 28113 consensus_queue.cc:1048] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:21.958699 28059 raft_consensus.cc:493] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:22.002315 27971 raft_consensus.cc:2749] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:21.986922 27724 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:22.012334 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:22.076637 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
W20260709 12:29:22.016394 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 195718us
I20260709 12:29:22.077085 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:22.077486 26509 raft_consensus.cc:2393] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 6: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:22.077857 26506 raft_consensus.cc:2393] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 3: Already voted for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in this term.
I20260709 12:29:22.017839 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:22.078890 26507 raft_consensus.cc:3055] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:22.079037 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:22.018741 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:22.079708 27351 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:22.019929 27302 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:22.079864 26512 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:29:22.080034 26507 raft_consensus.cc:740] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:22.081780 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:22.080261 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:22.075526 28059 raft_consensus.cc:515] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:22.021425 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:22.022648 28105 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:22.086383 28059 leader_election.cc:290] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:22.028106 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:22.091042 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf18772950487998aeb7a43530703f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:22.002197 28110 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:22.082665 26336 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48722 (request call id 65) took 7484 ms. Trace:
I20260709 12:29:22.093256 26336 rpcz_store.cc:276] 0709 12:29:14.598221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.598396 (+   175us) service_pool.cc:224] Handling call
0709 12:29:22.082567 (+7484171us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:21.154896 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:21.155570 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:21.155615 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:29:21.155649 (+    34us) tablet.cc:662] Decoding operations
0709 12:29:21.157027 (+  1378us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:21.157130 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:21.157157 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:29:21.158335 (+  1178us) tablet.cc:701] Row locks acquired
0709 12:29:21.158381 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:29:21.158549 (+   168us) write_op.cc:270] Start()
0709 12:29:21.191452 (+ 32903us) write_op.cc:276] Timestamp: P: 1783600161158488 usec, L: 0
0709 12:29:21.208008 (+ 16556us) op_driver.cc:348] REPLICATION: starting
0709 12:29:21.237240 (+ 29232us) log.cc:844] Serialized 5969 byte log entry
0709 12:29:21.680745 (+443505us) op_driver.cc:464] REPLICATION: finished
0709 12:29:21.823664 (+142919us) write_op.cc:301] APPLY: starting
0709 12:29:21.823772 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:21.824092 (+   320us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:21.824230 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:21.912611 (+ 88381us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:21.912992 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:29:21.913055 (+    63us) write_op.cc:312] APPLY: finished
0709 12:29:21.913478 (+   423us) log.cc:844] Serialized 106 byte log entry
0709 12:29:21.913680 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:21.913867 (+   187us) write_op.cc:454] Released schema lock
0709 12:29:21.913946 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:21.945163 (+ 31217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:21.945199 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1248308,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":133029,"apply.run_cpu_time_us":5306,"apply.run_wall_time_us":121423,"num_ops":15,"prepare.queue_time_us":183002,"prepare.run_cpu_time_us":11243,"prepare.run_wall_time_us":151152,"raft.queue_time_us":261648,"raft.run_cpu_time_us":9380,"raft.run_wall_time_us":152288,"replication_time_us":442118,"thread_start_us":359400,"threads_started":4,"wal-append.queue_time_us":136486}]]}
I20260709 12:29:22.096204 26625 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:22.044075 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:22.097937 26504 raft_consensus.cc:2410] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:29:22.044552 26660 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:22.099905 28137 consensus_queue.cc:1048] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:22.101377 27349 raft_consensus.cc:1275] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:22.102623 28137 consensus_queue.cc:1059] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:22.103617 28128 raft_consensus.cc:3055] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:22.103976 28128 raft_consensus.cc:740] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:22.104902 28128 consensus_queue.cc:260] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:22.106850 26580 raft_consensus.cc:1240] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:22.107956 26331 catalog_manager.cc:5697] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:22.109462 28110 consensus_queue.cc:1048] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:22.109771 26331 catalog_manager.cc:5697] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 3, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 3 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:22.112210 28128 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:22.112946 26512 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 3.
I20260709 12:29:22.082193 26507 consensus_queue.cc:260] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:22.115993 26625 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.097163 27724 raft_consensus.cc:2749] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:22.112737 26331 catalog_manager.cc:5697] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } }
I20260709 12:29:22.120095 26331 catalog_manager.cc:5697] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 2, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } }
I20260709 12:29:22.114195 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:22.114810 27960 consensus_queue.cc:1059] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:22.121945 27346 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:22.119830 26507 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:22.032073 26477 leader_election.cc:304] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:22.122834 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 102988us
I20260709 12:29:22.123517 27972 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:22.122088 26331 catalog_manager.cc:5697] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
I20260709 12:29:22.135320 27972 raft_consensus.cc:697] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:22.123769 27971 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.136526 26331 catalog_manager.cc:5697] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } }
I20260709 12:29:22.138543 26582 raft_consensus.cc:1275] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:22.138229 26331 catalog_manager.cc:5697] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 1 to 3, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
I20260709 12:29:22.138451 27972 consensus_queue.cc:237] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:22.139343 26580 raft_consensus.cc:1275] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:22.139876 26507 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
W20260709 12:29:22.142071 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 110099us
I20260709 12:29:22.142704 27971 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:22.143666 28059 raft_consensus.cc:2749] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:29:22.143026 27659 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:22.145351 27971 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:22.149966 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:22.150660 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:22.150995 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fcb1f4dc2c4377a60316fa1c70a8b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:22.152731 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91df34303a124f3eb4e5103bd9254c6a" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:22.150447 27952 consensus_queue.cc:1048] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:29:22.150522 27346 raft_consensus.cc:1240] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:29:22.054222 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 71172.3us
I20260709 12:29:22.158360 26625 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:22.161342 28143 raft_consensus.cc:2749] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:22.161394 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:22.162364 27960 raft_consensus.cc:3055] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:22.163012 27960 raft_consensus.cc:740] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:22.164006 27960 consensus_queue.cc:260] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:22.164744 28114 consensus_queue.cc:1048] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:22.165252 27960 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:22.162729 26551 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:22.169281 28143 raft_consensus.cc:2804] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:22.169787 28143 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:22.170261 28143 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:22.170763 27301 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:22.169633 26625 leader_election.cc:400] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4.
I20260709 12:29:22.171891 26625 leader_election.cc:403] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:22.172492 27906 raft_consensus.cc:2804] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:22.173136 27906 raft_consensus.cc:697] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:22.174957 28097 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:22.175408 28097 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.175742 28097 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:22.174562 27906 consensus_queue.cc:237] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:22.177917 26477 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.179514 26625 leader_election.cc:400] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 5. Current term is 6.
I20260709 12:29:22.179890 26625 leader_election.cc:403] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:22.175742 27301 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:22.177162 28137 raft_consensus.cc:2749] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 3. Current term is 4.
I20260709 12:29:22.177973 27956 consensus_queue.cc:1048] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:22.178047 27659 consensus_queue.cc:1048] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:22.172410 27351 raft_consensus.cc:2468] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 5.
I20260709 12:29:22.193342 26477 leader_election.cc:304] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.184582 27302 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.195307 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:22.197345 27349 raft_consensus.cc:1240] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:22.199811 27302 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.182080 28002 raft_consensus.cc:2804] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:22.201226 28059 raft_consensus.cc:2749] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:22.203336 27956 consensus_queue.cc:1059] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:22.192203 28125 raft_consensus.cc:3060] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:29:22.201380 27598 raft_consensus.cc:2749] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:29:22.208977 26580 raft_consensus.cc:1275] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:22.212540 26551 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:22.192329 27940 raft_consensus.cc:2749] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:22.214425 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:22.214988 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:22.215149 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:22.212919 27984 raft_consensus.cc:2749] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:22.223289 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:22.223397 26585 raft_consensus.cc:2393] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 6: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:22.223965 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:22.223291 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:22.225339 26579 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:22.226696 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:22.214614 28113 raft_consensus.cc:2804] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:22.232158 28113 raft_consensus.cc:697] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:22.233078 28113 consensus_queue.cc:237] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:22.243688 26512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:22.244549 26512 raft_consensus.cc:606] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:22.244911 26512 raft_consensus.cc:614] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:22.212087 27956 raft_consensus.cc:3055] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:22.251137 27956 raft_consensus.cc:740] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:22.275068 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18e20a50264529b43abc6da23a41db" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:22.271353 28002 raft_consensus.cc:697] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:22.269469 27940 consensus_queue.cc:1048] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:29:22.295855 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:22.298097 27989 consensus_queue.cc:1048] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:22.300601 27956 consensus_queue.cc:260] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:22.302685 28161 log.cc:927] Time spent T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:29:22.362565 28143 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:22.363112 28125 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 5. Current term is 6.
I20260709 12:29:22.363802 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:22.365868 28002 consensus_queue.cc:237] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:22.290719 27598 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:29:22.372476 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 85573.1us
I20260709 12:29:22.384016 26625 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.399804 26512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac3baa350f54fe492420693918644a7"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:22.400427 26512 raft_consensus.cc:606] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Received request to transfer leadership to TS baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:22.400767 26512 raft_consensus.cc:614] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:22.401690 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:22.412031 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:22.413350 26658 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
W20260709 12:29:22.416867 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 124903us
I20260709 12:29:22.423243 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:22.424017 26512 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:22.377213 27931 consensus_queue.cc:1048] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:29:22.426796 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddef97e10ce649ae82d02133a094f7ff" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:22.411111 27956 raft_consensus.cc:3060] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:22.392747 28127 consensus_queue.cc:1048] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 12:29:22.468192 26627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:22.432576 27843 raft_consensus.cc:493] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.489039 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:29:22.491806 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:22.476485 28137 raft_consensus.cc:2749] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:22.502431 27724 raft_consensus.cc:2749] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:22.543576 26477 leader_election.cc:304] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
W20260709 12:29:22.617873 28168 log.cc:927] Time spent T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:29:22.620934 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:22.555577 28099 raft_consensus.cc:2749] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:22.531726 27843 raft_consensus.cc:515] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
W20260709 12:29:22.639326 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 211764us
I20260709 12:29:22.654747 26476 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.676892 26550 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:22.634377 28097 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:22.688337 27771 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:29:22.694199 28097 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:22.696305 26582 raft_consensus.cc:1240] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:22.697770 27843 leader_election.cc:290] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:22.697937 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:22.698760 26513 raft_consensus.cc:2368] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3.
I20260709 12:29:22.700230 28176 consensus_queue.cc:1048] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:29:22.700959 28176 consensus_queue.cc:1243] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer baa04b33c4e846e49c1e22e5f9bfe644 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:22.711773 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:22.642333 26579 raft_consensus.cc:2468] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:22.722977 28154 raft_consensus.cc:2764] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:29:22.714787 26625 leader_election.cc:400] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3.
I20260709 12:29:22.723706 26625 leader_election.cc:403] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:29:22.712055 28143 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:22.750440 27960 raft_consensus.cc:3060] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:22.791657 27302 leader_election.cc:304] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:22.796715 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 140178us
I20260709 12:29:22.800192 26476 leader_election.cc:304] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.804630 27302 leader_election.cc:304] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:22.848526 26655 raft_consensus.cc:2468] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 6.
I20260709 12:29:22.855386 28183 raft_consensus.cc:2749] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:22.802695 27724 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
W20260709 12:29:22.855840 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 51413.7us
I20260709 12:29:22.857550 28134 raft_consensus.cc:2749] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:22.857995 27906 raft_consensus.cc:493] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.807669 28126 raft_consensus.cc:2749] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:22.907490 27302 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:22.923002 28114 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:22.894613 27724 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:22.900297 27906 raft_consensus.cc:515] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:22.946040 28114 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.974041 28114 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:23.005409 27960 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053) with higher term. Message: Invalid argument: T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3.
I20260709 12:29:23.009289 27906 leader_election.cc:290] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:23.013455 26509 raft_consensus.cc:1275] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:23.021971 28111 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:23.028174 26477 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:23.033067 28181 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:23.033681 28181 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.034040 28193 raft_consensus.cc:2804] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:23.035825 28181 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.026239 28111 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.039234 28111 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.039870 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:23.070451 26657 raft_consensus.cc:1275] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:23.075992 26659 raft_consensus.cc:1275] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:23.077654 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:23.081264 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:23.083945 26585 raft_consensus.cc:2368] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3.
I20260709 12:29:23.072505 28193 raft_consensus.cc:697] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:23.086086 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:23.086381 28193 consensus_queue.cc:237] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:23.086957 26653 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:23.091004 26550 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:23.094843 28111 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:23.095494 28111 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:23.096064 28111 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:23.104722 26550 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:23.106104 28153 raft_consensus.cc:2804] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:23.106686 28153 raft_consensus.cc:697] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:23.107545 28153 consensus_queue.cc:237] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:23.113200 26625 leader_election.cc:400] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 election: Vote denied by peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163) with higher term. Message: Invalid argument: T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 2. Current term is 3.
W20260709 12:29:23.116740 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 84163.2us
I20260709 12:29:23.096256 28114 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:23.122728 27353 raft_consensus.cc:1240] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:29:23.124143 28114 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:23.152269 28127 consensus_queue.cc:1059] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:29:23.166736 28062 consensus_queue.cc:1059] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:23.167176 28127 consensus_queue.cc:1243] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Peer baa04b33c4e846e49c1e22e5f9bfe644 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:23.192224 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ca6dc5d4574e99b2919d9261d9cb28" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:23.204939 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab5bed2ac8d429cbf2b3802b44b7888" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:23.206938 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:23.177098 28181 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:23.210915 28181 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.213169 28181 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.201391 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:23.216632 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:23.217384 26659 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:23.219448 26550 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:23.220417 28113 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:23.220793 28113 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:23.221160 28113 raft_consensus.cc:3060] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:23.222138 28111 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.224766 28111 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.227846 26510 raft_consensus.cc:1275] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:23.228418 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:23.239881 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:23.238059 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:23.236569 28181 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:23.251155 28181 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.252769 27345 raft_consensus.cc:1275] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:23.253470 28181 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.254971 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:23.243283 28134 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.259166 28134 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.261081 27352 raft_consensus.cc:2393] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 4: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:23.263516 26582 raft_consensus.cc:1240] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Rejecting Update request from peer 131fcd2f6a7a4ab39ad3dd26b08c92ea for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:29:23.273065 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:23.274006 26582 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:23.275619 27302 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:23.290307 27724 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:23.292260 28134 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:23.293495 28099 raft_consensus.cc:3055] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:23.293962 28099 raft_consensus.cc:740] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:23.294950 28154 consensus_queue.cc:1048] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:23.295760 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:23.296459 26655 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 5.
I20260709 12:29:23.300618 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:23.305308 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8bb74cfe63435e983f2e9258c229ba" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:23.309448 26551 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:23.309964 27956 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:23.310398 28154 raft_consensus.cc:2749] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:23.312516 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:23.313354 27346 raft_consensus.cc:2393] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 4: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:23.314625 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:23.316294 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:23.336330 26625 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:23.341675 26658 raft_consensus.cc:1275] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:23.310504 27956 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.344995 27956 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.280324 28199 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:23.348753 26659 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:23.351476 26507 raft_consensus.cc:1275] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:23.354084 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:23.352519 26551 leader_election.cc:304] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:23.355243 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:23.356525 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 45151.2us
I20260709 12:29:23.355786 26659 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 4.
I20260709 12:29:23.272432 28195 consensus_queue.cc:1059] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:29:23.350831 28125 raft_consensus.cc:2749] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:23.370298 28217 raft_consensus.cc:2749] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:23.371207 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:23.372285 28002 consensus_queue.cc:1048] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:23.377547 28113 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.379916 28113 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.367395 27301 leader_election.cc:304] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:23.360462 27984 consensus_queue.cc:1048] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:29:23.384114 27984 consensus_queue.cc:1243] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer 4b371ddb5e924d6e8b56b476a69a27d0 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:23.351830 28199 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.387259 28199 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:23.390769 28180 consensus_queue.cc:1048] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:23.392684 28183 consensus_queue.cc:1048] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:23.396504 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:23.397327 27352 raft_consensus.cc:2393] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 5: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:23.392696 27989 consensus_queue.cc:1048] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:29:23.402346 27301 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:23.403015 27581 raft_consensus.cc:2749] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:23.404558 27676 raft_consensus.cc:2749] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:29:23.405189 27676 consensus_queue.cc:1048] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:23.409448 28214 log.cc:927] Time spent T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:29:23.411693 26625 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:23.412737 28184 raft_consensus.cc:2749] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:29:23.436648 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 80960us
I20260709 12:29:23.438102 26551 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:23.444054 26550 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:23.445077 26550 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:23.446532 28153 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:23.447203 28153 raft_consensus.cc:697] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:23.450297 26661 pending_rounds.cc:85] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting all ops after (but not including) 1
I20260709 12:29:23.450700 26661 pending_rounds.cc:107] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:29:23.450938 26661 raft_consensus.cc:2889] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:23.469619 26657 raft_consensus.cc:1275] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:29:23.470002 26657 pending_rounds.cc:85] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting all ops after (but not including) 3
I20260709 12:29:23.470184 26657 pending_rounds.cc:107] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:29:23.470378 26657 raft_consensus.cc:2889] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:23.453723 28110 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:23.483654 28099 consensus_queue.cc:260] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:23.485337 28099 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:23.482033 28153 consensus_queue.cc:237] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.474891 28110 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:23.490026 26335 catalog_manager.cc:5697] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:29:23.493280 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:23.513020 28199 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.515065 27351 raft_consensus.cc:2393] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 4: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:23.499543 28110 raft_consensus.cc:3060] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:23.498925 28218 raft_consensus.cc:2749] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:29:23.536959 26335 catalog_manager.cc:5697] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } }
I20260709 12:29:23.541725 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:23.544199 26508 raft_consensus.cc:1275] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:29:23.545768 26335 catalog_manager.cc:5697] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:23.547709 26335 catalog_manager.cc:5697] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 2, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 2 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } }
I20260709 12:29:23.550625 28199 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:23.549149 26335 catalog_manager.cc:5697] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 3 to 4, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:29:23.575259 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:23.575948 26653 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:23.581055 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:23.596433 26653 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 5.
I20260709 12:29:23.579504 28219 consensus_queue.cc:1048] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:29:23.605708 26578 raft_consensus.cc:1275] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:23.634811 27659 consensus_queue.cc:1048] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:29:23.642845 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 167033us
I20260709 12:29:23.703059 27301 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
W20260709 12:29:23.727304 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 57345.1us
W20260709 12:29:23.681459 28222 log.cc:927] Time spent T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:29:23.735322 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 62695.1us
I20260709 12:29:23.743850 26652 raft_consensus.cc:2468] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:23.760658 27627 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:23.734200 28110 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:23.817369 28225 log.cc:927] Time spent T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:29:23.782649 28219 consensus_queue.cc:1048] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:29:23.835992 28110 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.851241 26335 catalog_manager.cc:5697] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 3 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 5 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.853152 26335 catalog_manager.cc:5697] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
W20260709 12:29:23.857928 28231 log.cc:927] Time spent T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
W20260709 12:29:23.867630 28227 log.cc:927] Time spent T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 12:29:23.868464 26335 catalog_manager.cc:5697] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:23.871639 26331 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45822 (request call id 115) took 2606 ms. Trace:
I20260709 12:29:23.872141 26331 rpcz_store.cc:276] 0709 12:29:21.265203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:21.265609 (+   406us) service_pool.cc:224] Handling call
0709 12:29:21.363867 (+ 98258us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b540083e354. stack: 00007ff1895e7343 00007ff1895e7240 00007ff188f761d4 00007ff192cb4304 00007ff192cb4299 00007ff18c670090 00007ff18c70ef3a 00007ff1924c4e9c 00007ff1925c304e 00007ff190a842a4 00007ff190a84232 00007ff190a84161 00007ff190a840dc 00007ff190a83392 00007ff18aa4148c 00007ff18aa408c6
0709 12:29:23.871547 (+2507680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:22.489258 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:22.489840 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:22.489875 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:29:22.489892 (+    17us) tablet.cc:662] Decoding operations
0709 12:29:22.490803 (+   911us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:22.490871 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:22.490902 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:29:22.491481 (+   579us) tablet.cc:701] Row locks acquired
0709 12:29:22.491495 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:29:22.491647 (+   152us) write_op.cc:270] Start()
0709 12:29:22.491760 (+   113us) write_op.cc:276] Timestamp: P: 1783600162491595 usec, L: 0
0709 12:29:22.491780 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:29:22.492528 (+   748us) log.cc:844] Serialized 2869 byte log entry
0709 12:29:22.826550 (+334022us) op_driver.cc:464] REPLICATION: finished
0709 12:29:23.026384 (+199834us) write_op.cc:301] APPLY: starting
0709 12:29:23.027555 (+  1171us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:23.039942 (+ 12387us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:23.040059 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:23.040806 (+   747us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:23.041002 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:29:23.041045 (+    43us) write_op.cc:312] APPLY: finished
0709 12:29:23.041282 (+   237us) log.cc:844] Serialized 58 byte log entry
0709 12:29:23.042210 (+   928us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:23.042342 (+   132us) write_op.cc:454] Released schema lock
0709 12:29:23.042390 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:23.042741 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:23.042770 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4330,"reported_tablets":32,"spinlock_wait_cycles":65391872,"child_traces":[["op",{"apply.queue_time_us":185057,"apply.run_cpu_time_us":2473,"apply.run_wall_time_us":23738,"num_ops":7,"prepare.queue_time_us":340166,"prepare.run_cpu_time_us":3594,"prepare.run_wall_time_us":3594,"replication_time_us":334618,"thread_start_us":371464,"threads_started":2}]]}
I20260709 12:29:23.876241 27960 raft_consensus.cc:3055] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:23.886163 27960 raft_consensus.cc:740] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:23.887104 27960 consensus_queue.cc:260] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:23.888326 27960 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:23.899683 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:23.901190 26653 raft_consensus.cc:1275] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:23.908459 28137 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.908999 28137 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.911159 26550 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:23.912601 28233 raft_consensus.cc:2804] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:23.913843 28233 raft_consensus.cc:697] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:23.914355 28137 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:23.914958 28233 consensus_queue.cc:237] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:23.916842 26655 raft_consensus.cc:2468] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 5.
I20260709 12:29:23.870190 26335 catalog_manager.cc:5697] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 5, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:29:23.918641 26335 catalog_manager.cc:5697] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 4, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 4 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.925004 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:23.928614 26550 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:23.931170 26661 raft_consensus.cc:1275] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:29:23.927127 26335 catalog_manager.cc:5697] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 5, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:29:23.939494 26335 catalog_manager.cc:5697] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:23.947749 26335 catalog_manager.cc:5697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 4 to 5, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } }
I20260709 12:29:23.949174 28235 raft_consensus.cc:2804] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:23.932379 28099 consensus_queue.cc:1048] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:29:23.960580 26335 catalog_manager.cc:5697] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
I20260709 12:29:23.987768 26335 catalog_manager.cc:5697] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 4, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:29:23.944432 27627 raft_consensus.cc:697] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:23.989681 26335 catalog_manager.cc:5697] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.983578 28235 raft_consensus.cc:697] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:24.002493 26335 catalog_manager.cc:5697] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
W20260709 12:29:24.008558 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 220069us
I20260709 12:29:24.019930 27351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:24.020745 27351 raft_consensus.cc:2393] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 5: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:24.031383 27351 raft_consensus.cc:1240] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Rejecting Update request from peer 4b371ddb5e924d6e8b56b476a69a27d0 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 12:29:24.040333 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 107178us
I20260709 12:29:24.005685 28235 consensus_queue.cc:237] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:24.041684 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71584399dd7f43d8950539126b066e37" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:24.048218 28244 consensus_queue.cc:1048] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:24.029994 27627 consensus_queue.cc:237] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:24.130205 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 66718.8us
I20260709 12:29:24.146435 27352 raft_consensus.cc:1240] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:24.166666 26625 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:24.175216 28127 raft_consensus.cc:2749] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:24.252847 26551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 66731.3us
W20260709 12:29:24.253867 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 66991.8us
I20260709 12:29:24.256142 26657 raft_consensus.cc:1240] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Rejecting Update request from peer 4ecb621c9f7f4c6698e141f131a14c4e for earlier term 4. Current term is 5. Ops: []
I20260709 12:29:24.291473 28178 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.296578 28178 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:24.292098 28235 consensus_queue.cc:1059] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:29:24.318823 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:24.345243 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102123f032ed4637895154c8d3cfe658" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:24.346205 26659 raft_consensus.cc:2410] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:29:24.346926 28178 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:24.354992 27301 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:24.355820 27581 raft_consensus.cc:2749] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:24.342674 28235 consensus_queue.cc:1243] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer baa04b33c4e846e49c1e22e5f9bfe644 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:29:24.360458 28218 consensus_queue.cc:1059] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:29:24.392278 27971 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.416589 27971 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:24.422075 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:24.439023 27971 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
I20260709 12:29:24.498185 26661 raft_consensus.cc:1275] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:24.500366 28233 consensus_queue.cc:1048] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:24.512042 26660 raft_consensus.cc:1275] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:24.523084 28233 consensus_queue.cc:1048] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:24.565878 28236 raft_consensus.cc:3055] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:24.566383 28236 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:24.567265 28236 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:24.568606 28236 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:24.582998 27352 raft_consensus.cc:1275] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:24.585276 28153 consensus_queue.cc:1048] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:24.596323 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:24.608474 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5a23561d854cb098b5ecc2eec7f3b4" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:24.611294 26656 raft_consensus.cc:1275] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:24.615592 27346 raft_consensus.cc:1275] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:24.617131 28237 consensus_queue.cc:1048] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:24.633961 27301 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:24.660652 28003 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:24.710647 27971 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:24.718832 27971 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:24.721403 27971 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:24.725571 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:24.726502 26584 raft_consensus.cc:2393] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 5: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:24.731431 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:24.732125 26509 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 5.
I20260709 12:29:24.733752 27302 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:24.736511 28003 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:24.736938 28003 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:24.737309 28003 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:24.746165 26578 raft_consensus.cc:1275] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:29:24.749683 26578 pending_rounds.cc:85] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: Aborting all ops after (but not including) 3
I20260709 12:29:24.749943 26578 pending_rounds.cc:107] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:29:24.750203 26578 raft_consensus.cc:2889] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:24.775439 28257 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:24.783937 28003 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:24.783711 28262 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:24.791576 28262 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:24.795089 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:24.795737 26661 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 5.
I20260709 12:29:24.796818 26476 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:24.798062 27940 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:24.798462 27940 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b371ddb5e924d6e8b56b476a69a27d0)
I20260709 12:29:24.798857 27940 raft_consensus.cc:3060] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:24.800096 28262 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:24.809367 27989 raft_consensus.cc:2749] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:29:24.809428 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" is_pre_election: true
I20260709 12:29:24.810883 27352 raft_consensus.cc:2393] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 5: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:24.813623 28003 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:24.827382 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:24.834518 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:24.850462 26332 catalog_manager.cc:5697] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 2 to 3, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.851689 26507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1482f526e3e847889ab33113a4254db7"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:24.852304 26507 raft_consensus.cc:606] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:24.852960 26507 raft_consensus.cc:614] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:24.856302 26332 catalog_manager.cc:5697] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.858134 26332 catalog_manager.cc:5697] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 1 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } }
I20260709 12:29:24.864578 26509 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa04b33c4e846e49c1e22e5f9bfe644 in term 5.
I20260709 12:29:24.864362 26332 catalog_manager.cc:5697] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 1 to 2, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 2 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.866158 27302 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:24.869238 28257 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:24.872123 26578 raft_consensus.cc:2393] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 in current term 5: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:24.883082 26335 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45818 (request call id 119) took 3735 ms. Trace:
I20260709 12:29:24.884610 28257 raft_consensus.cc:697] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Leader. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:24.896273 27940 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:24.897183 28257 consensus_queue.cc:237] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:24.903450 26508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207cf65124de4fd1a9e0f6f3332bd1c3"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:24.904136 26508 raft_consensus.cc:606] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:24.904570 26508 raft_consensus.cc:614] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:24.906260 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:24.907054 27352 raft_consensus.cc:2393] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in current term 5: Already voted for candidate baa04b33c4e846e49c1e22e5f9bfe644 in this term.
I20260709 12:29:24.908967 26507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:24.909719 26507 raft_consensus.cc:606] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:24.911585 26507 raft_consensus.cc:614] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:24.919369 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:24.915050 27940 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:24.928306 26508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:24.929080 26508 raft_consensus.cc:606] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:24.932174 26578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2acc4a4b3b54b9381d3203a4023ba71"
dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52818
I20260709 12:29:24.932569 26653 raft_consensus.cc:2468] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 5.
I20260709 12:29:24.932988 26578 raft_consensus.cc:606] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:24.933557 26578 raft_consensus.cc:614] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:24.891108 26335 rpcz_store.cc:276] 0709 12:29:21.148030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:21.148260 (+   230us) service_pool.cc:224] Handling call
0709 12:29:24.883008 (+3734748us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:24.142925 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:24.143559 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:24.143598 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:29:24.143619 (+    21us) tablet.cc:662] Decoding operations
0709 12:29:24.254118 (+110499us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:24.254205 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:24.254232 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:29:24.294896 (+ 40664us) tablet.cc:701] Row locks acquired
0709 12:29:24.294919 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:29:24.295083 (+   164us) write_op.cc:270] Start()
0709 12:29:24.295207 (+   124us) write_op.cc:276] Timestamp: P: 1783600164295039 usec, L: 0
0709 12:29:24.295228 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:29:24.316275 (+ 21047us) log.cc:844] Serialized 6749 byte log entry
0709 12:29:24.644132 (+327857us) op_driver.cc:464] REPLICATION: finished
0709 12:29:24.761592 (+117460us) write_op.cc:301] APPLY: starting
0709 12:29:24.761698 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:24.762056 (+   358us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:24.762195 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:24.763988 (+  1793us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:24.764311 (+   323us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:29:24.764514 (+   203us) write_op.cc:312] APPLY: finished
0709 12:29:24.764950 (+   436us) log.cc:844] Serialized 118 byte log entry
0709 12:29:24.765158 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:24.785326 (+ 20168us) write_op.cc:454] Released schema lock
0709 12:29:24.785401 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:24.785785 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:24.785809 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":383728,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":115274,"apply.run_cpu_time_us":4315,"apply.run_wall_time_us":24234,"num_ops":17,"prepare.queue_time_us":45268,"prepare.run_cpu_time_us":26071,"prepare.run_wall_time_us":365710,"raft.queue_time_us":94336,"raft.run_cpu_time_us":23039,"raft.run_wall_time_us":111461,"replication_time_us":348743,"thread_start_us":402595,"threads_started":4,"wal-append.queue_time_us":225536}]]}
I20260709 12:29:24.939747 26476 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:24.940660 28126 raft_consensus.cc:2804] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:24.943145 28126 raft_consensus.cc:697] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:24.946188 28126 consensus_queue.cc:237] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:24.989912 26332 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45824 (request call id 114) took 4135 ms. Trace:
I20260709 12:29:24.990660 26336 catalog_manager.cc:5697] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 4 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } }
I20260709 12:29:24.993062 26336 catalog_manager.cc:5697] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 1 to 4, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.995363 26336 catalog_manager.cc:5697] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 4, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:24.998368 26332 rpcz_store.cc:276] 0709 12:29:20.854722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:20.856006 (+  1284us) service_pool.cc:224] Handling call
0709 12:29:24.989811 (+4133805us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:24.929057 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:24.929568 (+   511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:24.929603 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:29:24.929623 (+    20us) tablet.cc:662] Decoding operations
0709 12:29:24.930180 (+   557us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:24.930232 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:24.930258 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:29:24.930672 (+   414us) tablet.cc:701] Row locks acquired
0709 12:29:24.930686 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:29:24.930846 (+   160us) write_op.cc:270] Start()
0709 12:29:24.930955 (+   109us) write_op.cc:276] Timestamp: P: 1783600164930790 usec, L: 0
0709 12:29:24.930971 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:29:24.931612 (+   641us) log.cc:844] Serialized 1705 byte log entry
0709 12:29:24.933935 (+  2323us) op_driver.cc:464] REPLICATION: finished
0709 12:29:24.934248 (+   313us) write_op.cc:301] APPLY: starting
0709 12:29:24.934335 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:24.934478 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:24.934571 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:24.935042 (+   471us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:24.935247 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:29:24.935293 (+    46us) write_op.cc:312] APPLY: finished
0709 12:29:24.935539 (+   246us) log.cc:844] Serialized 40 byte log entry
0709 12:29:24.935701 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:24.935807 (+   106us) write_op.cc:454] Released schema lock
0709 12:29:24.935849 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:24.936219 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:24.936263 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4159,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":1924,"apply.run_wall_time_us":1923,"num_ops":4,"prepare.queue_time_us":157,"prepare.run_cpu_time_us":2820,"prepare.run_wall_time_us":2819,"replication_time_us":2837}]]}
I20260709 12:29:24.997530 26336 catalog_manager.cc:5697] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 4 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } }
I20260709 12:29:25.006382 26336 catalog_manager.cc:5697] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 1 to 3, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 3 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:25.011826 26336 catalog_manager.cc:5697] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.015544 26336 catalog_manager.cc:5697] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:25.018574 26336 catalog_manager.cc:5697] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 2 to 5, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 5 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:29:25.020308 26336 catalog_manager.cc:5697] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 1 to 4, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.024160 26336 catalog_manager.cc:5697] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 3 to 4, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 4 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:25.069039 27352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac3baa350f54fe492420693918644a7"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:25.069660 27352 raft_consensus.cc:606] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Received request to transfer leadership to TS 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:25.073037 26507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f373d8db1e3349c48d8c4dfcdada9e41"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:46330
I20260709 12:29:25.073643 26507 raft_consensus.cc:606] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:25.073982 26507 raft_consensus.cc:614] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:25.079190 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:29:25.081578 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:25.081787 26332 catalog_manager.cc:5697] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.083633 26332 catalog_manager.cc:5697] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 4, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } }
I20260709 12:29:25.084961 26332 catalog_manager.cc:5697] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
I20260709 12:29:25.089577 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:25.090230 26332 catalog_manager.cc:5697] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
I20260709 12:29:25.092428 26332 catalog_manager.cc:5697] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.097199 26332 catalog_manager.cc:5697] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 1 to 3, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
I20260709 12:29:25.095860 26336 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48722 (request call id 66) took 1681 ms. Trace:
I20260709 12:29:25.100811 26336 rpcz_store.cc:276] 0709 12:29:23.414138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:23.414857 (+   719us) service_pool.cc:224] Handling call
0709 12:29:25.057458 (+1642601us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:25.057494 (+    36us) write_op.cc:454] Released schema lock
0709 12:29:25.095759 (+ 38265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:25.041565 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:25.042061 (+   496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:25.042111 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:29:25.042130 (+    19us) tablet.cc:662] Decoding operations
0709 12:29:25.043060 (+   930us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:25.043116 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:25.043144 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:29:25.043913 (+   769us) tablet.cc:701] Row locks acquired
0709 12:29:25.043931 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:29:25.044071 (+   140us) write_op.cc:270] Start()
0709 12:29:25.044189 (+   118us) write_op.cc:276] Timestamp: P: 1783600165044027 usec, L: 0
0709 12:29:25.044209 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:29:25.045108 (+   899us) log.cc:844] Serialized 4025 byte log entry
0709 12:29:25.048756 (+  3648us) op_driver.cc:464] REPLICATION: finished
0709 12:29:25.050317 (+  1561us) write_op.cc:301] APPLY: starting
0709 12:29:25.050406 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:25.051942 (+  1536us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:25.052177 (+   235us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:25.053210 (+  1033us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:25.053435 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:29:25.053478 (+    43us) write_op.cc:312] APPLY: finished
0709 12:29:25.053737 (+   259us) log.cc:844] Serialized 76 byte log entry
0709 12:29:25.053913 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:25.054041 (+   128us) write_op.cc:454] Released schema lock
0709 12:29:25.054088 (+    47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":54289,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":1327,"apply.run_cpu_time_us":2844,"apply.run_wall_time_us":4063,"num_ops":10,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":3645,"prepare.run_wall_time_us":14701,"replication_time_us":4406}]]}
I20260709 12:29:25.098879 26332 catalog_manager.cc:5697] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 4, leader changed from 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } }
I20260709 12:29:25.106686 26332 catalog_manager.cc:5697] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 5, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 5 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.155488 26331 catalog_manager.cc:5697] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 3 to 4, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 4 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.160179 26331 catalog_manager.cc:5697] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 3 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 5 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.173959 26331 catalog_manager.cc:5697] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 3 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 5 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:25.182124 27940 raft_consensus.cc:993] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: : Instructing follower 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:25.184501 27940 raft_consensus.cc:1081] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Signalling peer 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:25.203727 26653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:60790
I20260709 12:29:25.204319 26653 raft_consensus.cc:493] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:25.204704 26653 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:25.233364 27984 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.234001 27984 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:25.236210 27984 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:25.237258 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:25.239157 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f36d35c0b94881b6f8db11a1caa351" candidate_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:25.240089 26661 raft_consensus.cc:2410] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa04b33c4e846e49c1e22e5f9bfe644 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:29:25.241330 27301 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa04b33c4e846e49c1e22e5f9bfe644; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:25.242579 28199 raft_consensus.cc:2749] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:29:25.247845 26653 raft_consensus.cc:515] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:25.249421 26336 catalog_manager.cc:5697] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 3 to 5, leader changed from 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.294263 26336 catalog_manager.cc:5697] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 reported cstate change: term changed from 4 to 5, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65). New cstate: current_term: 5 leader_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:25.322124 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:25.322961 26508 raft_consensus.cc:3055] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:25.323290 26508 raft_consensus.cc:740] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:25.324194 26508 consensus_queue.cc:260] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:25.325457 26508 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:25.337720 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734b294b669c4944aaabdb8977f85fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:25.338572 26585 raft_consensus.cc:3060] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:25.338835 26653 leader_election.cc:290] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:25.348726 26585 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:25.350225 26625 leader_election.cc:304] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:25.351202 27931 raft_consensus.cc:2804] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:25.351715 27931 raft_consensus.cc:697] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:25.352653 27931 consensus_queue.cc:237] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:25.352464 26508 raft_consensus.cc:2468] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:25.406144 27346 raft_consensus.cc:1275] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:25.411167 26653 raft_consensus.cc:1275] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:25.414252 28126 consensus_queue.cc:1048] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:25.430673 27771 consensus_queue.cc:1048] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:25.431424 27771 consensus_queue.cc:1243] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Peer baa04b33c4e846e49c1e22e5f9bfe644 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:29:25.436040 27346 pending_rounds.cc:85] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Aborting all ops after (but not including) 1
I20260709 12:29:25.436405 27346 pending_rounds.cc:107] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:29:25.436647 27346 raft_consensus.cc:2889] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:25.459525 26586 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:29:25.473593 26507 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer baa04b33c4e846e49c1e22e5f9bfe644: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:29:25.491833 26335 catalog_manager.cc:5697] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 3 to 4, leader changed from 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.494712 28239 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:29:25.520900 28199 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:29:25.663424 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 48099.2us
I20260709 12:29:25.703797 28284 raft_consensus.cc:993] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 131fcd2f6a7a4ab39ad3dd26b08c92ea to start an election
I20260709 12:29:25.704342 28282 raft_consensus.cc:1081] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Signalling peer 131fcd2f6a7a4ab39ad3dd26b08c92ea to start an election
W20260709 12:29:25.704924 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 101885us
I20260709 12:29:25.733287 26508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eac3baa350f54fe492420693918644a7"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
 from {username='slave'} at 127.0.0.1:46320
I20260709 12:29:25.733911 26508 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:25.734263 26508 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:25.752110 26508 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:25.755311 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:25.755815 26508 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:25.755956 27346 raft_consensus.cc:3055] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:25.756407 27346 raft_consensus.cc:740] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:25.757182 27346 consensus_queue.cc:260] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:25.758431 27346 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:25.759927 26586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac3baa350f54fe492420693918644a7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:25.760543 26586 raft_consensus.cc:3060] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:25.765805 27346 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 5.
I20260709 12:29:25.767117 26477 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:25.767953 28126 raft_consensus.cc:2804] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:25.768435 28126 raft_consensus.cc:697] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:25.769292 28126 consensus_queue.cc:237] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:25.772465 26586 raft_consensus.cc:2468] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 5.
I20260709 12:29:25.783516 26331 catalog_manager.cc:5697] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 4 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 5 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:25.794735 26586 raft_consensus.cc:1275] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:25.797426 27931 consensus_queue.cc:1048] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:25.831353 26508 raft_consensus.cc:1275] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:25.843942 28245 consensus_queue.cc:1048] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:26.265425 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:26.493999 27352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:26.494686 27352 raft_consensus.cc:606] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:26.509856 28282 raft_consensus.cc:993] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:26.510334 28282 raft_consensus.cc:1081] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Signalling peer 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:26.523360 26658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:44540
I20260709 12:29:26.532780 26658 raft_consensus.cc:493] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:26.533588 26658 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:26.548703 26658 raft_consensus.cc:515] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:26.560837 26658 leader_election.cc:290] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:26.568466 26584 raft_consensus.cc:1275] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:26.594558 27352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:26.601500 27352 raft_consensus.cc:606] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:26.598706 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:26.608255 26582 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:26.608060 28262 consensus_queue.cc:1048] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:29:26.610031 27301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 86506.8us
I20260709 12:29:26.615960 27351 raft_consensus.cc:1275] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:26.619297 28295 consensus_queue.cc:1048] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:26.670321 27348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:26.671316 27348 raft_consensus.cc:606] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Received request to transfer leadership to TS 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:26.679076 26660 raft_consensus.cc:1240] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 5. Current term is 6. Ops: []
I20260709 12:29:26.728384 28285 consensus_queue.cc:1059] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:26.729791 28199 raft_consensus.cc:3055] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:29:26.730192 28199 raft_consensus.cc:740] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:26.730584 27348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "958b4fe6e86040349d99c54da8473245"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:26.731359 27348 raft_consensus.cc:606] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:26.731052 28199 consensus_queue.cc:260] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:26.734100 28199 raft_consensus.cc:3060] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:26.737768 26582 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 6.
W20260709 12:29:26.744997 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 75150.9us
I20260709 12:29:26.756512 27348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6201f65047045ac9ae106afdade627d"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:26.757256 27348 raft_consensus.cc:606] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:26.758845 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:29:26.760919 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:26.761758 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:26.788331 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001d53e77bda4b339dbb0c3b7e65eef3" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:26.799609 26625 leader_election.cc:304] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:26.801803 28245 raft_consensus.cc:2804] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:26.803700 28245 raft_consensus.cc:697] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:26.809132 28245 consensus_queue.cc:237] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:26.813458 27348 raft_consensus.cc:2468] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 6.
I20260709 12:29:26.849105 28285 raft_consensus.cc:993] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 131fcd2f6a7a4ab39ad3dd26b08c92ea to start an election
I20260709 12:29:26.849591 28285 raft_consensus.cc:1081] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Signalling peer 131fcd2f6a7a4ab39ad3dd26b08c92ea to start an election
I20260709 12:29:26.866611 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
 from {username='slave'} at 127.0.0.1:46320
I20260709 12:29:26.867192 26510 raft_consensus.cc:493] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:26.867561 26510 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:26.876628 26510 raft_consensus.cc:515] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:26.874974 26335 catalog_manager.cc:5697] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 5 to 6, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 6 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:26.882390 26510 leader_election.cc:290] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:26.883332 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:26.884060 26585 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:26.893894 26585 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 6.
I20260709 12:29:26.905261 26477 leader_election.cc:304] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:26.906267 28126 raft_consensus.cc:2804] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:26.907106 28126 raft_consensus.cc:697] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:26.907930 28126 consensus_queue.cc:237] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:26.915800 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828700bf20fa4c988e072c6d158102fc" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:26.916709 27346 raft_consensus.cc:3055] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:29:26.917045 27346 raft_consensus.cc:740] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:26.917878 27346 consensus_queue.cc:260] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:26.920351 27346 raft_consensus.cc:3060] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:26.930332 27346 raft_consensus.cc:2468] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 6.
I20260709 12:29:26.931105 28285 raft_consensus.cc:993] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:26.933471 28285 raft_consensus.cc:1081] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Signalling peer 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:26.952849 28282 raft_consensus.cc:993] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:26.953352 28282 raft_consensus.cc:1081] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Signalling peer 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:26.953913 26331 catalog_manager.cc:5697] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 5 to 6, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 6 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:26.959192 26653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "958b4fe6e86040349d99c54da8473245"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:44540
I20260709 12:29:26.959887 26653 raft_consensus.cc:493] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:26.960235 26653 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:26.973894 26660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:44540
I20260709 12:29:26.974651 26660 raft_consensus.cc:493] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:26.975000 26660 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:26.987996 26660 raft_consensus.cc:515] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:27.024287 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:27.024968 26582 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:27.032996 26582 raft_consensus.cc:2468] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
W20260709 12:29:27.043138 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:39541, user_credentials={real_user=slave}} blocked reactor thread for 83529.3us
I20260709 12:29:27.044214 26625 leader_election.cc:304] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:27.045332 28294 raft_consensus.cc:2804] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:27.045899 28294 raft_consensus.cc:697] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:27.046802 28294 consensus_queue.cc:237] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:26.992381 26653 raft_consensus.cc:515] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:27.056198 26660 leader_election.cc:290] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:27.062906 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 48853.2us
I20260709 12:29:27.066254 28285 raft_consensus.cc:993] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:27.075234 28285 raft_consensus.cc:1081] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Signalling peer 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:27.068010 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:27.076510 26585 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:27.080806 26582 raft_consensus.cc:1240] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Rejecting Update request from peer baa04b33c4e846e49c1e22e5f9bfe644 for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:27.081498 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a863d2269ed4c85b7844c44d071ef2f" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:27.083148 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958b4fe6e86040349d99c54da8473245" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:27.087965 27346 raft_consensus.cc:3055] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:27.088135 27348 raft_consensus.cc:3055] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:27.088688 27348 raft_consensus.cc:740] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:27.089954 27346 raft_consensus.cc:740] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:27.089689 27348 consensus_queue.cc:260] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:27.090883 27346 consensus_queue.cc:260] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:27.091763 27348 raft_consensus.cc:3060] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:27.093281 26660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6201f65047045ac9ae106afdade627d"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:44540
I20260709 12:29:27.094041 26660 raft_consensus.cc:493] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:27.094409 26660 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:27.105428 26660 raft_consensus.cc:515] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:27.075322 26653 leader_election.cc:290] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:27.092048 27346 raft_consensus.cc:3060] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:27.086197 26585 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:27.117741 26625 leader_election.cc:304] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:27.118716 28294 raft_consensus.cc:2804] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:27.119237 28294 raft_consensus.cc:697] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:27.120178 28294 consensus_queue.cc:237] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:27.144028 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: true dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:27.144795 26508 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:27.148197 27348 raft_consensus.cc:2468] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:27.154712 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6201f65047045ac9ae106afdade627d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:27.155520 27352 raft_consensus.cc:3055] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:29:27.155820 27352 raft_consensus.cc:740] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:27.157825 26508 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 6.
I20260709 12:29:27.159518 26625 leader_election.cc:304] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:27.160486 28245 raft_consensus.cc:2804] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:27.161181 28245 raft_consensus.cc:697] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:27.160808 27352 consensus_queue.cc:260] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:27.162406 27352 raft_consensus.cc:3060] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:27.162101 28245 consensus_queue.cc:237] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:27.167766 26660 leader_election.cc:290] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:27.170514 27346 raft_consensus.cc:2468] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:27.184640 27352 raft_consensus.cc:2468] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 6.
I20260709 12:29:27.200800 26331 catalog_manager.cc:5697] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 2 to 3, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.202557 26331 catalog_manager.cc:5697] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.204834 26331 catalog_manager.cc:5697] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 5 to 6, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 6 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.360095 26585 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:29:27.361923 27940 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:29:27.383311 27352 raft_consensus.cc:1275] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:29:27.387079 28245 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:27.423040 26584 raft_consensus.cc:1275] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:29:27.431842 28294 consensus_queue.cc:1048] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:29:27.443032 27352 raft_consensus.cc:1275] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:29:27.444667 28126 consensus_queue.cc:1048] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:29:27.537621 26682 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd280 after lost signal to thread 20920
W20260709 12:29:27.538903 26682 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba340 after lost signal to thread 26370
W20260709 12:29:27.540323 26682 debug-util.cc:398] Leaking SignalData structure 0x7b08001d23a0 after lost signal to thread 26537
W20260709 12:29:27.548390 26682 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6a00 after lost signal to thread 26611
W20260709 12:29:27.550697 26682 debug-util.cc:398] Leaking SignalData structure 0x7b08003e5d40 after lost signal to thread 26685
W20260709 12:29:27.552079 26682 debug-util.cc:398] Leaking SignalData structure 0x7b08000ca3c0 after lost signal to thread 27380
I20260709 12:29:27.561386 27352 raft_consensus.cc:1275] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:27.556268 27348 raft_consensus.cc:1275] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:27.582046 28294 consensus_queue.cc:1048] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:27.583441 28294 consensus_queue.cc:1048] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:27.605537 26508 raft_consensus.cc:1275] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:29:27.607168 28245 consensus_queue.cc:1048] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:27.632340 26582 raft_consensus.cc:1275] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:27.636669 26582 raft_consensus.cc:1275] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:27.637759 28293 consensus_queue.cc:1048] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:27.647396 27352 raft_consensus.cc:1275] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:29:27.648970 28293 consensus_queue.cc:1048] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:27.693097 28245 consensus_queue.cc:1048] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 12:29:27.738775 28329 log.cc:927] Time spent T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:29:27.767194 28330 log.cc:927] Time spent T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
W20260709 12:29:27.893898 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 73238.3us
W20260709 12:29:27.918129 27302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 94896.5us
I20260709 12:29:28.056344 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:28.171227 27346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:28.171921 27346 raft_consensus.cc:606] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Received request to transfer leadership to TS 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:28.192649 27346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:28.193310 27346 raft_consensus.cc:606] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:28.196659 27346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:28.197290 27346 raft_consensus.cc:606] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Received request to transfer leadership to TS 131fcd2f6a7a4ab39ad3dd26b08c92ea
I20260709 12:29:28.201018 27346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:28.201603 27346 raft_consensus.cc:606] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Received request to transfer leadership to TS 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:28.204530 27346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:28.205145 27346 raft_consensus.cc:606] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:28.206434 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:29:28.208381 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:28.209175 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:28.346431 28341 raft_consensus.cc:993] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 4ecb621c9f7f4c6698e141f131a14c4e to start an election
I20260709 12:29:28.347106 28341 raft_consensus.cc:1081] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Signalling peer 4ecb621c9f7f4c6698e141f131a14c4e to start an election
I20260709 12:29:28.349159 26580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21"
dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
 from {username='slave'} at 127.0.0.1:52816
I20260709 12:29:28.350152 26580 raft_consensus.cc:493] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.350586 26580 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.365594 26580 raft_consensus.cc:515] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:28.380424 28342 raft_consensus.cc:993] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 131fcd2f6a7a4ab39ad3dd26b08c92ea to start an election
I20260709 12:29:28.381049 28342 raft_consensus.cc:1081] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Signalling peer 131fcd2f6a7a4ab39ad3dd26b08c92ea to start an election
I20260709 12:29:28.383342 26513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
 from {username='slave'} at 127.0.0.1:46320
I20260709 12:29:28.383989 26513 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.384377 26513 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.409353 26580 leader_election.cc:290] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:28.411345 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:28.411734 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75ba30f9857421393dc3f00cdf47f21" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:28.411887 26508 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.412364 27352 raft_consensus.cc:3055] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:29:28.410949 26513 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:28.412731 27352 raft_consensus.cc:740] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:28.413555 27352 consensus_queue.cc:260] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:28.415519 27352 raft_consensus.cc:3060] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.416716 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:28.417404 27346 raft_consensus.cc:3055] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:29:28.417714 27346 raft_consensus.cc:740] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:28.423163 27346 consensus_queue.cc:260] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:28.428642 27346 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.438803 26508 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 6.
I20260709 12:29:28.440470 26551 leader_election.cc:304] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:28.441665 26513 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:28.444476 27346 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 6.
I20260709 12:29:28.448493 27352 raft_consensus.cc:2468] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 6.
I20260709 12:29:28.450234 26477 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:28.467818 28353 raft_consensus.cc:2804] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:28.480140 28353 raft_consensus.cc:697] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:28.481145 28353 consensus_queue.cc:237] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:28.471879 28313 raft_consensus.cc:2804] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:28.507009 28341 raft_consensus.cc:993] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:28.507623 28341 raft_consensus.cc:1081] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Signalling peer 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:28.509318 28313 raft_consensus.cc:697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:28.510362 28313 consensus_queue.cc:237] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:28.515319 26653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:44540
I20260709 12:29:28.517683 26653 raft_consensus.cc:493] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.518126 26653 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:28.570348 28349 raft_consensus.cc:993] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 131fcd2f6a7a4ab39ad3dd26b08c92ea to start an election
I20260709 12:29:28.570935 28349 raft_consensus.cc:1081] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Signalling peer 131fcd2f6a7a4ab39ad3dd26b08c92ea to start an election
I20260709 12:29:28.571974 26335 catalog_manager.cc:5697] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 5 to 6, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 6 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.583252 26653 raft_consensus.cc:515] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:28.587061 26550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 101836us
I20260709 12:29:28.595146 26513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f"
dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
 from {username='slave'} at 127.0.0.1:46320
I20260709 12:29:28.595858 26513 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.596362 26513 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.597738 26653 leader_election.cc:290] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:28.599012 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:28.599560 26510 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:28.600397 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55bc7c762df41c8b7c71ed2384f9fcb" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:28.600947 27349 raft_consensus.cc:3055] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:28.601212 27349 raft_consensus.cc:740] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:28.606196 28341 raft_consensus.cc:993] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:28.606835 28341 raft_consensus.cc:1081] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Signalling peer 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:28.610069 26653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:44540
I20260709 12:29:28.610579 26653 raft_consensus.cc:493] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.610920 26653 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:28.615016 26513 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:28.621016 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:28.621625 26656 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.622699 26513 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:28.623378 27352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa1d77d71ae4c8993d446d81e4c1e5f" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:28.624048 27352 raft_consensus.cc:3055] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:29:28.624351 27352 raft_consensus.cc:740] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:28.602135 27349 consensus_queue.cc:260] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:28.627094 27349 raft_consensus.cc:3060] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:28.630571 27352 consensus_queue.cc:260] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:28.633589 27352 raft_consensus.cc:3060] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.652688 26336 catalog_manager.cc:5697] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 5 to 6, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 6 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:28.654431 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2846cdd8904c908b6cb1a8f6e42aaf" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:28.663375 26582 raft_consensus.cc:3060] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:28.676386 27352 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 6.
I20260709 12:29:28.678354 26477 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644; no voters: 
I20260709 12:29:28.679345 28355 raft_consensus.cc:2804] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:28.679428 26510 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:28.679944 28355 raft_consensus.cc:697] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:28.680985 28355 consensus_queue.cc:237] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:28.656775 27349 raft_consensus.cc:2468] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:28.688869 26625 leader_election.cc:304] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:28.690158 28348 raft_consensus.cc:2804] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:28.691089 28348 raft_consensus.cc:697] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:28.692114 28348 consensus_queue.cc:237] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:28.678237 26656 raft_consensus.cc:2468] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 6.
I20260709 12:29:28.714620 26653 raft_consensus.cc:515] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:28.716862 26653 leader_election.cc:290] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:28.724251 27349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:28.725188 27349 raft_consensus.cc:3055] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:28.725595 27349 raft_consensus.cc:740] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:28.686218 26582 raft_consensus.cc:2468] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 6.
I20260709 12:29:28.726547 27349 consensus_queue.cc:260] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:28.748914 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247d4b40ff7f4c7ca1055cb3856c254d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:28.750847 26507 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:28.760185 26331 catalog_manager.cc:5697] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.778043 26507 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
I20260709 12:29:28.782008 27349 raft_consensus.cc:3060] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:28.802464 26625 leader_election.cc:304] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:28.812625 28350 raft_consensus.cc:2804] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:28.813143 28350 raft_consensus.cc:697] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:28.813999 28350 consensus_queue.cc:237] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:28.836112 26335 catalog_manager.cc:5697] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 5 to 6, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 6 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:28.859644 27349 raft_consensus.cc:2468] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
I20260709 12:29:28.872088 26335 catalog_manager.cc:5697] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 4 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 5 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.899477 27348 raft_consensus.cc:1275] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:29:28.901043 28355 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:28.975888 26585 raft_consensus.cc:1275] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:29:28.977488 28356 consensus_queue.cc:1048] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:29.092104 26507 raft_consensus.cc:1275] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:29:29.094369 28360 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:29.114318 27348 raft_consensus.cc:1275] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:29:29.116341 28360 consensus_queue.cc:1048] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:29.199337 27348 raft_consensus.cc:1275] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:29:29.201224 28334 consensus_queue.cc:1048] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:29.233354 26510 raft_consensus.cc:1275] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:29.240965 27349 raft_consensus.cc:1275] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:29.241683 26653 raft_consensus.cc:1275] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:29:29.242702 28348 consensus_queue.cc:1048] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:29.265872 28334 consensus_queue.cc:1048] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:29.276537 28350 consensus_queue.cc:1048] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:29.288811 27349 raft_consensus.cc:1275] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:29.303174 28348 consensus_queue.cc:1048] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:29.384828 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:29.430238 26507 raft_consensus.cc:1275] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:29.434904 28388 consensus_queue.cc:1048] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:29.551400 27348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1"
dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
mode: GRACEFUL
new_leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:29:29.552096 27348 raft_consensus.cc:606] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Received request to transfer leadership to TS 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:29.556514 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:29:29.558485 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:29.559347 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:29.967464 28341 raft_consensus.cc:993] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644: : Instructing follower 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:29.968004 28349 raft_consensus.cc:1081] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Signalling peer 4b371ddb5e924d6e8b56b476a69a27d0 to start an election
I20260709 12:29:29.972615 26656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1"
dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
 from {username='slave'} at 127.0.0.1:44540
I20260709 12:29:29.973145 26656 raft_consensus.cc:493] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:29.973557 26656 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:29.996160 26656 raft_consensus.cc:515] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:29.999584 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:30.000214 26580 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:30.001425 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ed770173234cb8984ad0a8be82a8d1" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "baa04b33c4e846e49c1e22e5f9bfe644"
I20260709 12:29:30.002161 27348 raft_consensus.cc:3055] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:30.002462 27348 raft_consensus.cc:740] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa04b33c4e846e49c1e22e5f9bfe644, State: Running, Role: LEADER
I20260709 12:29:30.003273 27348 consensus_queue.cc:260] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:30.009812 27348 raft_consensus.cc:3060] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:30.004635 26656 leader_election.cc:290] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:30.020560 26580 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
I20260709 12:29:30.022325 26625 leader_election.cc:304] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:30.023217 28388 raft_consensus.cc:2804] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:30.023734 28388 raft_consensus.cc:697] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:30.024729 28388 consensus_queue.cc:237] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:30.079150 27348 raft_consensus.cc:2468] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
I20260709 12:29:30.134814 26331 catalog_manager.cc:5697] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 4 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 5 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:30.239086 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.68:41855, user_credentials={real_user=slave}} blocked reactor thread for 71691.8us
W20260709 12:29:30.456566 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:34053, user_credentials={real_user=slave}} blocked reactor thread for 54431.8us
I20260709 12:29:30.576886 27349 raft_consensus.cc:1275] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:30.630455 28397 consensus_queue.cc:1048] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:29:30.651298 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:30.659533 26582 raft_consensus.cc:1275] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:30.668468 28405 consensus_queue.cc:1048] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:30.936216 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:30.938052 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:30.939158 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:30.991775 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:31.043011 20917 tablet_server.cc:179] TabletServer@127.20.109.65:39541 shutting down...
W20260709 12:29:31.079573 26625 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:29:31.114111 26477 consensus_peers.cc:597] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.115487 26625 consensus_peers.cc:597] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.199030 26477 consensus_peers.cc:597] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.242898 26551 consensus_peers.cc:597] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.245363 26551 consensus_peers.cc:597] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.248286 26551 consensus_peers.cc:597] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.278218 26551 consensus_peers.cc:597] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.281411 26551 consensus_peers.cc:597] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.300292 26477 consensus_peers.cc:597] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.301121 26551 consensus_peers.cc:597] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.306898 26477 consensus_peers.cc:597] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.317519 26625 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.319000 26477 consensus_peers.cc:597] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.332456 26477 consensus_peers.cc:597] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.344985 26477 consensus_peers.cc:597] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.344635 26625 consensus_peers.cc:597] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.347230 26625 consensus_peers.cc:597] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.351271 26625 consensus_peers.cc:597] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.354282 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:29:31.355306 26625 consensus_peers.cc:597] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.357290 20917 tablet_replica.cc:333] stopping tablet replica
W20260709 12:29:31.358098 26625 consensus_peers.cc:597] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.358619 26551 consensus_peers.cc:597] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.360824 20917 raft_consensus.cc:2243] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.361488 20917 raft_consensus.cc:2272] T ddef97e10ce649ae82d02133a094f7ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:31.368232 26477 consensus_peers.cc:597] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.372126 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.373425 20917 raft_consensus.cc:2243] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:29:31.374388 26551 consensus_peers.cc:597] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.386121 26477 consensus_peers.cc:597] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.374769 20917 raft_consensus.cc:2272] T 486de29ef17f4eb9aa01601103eaf921 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.394721 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.402226 20917 raft_consensus.cc:2243] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:29:31.409667 26477 consensus_peers.cc:597] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.411448 20917 raft_consensus.cc:2272] T 36b9151618004ebba90012bfc0c4c39b P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.435499 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.439831 20917 raft_consensus.cc:2243] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.440598 20917 raft_consensus.cc:2272] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:31.444096 26477 consensus_peers.cc:597] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:31.448923 26625 consensus_peers.cc:597] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.455552 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.463543 20917 raft_consensus.cc:2243] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.478034 20917 raft_consensus.cc:2272] T b867f2d6360645d4a8c7a56339b7ef56 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.482125 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.483310 20917 raft_consensus.cc:2243] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.484148 20917 raft_consensus.cc:2272] T 001d53e77bda4b339dbb0c3b7e65eef3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:31.489719 26551 consensus_peers.cc:597] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.503180 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.504630 20917 raft_consensus.cc:2243] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.505481 20917 raft_consensus.cc:2272] T 71584399dd7f43d8950539126b066e37 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.535696 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.537022 20917 raft_consensus.cc:2243] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.537742 20917 raft_consensus.cc:2272] T 828700bf20fa4c988e072c6d158102fc P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:31.542166 26551 consensus_peers.cc:597] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.552310 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.567595 20917 raft_consensus.cc:2243] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.568502 20917 raft_consensus.cc:2272] T 0a2846cdd8904c908b6cb1a8f6e42aaf P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.572032 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.579476 20917 raft_consensus.cc:2243] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.580768 20917 raft_consensus.cc:2272] T a0eddc7ff9ef4017b178747494e76fc2 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:31.592379 26625 consensus_peers.cc:597] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:31.597299 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.602218 20917 raft_consensus.cc:2243] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.603121 20917 raft_consensus.cc:2272] T 207cf65124de4fd1a9e0f6f3332bd1c3 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.629546 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.631808 20917 raft_consensus.cc:2243] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.633162 20917 raft_consensus.cc:2272] T 6a2a8cf91f76492d8418cba471ffe78e P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.689301 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.690353 20917 raft_consensus.cc:2243] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.691715 20917 raft_consensus.cc:2272] T 6180fe8f3be6486d829a4b44cc3c7f9d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.696148 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.697206 20917 raft_consensus.cc:2243] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.698010 20917 raft_consensus.cc:2272] T 579a9b2cdca24a6a95444e424f03a551 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.709106 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.714632 20917 raft_consensus.cc:2243] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.716080 20917 raft_consensus.cc:2272] T 6aefe5d0dc7846ca9db57012baae4777 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.720314 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.723309 20917 raft_consensus.cc:2243] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.741542 20917 raft_consensus.cc:2272] T eac3baa350f54fe492420693918644a7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.747884 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.771154 20917 raft_consensus.cc:2243] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.772267 20917 raft_consensus.cc:2272] T d32ec030f9c24f4591d2794595b4bd1c P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.775049 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.775882 20917 raft_consensus.cc:2243] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.776582 20917 raft_consensus.cc:2272] T 325ddf3240694c36a217b486f7f82472 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.779906 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.780830 20917 raft_consensus.cc:2243] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.781445 20917 raft_consensus.cc:2272] T 55ed770173234cb8984ad0a8be82a8d1 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.820761 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.838152 20917 raft_consensus.cc:2243] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.845033 20917 raft_consensus.cc:2272] T 488122ee22144275b3f537809a55060d P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.857637 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.858680 20917 raft_consensus.cc:2243] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.859393 20917 raft_consensus.cc:2272] T 1a863d2269ed4c85b7844c44d071ef2f P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.862569 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.863575 20917 raft_consensus.cc:2243] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.864197 20917 raft_consensus.cc:2272] T b75ba30f9857421393dc3f00cdf47f21 P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.869683 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.876432 20917 raft_consensus.cc:2243] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.877769 20917 raft_consensus.cc:2272] T 1482f526e3e847889ab33113a4254db7 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.880983 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.883765 20917 raft_consensus.cc:2243] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.884400 20917 raft_consensus.cc:2272] T 90f36d35c0b94881b6f8db11a1caa351 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.887979 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.888819 20917 raft_consensus.cc:2243] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.889516 20917 raft_consensus.cc:2272] T afa1d77d71ae4c8993d446d81e4c1e5f P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.892944 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.893730 20917 raft_consensus.cc:2243] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.894317 20917 raft_consensus.cc:2272] T be63fec868ca40ea8667c7fac2c3c613 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.922966 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.923916 20917 raft_consensus.cc:2243] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.924666 20917 raft_consensus.cc:2272] T 958b4fe6e86040349d99c54da8473245 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.928325 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.929239 20917 raft_consensus.cc:2243] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.930483 20917 raft_consensus.cc:2272] T eee116af186a4716920d4630b13d5b51 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.933770 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.934628 20917 raft_consensus.cc:2243] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.935266 20917 raft_consensus.cc:2272] T 5bf8f563ecd14874baedead593c9a98a P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.946837 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.947717 20917 raft_consensus.cc:2243] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.949081 20917 raft_consensus.cc:2272] T 1ca98a19b190437eafaa2f7cd74e53df P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.953083 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.953989 20917 raft_consensus.cc:2243] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.966706 20917 raft_consensus.cc:2272] T b6201f65047045ac9ae106afdade627d P baa04b33c4e846e49c1e22e5f9bfe644 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.970093 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.971033 20917 raft_consensus.cc:2243] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.971661 20917 raft_consensus.cc:2272] T 247d4b40ff7f4c7ca1055cb3856c254d P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.974992 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.975787 20917 raft_consensus.cc:2243] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:31.977070 20917 raft_consensus.cc:2272] T e346f965eb91472e99c529ad927e2636 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.992830 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:31.993798 20917 raft_consensus.cc:2243] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:31.994479 20917 raft_consensus.cc:2272] T 32ca6dc5d4574e99b2919d9261d9cb28 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:31.997802 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.011268 20917 raft_consensus.cc:2243] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:32.012140 20917 raft_consensus.cc:2272] T fb27c0ed64f74c578dbcd030e17d00a4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.015424 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.016261 20917 raft_consensus.cc:2243] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:32.017032 20917 raft_consensus.cc:2272] T d55bc7c762df41c8b7c71ed2384f9fcb P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.020539 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.021584 20917 raft_consensus.cc:2243] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:32.035578 20917 raft_consensus.cc:2272] T ede359b4a846419ca0057e565814c444 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.039374 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.040334 20917 raft_consensus.cc:2243] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:32.041114 20917 raft_consensus.cc:2272] T 102123f032ed4637895154c8d3cfe658 P baa04b33c4e846e49c1e22e5f9bfe644 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.047225 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.048261 20917 raft_consensus.cc:2243] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:32.048945 20917 raft_consensus.cc:2272] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.083514 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.085994 20917 raft_consensus.cc:2243] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:32.086787 20917 raft_consensus.cc:2272] T 5a5a23561d854cb098b5ecc2eec7f3b4 P baa04b33c4e846e49c1e22e5f9bfe644 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.121183 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.122159 20917 raft_consensus.cc:2243] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:32.123531 20917 raft_consensus.cc:2272] T fdb336eb1945459da39038940beae620 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.138594 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.148525 20917 raft_consensus.cc:2243] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:32.158797 20917 raft_consensus.cc:2272] T 98dacc178cef46228ca27e7e2085dd8a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.172479 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.180394 20917 raft_consensus.cc:2243] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:32.182803 20917 raft_consensus.cc:2272] T ea21ef264e8c4b2d982ec57324d121ff P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.186945 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.189839 20917 raft_consensus.cc:2243] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:32.190620 20917 raft_consensus.cc:2272] T 71d43124d4854915a84f60d5a8d16915 P baa04b33c4e846e49c1e22e5f9bfe644 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.199218 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:32.200078 20917 raft_consensus.cc:2243] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:32.200791 20917 raft_consensus.cc:2272] T 91df34303a124f3eb4e5103bd9254c6a P baa04b33c4e846e49c1e22e5f9bfe644 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:32.473038 28397 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.473744 28397 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.478395 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:32.476163 28397 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:32.482786 26625 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.485255 26625 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.486829 28397 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:32.515733 28397 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.516381 28397 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.518842 28397 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:32.522370 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
W20260709 12:29:32.528908 26625 leader_election.cc:336] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.529428 26625 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.529441 28399 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.530171 28399 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.530931 28397 raft_consensus.cc:2749] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:32.533231 28399 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:32.540216 26477 leader_election.cc:336] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.540253 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:32.541018 26656 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:32.542443 26476 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.543695 28399 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:32.544108 28399 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.545642 28399 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:32.579375 28403 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.580120 28403 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:32.583495 28403 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:32.583648 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:32.631349 28396 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.631990 28396 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:32.642143 26625 leader_election.cc:336] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.648260 28397 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.648869 28397 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:32.562281 28399 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.655105 28399 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:32.658303 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b867f2d6360645d4a8c7a56339b7ef56" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:32.659567 28397 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:32.659817 26660 raft_consensus.cc:3060] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:32.661388 28396 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:32.665285 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:32.665983 26582 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
W20260709 12:29:32.666220 26477 leader_election.cc:336] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.671355 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:32.674561 26625 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:32.675496 28405 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:32.675953 28405 raft_consensus.cc:493] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.676394 28405 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:32.687011 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.688072 28397 raft_consensus.cc:2749] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:29:32.692461 26625 leader_election.cc:336] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:32.693924 26551 leader_election.cc:336] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.694499 26551 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.696821 28403 raft_consensus.cc:2749] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:32.706414 28399 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.707175 28399 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.714953 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:32.720309 28399 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:32.729988 26660 raft_consensus.cc:2468] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 5.
I20260709 12:29:32.746459 26476 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.748199 28313 raft_consensus.cc:2804] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:32.748759 28313 raft_consensus.cc:697] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:32.749735 28397 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.750360 28397 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:32.749763 28313 consensus_queue.cc:237] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.752594 28397 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:32.756449 26477 leader_election.cc:336] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.757681 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
W20260709 12:29:32.762800 26625 leader_election.cc:336] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.763965 26625 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.765239 28422 raft_consensus.cc:2749] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:32.767127 26477 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.768959 28355 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.769522 28355 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.772572 28355 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:32.734124 28405 raft_consensus.cc:515] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:32.776553 28399 raft_consensus.cc:2749] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:32.778512 28399 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.779603 28405 leader_election.cc:290] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:32.780593 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:32.779660 28399 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.781332 26660 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
I20260709 12:29:32.782225 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486de29ef17f4eb9aa01601103eaf921" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:32.782866 26580 raft_consensus.cc:3060] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:32.785396 26476 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:32.787853 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:32.789005 26625 leader_election.cc:336] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.789624 28399 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:32.790282 28399 raft_consensus.cc:2804] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:32.790656 28399 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.791018 28399 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:32.794715 26580 raft_consensus.cc:2468] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
I20260709 12:29:32.796428 26625 leader_election.cc:304] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.797381 28405 raft_consensus.cc:2804] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:32.797930 28405 raft_consensus.cc:697] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:32.798856 28405 consensus_queue.cc:237] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:32.832508 26477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:38163, user_credentials={real_user=slave}} blocked reactor thread for 63900.5us
I20260709 12:29:32.839602 28405 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.840343 28405 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.846508 28405 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:32.847142 26625 leader_election.cc:336] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.856268 26335 catalog_manager.cc:5697] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 4 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 5 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:32.872634 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:32.873489 26510 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:32.874775 26625 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.875938 28405 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:32.876293 28405 raft_consensus.cc:493] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:32.876673 28405 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:32.886071 28405 raft_consensus.cc:515] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.901369 28405 leader_election.cc:290] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:32.881150 28399 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:32.903399 28399 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:32.905973 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eddc7ff9ef4017b178747494e76fc2" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:32.906622 26510 raft_consensus.cc:3060] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:32.916011 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b9151618004ebba90012bfc0c4c39b" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:32.916716 26660 raft_consensus.cc:3060] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:32.917075 26510 raft_consensus.cc:2468] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
W20260709 12:29:32.920053 26625 leader_election.cc:336] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.921020 26625 leader_election.cc:304] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.921815 28422 raft_consensus.cc:2804] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:32.922322 28422 raft_consensus.cc:697] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:32.923219 28422 consensus_queue.cc:237] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:32.925100 26477 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:32.925971 26477 leader_election.cc:336] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:32.926355 26477 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:32.927080 28399 raft_consensus.cc:2749] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:32.928016 26336 catalog_manager.cc:5697] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 4 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 5 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:32.937455 26660 raft_consensus.cc:2468] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:32.939023 26476 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:32.939873 28399 raft_consensus.cc:2804] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:32.940639 28399 raft_consensus.cc:697] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:32.944104 28399 consensus_queue.cc:237] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:32.949551 26477 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.019446 26336 catalog_manager.cc:5697] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:33.024801 26335 catalog_manager.cc:5697] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 4 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:33.046558 28403 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.047147 28403 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.051231 28403 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.052708 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:33.053442 26656 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:33.055352 26550 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.056263 28415 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:33.056651 28415 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.057003 28415 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:29:33.061211 26551 leader_election.cc:336] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.067456 28415 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.070780 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2a8cf91f76492d8418cba471ffe78e" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:33.071403 26660 raft_consensus.cc:3060] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:29:33.075132 26551 leader_election.cc:336] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.082718 26660 raft_consensus.cc:2468] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 5.
I20260709 12:29:33.082823 28415 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.089939 26550 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.091194 28415 raft_consensus.cc:2804] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:33.091756 28415 raft_consensus.cc:697] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:33.092641 28415 consensus_queue.cc:237] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.118434 28403 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.120587 28403 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.123482 28403 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.123708 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
W20260709 12:29:33.139436 26551 leader_election.cc:336] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.147639 26550 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.150131 28437 raft_consensus.cc:2749] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:33.153281 28402 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.155907 28402 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.158381 28402 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.158918 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:33.158833 28403 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.170841 28403 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.172549 28403 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.173324 28422 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.173892 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:33.174948 28399 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.175558 28399 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.177871 28399 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.178896 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:33.182209 26660 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 4.
I20260709 12:29:33.183459 26476 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:33.174010 28422 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.184648 28424 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:33.185045 28424 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.185413 28424 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:33.186424 28422 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.188562 26656 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:33.190469 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:33.191150 26580 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:33.192236 26625 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.192891 28422 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:33.193305 28422 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.193768 28422 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:33.193338 26477 leader_election.cc:336] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.198264 26625 leader_election.cc:336] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.199218 26551 leader_election.cc:336] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.199497 26477 consensus_peers.cc:597] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:33.199901 26551 leader_election.cc:336] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.200373 26551 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.200186 26335 catalog_manager.cc:5697] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 4 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 5 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:33.201637 28415 raft_consensus.cc:2749] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:33.202153 28422 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.205180 28399 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.205777 28399 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.207950 28399 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.204367 28422 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.205204 26550 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.210861 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:33.210156 28415 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:33.212913 28415 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.213485 28415 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:33.220175 28415 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:33.226840 26625 leader_election.cc:336] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.228025 26477 leader_election.cc:336] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.228796 26625 consensus_peers.cc:597] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:33.229106 28424 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.232555 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:33.233698 26580 raft_consensus.cc:2393] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 4: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:33.241238 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:33.242008 26660 raft_consensus.cc:2393] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 4: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
W20260709 12:29:33.245700 26477 leader_election.cc:336] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.246376 28424 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:33.247661 26551 leader_election.cc:336] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.236112 28415 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.248847 28422 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.249505 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6180fe8f3be6486d829a4b44cc3c7f9d" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:33.249691 26550 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.249466 28422 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.250270 26660 raft_consensus.cc:3060] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:33.250901 28415 raft_consensus.cc:2749] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:33.251823 28422 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.252256 26476 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.253829 28424 raft_consensus.cc:2749] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:33.253968 26625 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.255409 28405 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.255964 28405 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.257961 28405 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.258512 28405 raft_consensus.cc:2749] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:29:33.265157 28405 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.265841 28405 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.269531 28405 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:33.283601 26660 raft_consensus.cc:2468] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 5.
I20260709 12:29:33.284092 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:33.292662 28415 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.293351 28415 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.297411 28415 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.300609 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:33.301400 26582 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
W20260709 12:29:33.303692 26551 leader_election.cc:336] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.305051 28397 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.305722 28397 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.307266 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:33.308117 26513 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:33.308038 28397 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.312920 26476 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.314467 28399 raft_consensus.cc:2804] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:33.315850 28399 raft_consensus.cc:697] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:33.316854 28399 consensus_queue.cc:237] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.318794 28415 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.319465 28415 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:33.322427 28415 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:33.329980 28415 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.327641 28397 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.335518 28397 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.327375 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:33.337689 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:33.338506 26582 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:33.337807 28397 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:33.339566 28415 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.341857 28415 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:33.346240 26551 leader_election.cc:336] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.347050 26551 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.347690 28415 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:33.347839 26335 catalog_manager.cc:5697] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 4 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 5 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:33.349436 26656 raft_consensus.cc:1275] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:29:33.350863 26625 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
W20260709 12:29:33.353645 26551 leader_election.cc:336] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.354506 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:33.356245 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:33.356688 26656 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 4.
I20260709 12:29:33.356920 26660 raft_consensus.cc:2468] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 2.
I20260709 12:29:33.355834 26625 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.355867 28397 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:33.358116 28397 raft_consensus.cc:493] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.358316 28439 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:33.358565 28397 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:33.358851 28439 raft_consensus.cc:493] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.359237 28439 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:33.368254 28397 raft_consensus.cc:515] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.369416 26625 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.370659 28397 leader_election.cc:290] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:33.370890 28422 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:33.371492 28422 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.371893 28422 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:33.372174 26582 raft_consensus.cc:1275] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:33.372434 28397 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.372979 28397 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.368237 28439 raft_consensus.cc:515] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.375183 28397 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.375324 28439 leader_election.cc:290] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:33.376776 26625 leader_election.cc:336] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.377259 26625 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.377844 28439 raft_consensus.cc:2749] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:33.378053 26625 leader_election.cc:336] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.378986 26625 leader_election.cc:336] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.380627 28422 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.382957 28422 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.387066 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" is_pre_election: true
I20260709 12:29:33.387868 26513 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
W20260709 12:29:33.388253 26477 consensus_peers.cc:597] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:33.392120 20917 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27377)
I20260709 12:29:33.392695 26550 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.393162 28427 consensus_queue.cc:1048] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:33.393868 28415 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:33.394269 28415 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.394667 28415 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:33.403338 28415 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.405753 28415 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.408206 26550 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.410125 28403 raft_consensus.cc:2804] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:33.410552 28403 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.410948 28403 raft_consensus.cc:3060] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:33.417049 28438 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.417747 28438 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.421347 28438 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:33.427578 26551 leader_election.cc:336] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.427943 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32ec030f9c24f4591d2794595b4bd1c" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:33.428655 26513 raft_consensus.cc:3060] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:33.431648 26551 leader_election.cc:336] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.440955 26477 consensus_peers.cc:597] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.445497 26513 raft_consensus.cc:2468] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:33.448078 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:33.448917 26582 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
I20260709 12:29:33.449965 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb336eb1945459da39038940beae620" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:33.450663 26580 raft_consensus.cc:3060] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:33.460409 26580 raft_consensus.cc:2468] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:33.461751 28427 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.419978 28403 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.464097 26510 raft_consensus.cc:1275] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:33.464745 28403 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Requested vote from peers 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:33.466873 26625 leader_election.cc:336] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.468547 26625 leader_election.cc:336] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.467638 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:33.471508 26580 raft_consensus.cc:2393] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b371ddb5e924d6e8b56b476a69a27d0 in current term 5: Already voted for candidate 4ecb621c9f7f4c6698e141f131a14c4e in this term.
I20260709 12:29:33.473721 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:33.474537 26656 raft_consensus.cc:2393] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ecb621c9f7f4c6698e141f131a14c4e in current term 5: Already voted for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in this term.
I20260709 12:29:33.462466 28427 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:33.475943 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:33.479043 26625 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.477578 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee116af186a4716920d4630b13d5b51" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0"
I20260709 12:29:33.479871 26660 raft_consensus.cc:3060] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:33.481525 26625 leader_election.cc:304] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 
I20260709 12:29:33.482307 28439 raft_consensus.cc:2804] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:33.482954 28439 raft_consensus.cc:697] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:33.484023 28439 consensus_queue.cc:237] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.484987 28427 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:33.479887 28397 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:33.489621 28397 raft_consensus.cc:493] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.490037 28397 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:33.489888 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:33.490895 26580 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 2.
I20260709 12:29:33.493570 28422 consensus_queue.cc:1048] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:33.496007 28422 consensus_queue.cc:1048] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:33.500319 26625 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.501310 26625 leader_election.cc:304] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.501551 28422 raft_consensus.cc:2804] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:33.502025 28439 raft_consensus.cc:2804] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:33.502308 28422 raft_consensus.cc:493] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.502559 28439 raft_consensus.cc:697] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:33.502877 28422 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:33.503592 28439 consensus_queue.cc:237] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.515834 26550 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.524377 28403 raft_consensus.cc:2749] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:29:33.520725 28422 raft_consensus.cc:515] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.529277 26550 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 4b371ddb5e924d6e8b56b476a69a27d0, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.531500 28422 leader_election.cc:290] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.532646 28403 raft_consensus.cc:2749] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:33.515494 26477 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.543944 28446 raft_consensus.cc:2804] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:33.544468 28446 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.544845 28446 raft_consensus.cc:3060] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:33.553161 26660 raft_consensus.cc:2468] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ecb621c9f7f4c6698e141f131a14c4e in term 3.
I20260709 12:29:33.561118 28446 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
W20260709 12:29:33.574829 26551 leader_election.cc:336] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.575595 26551 consensus_peers.cc:597] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.561282 28397 raft_consensus.cc:515] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:33.580621 28397 leader_election.cc:290] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:33.581902 26477 leader_election.cc:336] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.584723 26625 leader_election.cc:336] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.585852 26625 leader_election.cc:336] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.586578 26625 leader_election.cc:336] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.587308 26625 leader_election.cc:336] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.587697 26625 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.589742 28439 raft_consensus.cc:2749] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:29:33.590852 26625 consensus_peers.cc:597] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.594353 26551 consensus_peers.cc:597] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:33.597009 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede359b4a846419ca0057e565814c444" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:33.597741 26580 raft_consensus.cc:3060] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:33.601392 26551 consensus_peers.cc:597] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.604786 26580 raft_consensus.cc:2468] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:33.610265 26550 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.611594 28403 raft_consensus.cc:2804] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:33.612123 28403 raft_consensus.cc:697] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Becoming Leader. State: Replica: 4ecb621c9f7f4c6698e141f131a14c4e, State: Running, Role: LEADER
I20260709 12:29:33.612401 28446 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Requested vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:33.613437 26477 consensus_peers.cc:597] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.612977 28403 consensus_queue.cc:237] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.617020 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca98a19b190437eafaa2f7cd74e53df" candidate_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:33.617609 26582 raft_consensus.cc:3060] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:33.620952 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1482f526e3e847889ab33113a4254db7" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea"
I20260709 12:29:33.621639 26510 raft_consensus.cc:3060] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:33.625737 28439 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.626387 28439 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.628594 28439 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.633278 26582 raft_consensus.cc:2468] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131fcd2f6a7a4ab39ad3dd26b08c92ea in term 3.
W20260709 12:29:33.626118 26477 leader_election.cc:336] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.635737 26477 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.636565 28446 raft_consensus.cc:2804] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:33.637068 28446 raft_consensus.cc:697] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Becoming Leader. State: Replica: 131fcd2f6a7a4ab39ad3dd26b08c92ea, State: Running, Role: LEADER
I20260709 12:29:33.637959 28446 consensus_queue.cc:237] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:33.643565 26653 raft_consensus.cc:1275] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:29:33.646982 26625 leader_election.cc:304] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.649266 28397 raft_consensus.cc:2804] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:33.649781 28397 raft_consensus.cc:697] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:33.650765 28397 consensus_queue.cc:237] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.659968 26653 raft_consensus.cc:1275] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:33.667460 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:33.668175 26580 raft_consensus.cc:2468] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 2.
I20260709 12:29:33.679564 26336 catalog_manager.cc:5697] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:33.680997 26477 consensus_peers.cc:597] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.681442 26336 catalog_manager.cc:5697] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:33.682291 28438 consensus_queue.cc:1048] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:33.684363 28446 consensus_queue.cc:1048] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:29:33.686841 26625 leader_election.cc:336] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.687633 26625 consensus_peers.cc:597] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:33.688052 26625 leader_election.cc:336] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.696728 26625 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:33.698388 28405 raft_consensus.cc:2804] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:33.698815 28405 raft_consensus.cc:493] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader baa04b33c4e846e49c1e22e5f9bfe644)
I20260709 12:29:33.699193 28405 raft_consensus.cc:3060] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:33.691140 26510 raft_consensus.cc:2468] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
W20260709 12:29:33.718884 26625 leader_election.cc:336] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:33.719808 26625 consensus_peers.cc:597] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.720240 26625 consensus_peers.cc:597] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.720615 26625 consensus_peers.cc:597] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.721019 26625 consensus_peers.cc:597] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.721858 26625 leader_election.cc:304] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.727262 28439 raft_consensus.cc:2804] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:33.727823 28439 raft_consensus.cc:697] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:33.728869 28439 consensus_queue.cc:237] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
W20260709 12:29:33.738809 26477 consensus_peers.cc:597] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.748646 26335 catalog_manager.cc:5697] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea reported cstate change: term changed from 2 to 3, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66). New cstate: current_term: 3 leader_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:33.761686 26625 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.775378 26336 catalog_manager.cc:5697] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 3 to 4, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 4 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:33.786453 28405 raft_consensus.cc:515] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.788738 28405 leader_election.cc:290] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:33.791020 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dacc178cef46228ca27e7e2085dd8a" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:33.791706 26582 raft_consensus.cc:3060] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:33.792375 26477 consensus_peers.cc:597] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.797077 26551 consensus_peers.cc:597] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.800720 26477 consensus_peers.cc:597] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.801783 26625 leader_election.cc:336] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:33.802320 26582 raft_consensus.cc:2468] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 3.
W20260709 12:29:33.802577 26551 consensus_peers.cc:597] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.803151 26551 consensus_peers.cc:597] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.803534 26551 consensus_peers.cc:597] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.809054 26336 catalog_manager.cc:5697] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 4 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 5 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:33.806635 26625 leader_election.cc:304] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:33.813413 28405 raft_consensus.cc:2804] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:33.813962 28405 raft_consensus.cc:697] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:33.814821 28405 consensus_queue.cc:237] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:33.835014 26336 catalog_manager.cc:5697] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e reported cstate change: term changed from 2 to 3, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67). New cstate: current_term: 3 leader_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:33.839893 26551 consensus_peers.cc:597] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:33.880738 26335 catalog_manager.cc:5697] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 2 to 3, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 3 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:33.885031 26653 raft_consensus.cc:1275] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:33.889251 28427 consensus_queue.cc:1048] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:29:33.898420 26551 consensus_peers.cc:597] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.905340 26477 consensus_peers.cc:597] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.929219 26625 consensus_peers.cc:597] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:33.939353 26477 consensus_peers.cc:597] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:33.960117 26477 consensus_peers.cc:597] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:34.012224 26582 raft_consensus.cc:1275] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:34.019785 28405 consensus_queue.cc:1048] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:29:34.023205 26551 consensus_peers.cc:597] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:34.040164 26477 consensus_peers.cc:597] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:34.040746 26625 consensus_peers.cc:597] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:34.046530 26477 consensus_peers.cc:597] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:34.058116 26625 consensus_peers.cc:597] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.064504 26582 raft_consensus.cc:1275] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:34.067068 26585 raft_consensus.cc:1275] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 131fcd2f6a7a4ab39ad3dd26b08c92ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:34.067593 28397 consensus_queue.cc:1048] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:34.069092 28427 consensus_queue.cc:1048] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:29:34.077437 26551 consensus_peers.cc:597] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:34.096134 26510 raft_consensus.cc:1275] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:29:34.098721 26477 consensus_peers.cc:597] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:34.101541 28397 consensus_queue.cc:1048] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:29:34.135277 26625 consensus_peers.cc:597] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.139389 26653 raft_consensus.cc:1275] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Refusing update from remote peer 4ecb621c9f7f4c6698e141f131a14c4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:34.157740 28403 consensus_queue.cc:1048] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:29:34.175239 26625 consensus_peers.cc:597] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:34.199285 26513 raft_consensus.cc:1275] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:29:34.200742 26625 consensus_peers.cc:597] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:34.201741 26477 consensus_peers.cc:597] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.202286 28405 consensus_queue.cc:1048] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:29:34.255039 26551 consensus_peers.cc:597] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:34.276701 26625 consensus_peers.cc:597] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:34.383363 26625 consensus_peers.cc:597] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:34.392596 20917 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 27377)
I20260709 12:29:34.429996 26582 raft_consensus.cc:1275] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:34.432211 28443 consensus_queue.cc:1048] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:35.041981 28465 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.042546 28465 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:35.045118 28465 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:35.048682 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:35.049408 26582 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 4.
I20260709 12:29:35.054787 26625 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:35.075587 28443 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:35.076018 28443 raft_consensus.cc:493] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:35.076342 28443 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:35.088318 28443 raft_consensus.cc:515] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:35.090359 28443 leader_election.cc:290] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:35.111672 26625 leader_election.cc:336] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:35.118155 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aefe5d0dc7846ca9db57012baae4777" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
I20260709 12:29:35.118871 26582 raft_consensus.cc:3060] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:35.126343 26582 raft_consensus.cc:2468] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
I20260709 12:29:35.147985 26625 leader_election.cc:304] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:35.148936 28397 raft_consensus.cc:2804] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:35.149379 28397 raft_consensus.cc:697] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:35.150307 28397 consensus_queue.cc:237] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
W20260709 12:29:35.163095 26625 leader_election.cc:336] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:35.211673 26336 catalog_manager.cc:5697] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 3 to 5, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 5 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:35.393160 20917 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 27377)
I20260709 12:29:35.432641 28397 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.433480 28397 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:35.435963 28397 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:35.437857 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" is_pre_election: true
I20260709 12:29:35.438585 26582 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 5.
I20260709 12:29:35.440661 26625 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 
I20260709 12:29:35.441438 28397 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:29:35.441802 28397 raft_consensus.cc:493] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:35.442081 28397 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:29:35.444151 26625 leader_election.cc:336] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:35.449739 28397 raft_consensus.cc:515] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:35.455499 28397 leader_election.cc:290] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 election: Requested vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:35.458096 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e346f965eb91472e99c529ad927e2636" candidate_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4ecb621c9f7f4c6698e141f131a14c4e"
W20260709 12:29:35.461735 26625 leader_election.cc:336] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:35.462987 26582 raft_consensus.cc:3060] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:35.472985 26582 raft_consensus.cc:2468] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b371ddb5e924d6e8b56b476a69a27d0 in term 6.
I20260709 12:29:35.475030 26625 leader_election.cc:304] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0, 4ecb621c9f7f4c6698e141f131a14c4e; no voters: baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:35.475962 28397 raft_consensus.cc:2804] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:35.476557 28397 raft_consensus.cc:697] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 LEADER]: Becoming Leader. State: Replica: 4b371ddb5e924d6e8b56b476a69a27d0, State: Running, Role: LEADER
I20260709 12:29:35.478045 28397 consensus_queue.cc:237] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:35.501614 26336 catalog_manager.cc:5697] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 reported cstate change: term changed from 4 to 6, leader changed from baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65) to 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68). New cstate: current_term: 6 leader_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:35.551774 26625 consensus_peers.cc:597] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:35.603281 26582 raft_consensus.cc:1275] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:29:35.606499 28397 consensus_queue.cc:1048] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:29:35.686272 26477 consensus_peers.cc:597] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:35.713615 26477 consensus_peers.cc:597] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:35.733356 26625 consensus_peers.cc:597] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:35.751075 26551 consensus_peers.cc:597] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:35.771862 26625 consensus_peers.cc:597] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:35.780401 26551 consensus_peers.cc:597] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:35.781111 26551 consensus_peers.cc:597] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:35.888607 26477 consensus_peers.cc:597] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:35.955539 26582 raft_consensus.cc:1275] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Refusing update from remote peer 4b371ddb5e924d6e8b56b476a69a27d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:29:35.957433 28422 consensus_queue.cc:1048] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:29:35.997049 26477 consensus_peers.cc:597] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.002194 26625 consensus_peers.cc:597] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:36.026358 26551 consensus_peers.cc:597] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.047999 26551 consensus_peers.cc:597] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.075825 26625 consensus_peers.cc:597] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.092031 26477 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111) [suppressed 419 similar messages]
W20260709 12:29:36.120811 26551 consensus_peers.cc:597] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.138280 26477 consensus_peers.cc:597] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.160799 26477 consensus_peers.cc:597] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.173106 26551 consensus_peers.cc:597] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.222743 26625 consensus_peers.cc:597] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.232147 26551 consensus_peers.cc:597] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.235683 26477 consensus_peers.cc:597] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.266659 26477 consensus_peers.cc:597] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.267601 26625 consensus_peers.cc:597] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:36.268424 26551 consensus_peers.cc:597] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.293111 26477 consensus_peers.cc:597] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:36.296305 26625 consensus_peers.cc:597] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.309945 26625 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.393718 20917 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 27377)
W20260709 12:29:36.407845 26625 consensus_peers.cc:597] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.444660 26625 consensus_peers.cc:597] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.457345 26477 consensus_peers.cc:597] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.464774 26477 consensus_peers.cc:597] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.473641 26477 consensus_peers.cc:597] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.481362 26477 consensus_peers.cc:597] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.503909 26551 consensus_peers.cc:597] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.509557 26551 consensus_peers.cc:597] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.591820 26625 consensus_peers.cc:597] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:36.603133 26625 consensus_peers.cc:597] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:36.696466 26625 consensus_peers.cc:597] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.707185 26625 consensus_peers.cc:597] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:36.713138 26625 consensus_peers.cc:597] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:36.782697 26551 consensus_peers.cc:597] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:36.820021 26625 consensus_peers.cc:597] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:36.852253 26625 consensus_peers.cc:597] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:36.950263 26477 consensus_peers.cc:597] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:37.019062 20917 tablet_server.cc:196] TabletServer@127.20.109.65:39541 shutdown complete.
W20260709 12:29:37.034762 26477 consensus_peers.cc:597] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:37.357251 20917 tablet_server.cc:179] TabletServer@127.20.109.66:0 shutting down...
W20260709 12:29:37.382879 26625 consensus_peers.cc:597] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.397120 26551 consensus_peers.cc:597] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.404811 26625 consensus_peers.cc:597] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.435431 26625 consensus_peers.cc:597] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.474259 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:29:37.474761 26625 consensus_peers.cc:597] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.475742 20917 tablet_replica.cc:333] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.476878 20917 raft_consensus.cc:2243] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.477538 20917 raft_consensus.cc:2272] T ddef97e10ce649ae82d02133a094f7ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.480706 20917 tablet_replica.cc:333] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.481643 20917 raft_consensus.cc:2243] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:29:37.486678 26625 consensus_peers.cc:597] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.486712 20917 raft_consensus.cc:2272] T b867f2d6360645d4a8c7a56339b7ef56 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.491165 20917 tablet_replica.cc:333] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.492957 20917 raft_consensus.cc:2243] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.493651 20917 raft_consensus.cc:2272] T 91df34303a124f3eb4e5103bd9254c6a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.497980 20917 tablet_replica.cc:333] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.499092 20917 raft_consensus.cc:2243] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.500190 20917 raft_consensus.cc:2272] T 71d43124d4854915a84f60d5a8d16915 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.503665 20917 tablet_replica.cc:333] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.504842 20917 raft_consensus.cc:2243] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.505440 20917 raft_consensus.cc:2272] T 1482f526e3e847889ab33113a4254db7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.515090 20917 tablet_replica.cc:333] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.515992 20917 raft_consensus.cc:2243] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.516743 20917 raft_consensus.cc:2272] T ea21ef264e8c4b2d982ec57324d121ff P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.525691 20917 tablet_replica.cc:333] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.526564 20917 raft_consensus.cc:2243] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.527598 20917 raft_consensus.cc:2272] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.528581 26625 consensus_peers.cc:597] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.530673 20917 tablet_replica.cc:333] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.531716 20917 raft_consensus.cc:2243] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.532418 20917 raft_consensus.cc:2272] T caf253f7acbf409180c569cd29f50cee P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.533622 26551 consensus_peers.cc:597] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.535490 20917 tablet_replica.cc:333] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.536423 20917 raft_consensus.cc:2243] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.537070 20917 raft_consensus.cc:2272] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.540123 20917 tablet_replica.cc:333] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.540980 20917 raft_consensus.cc:2243] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.541555 20917 raft_consensus.cc:2272] T a0eddc7ff9ef4017b178747494e76fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.544145 20917 tablet_replica.cc:333] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.544986 20917 raft_consensus.cc:2243] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.545552 20917 raft_consensus.cc:2272] T f373d8db1e3349c48d8c4dfcdada9e41 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.548403 20917 tablet_replica.cc:333] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.549901 20917 raft_consensus.cc:2243] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.550392 20917 raft_consensus.cc:2272] T 734b294b669c4944aaabdb8977f85fc2 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.553229 20917 tablet_replica.cc:333] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.554000 20917 raft_consensus.cc:2243] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.554648 20917 raft_consensus.cc:2272] T 247d4b40ff7f4c7ca1055cb3856c254d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.560065 26551 consensus_peers.cc:597] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.560738 20917 tablet_replica.cc:333] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.561666 20917 raft_consensus.cc:2243] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.562274 20917 raft_consensus.cc:2272] T b6201f65047045ac9ae106afdade627d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.565260 20917 tablet_replica.cc:333] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.566103 20917 raft_consensus.cc:2243] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.567212 20917 raft_consensus.cc:2272] T 36b9151618004ebba90012bfc0c4c39b P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.570202 20917 tablet_replica.cc:333] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.571092 20917 raft_consensus.cc:2243] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.571935 20917 raft_consensus.cc:2272] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.575556 20917 tablet_replica.cc:333] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.576392 20917 raft_consensus.cc:2243] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.577448 20917 raft_consensus.cc:2272] T 62cf18772950487998aeb7a43530703f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.580448 20917 tablet_replica.cc:333] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.581349 20917 raft_consensus.cc:2243] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.581930 20917 raft_consensus.cc:2272] T 22f24da90c1944079124e5b4c1ba4733 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.584813 20917 tablet_replica.cc:333] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.585649 20917 raft_consensus.cc:2243] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.586248 20917 raft_consensus.cc:2272] T 57aa38006440444a86a6ec5138a99183 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.586426 26551 consensus_peers.cc:597] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.589231 20917 tablet_replica.cc:333] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.590365 20917 raft_consensus.cc:2243] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.591457 20917 raft_consensus.cc:2272] T 828700bf20fa4c988e072c6d158102fc P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.594308 20917 tablet_replica.cc:333] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.595253 20917 raft_consensus.cc:2243] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.595868 20917 raft_consensus.cc:2272] T 2f18e20a50264529b43abc6da23a41db P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.598652 20917 tablet_replica.cc:333] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.599478 20917 raft_consensus.cc:2243] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.600041 20917 raft_consensus.cc:2272] T d55bc7c762df41c8b7c71ed2384f9fcb P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.602952 20917 tablet_replica.cc:333] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.603724 20917 raft_consensus.cc:2243] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.604847 20917 raft_consensus.cc:2272] T fb27c0ed64f74c578dbcd030e17d00a4 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.608589 20917 tablet_replica.cc:333] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.609817 20917 raft_consensus.cc:2243] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.610397 20917 raft_consensus.cc:2272] T 32ca6dc5d4574e99b2919d9261d9cb28 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.613214 20917 tablet_replica.cc:333] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.614002 20917 raft_consensus.cc:2243] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.615091 20917 raft_consensus.cc:2272] T fec4b7b54d6547299b2a1a4c618afcde P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.617794 20917 tablet_replica.cc:333] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.618553 20917 raft_consensus.cc:2243] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.619729 20917 raft_consensus.cc:2272] T eac3baa350f54fe492420693918644a7 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.623580 20917 tablet_replica.cc:333] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.624363 20917 raft_consensus.cc:2243] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:29:37.624434 26625 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.625458 20917 raft_consensus.cc:2272] T d97898f8f78e456084abffdb741c2b01 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.628259 20917 tablet_replica.cc:333] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.629042 20917 raft_consensus.cc:2243] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.630051 20917 raft_consensus.cc:2272] T 325ddf3240694c36a217b486f7f82472 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.632790 20917 tablet_replica.cc:333] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.633524 20917 raft_consensus.cc:2243] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.634065 20917 raft_consensus.cc:2272] T d32ec030f9c24f4591d2794595b4bd1c P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.636802 20917 tablet_replica.cc:333] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.637598 20917 raft_consensus.cc:2243] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.638677 20917 raft_consensus.cc:2272] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.641381 20917 tablet_replica.cc:333] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.642144 20917 raft_consensus.cc:2243] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.644120 20917 raft_consensus.cc:2272] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.647136 20917 tablet_replica.cc:333] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
W20260709 12:29:37.647472 26625 consensus_peers.cc:597] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.649170 20917 raft_consensus.cc:2243] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.652801 20917 raft_consensus.cc:2272] T afa1d77d71ae4c8993d446d81e4c1e5f P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.653272 26551 consensus_peers.cc:597] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.656939 20917 tablet_replica.cc:333] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.659814 20917 raft_consensus.cc:2243] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.660600 20917 raft_consensus.cc:2272] T a00d7cbf01954fb19c18146550c0ca07 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.669739 26625 consensus_peers.cc:597] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.670447 26625 consensus_peers.cc:597] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.671242 20917 tablet_replica.cc:333] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.671926 20917 raft_consensus.cc:2243] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.672971 20917 raft_consensus.cc:2272] T be63fec868ca40ea8667c7fac2c3c613 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.678678 20917 tablet_replica.cc:333] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.679536 20917 raft_consensus.cc:2243] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.683543 20917 raft_consensus.cc:2272] T 90f36d35c0b94881b6f8db11a1caa351 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.680413 26551 consensus_peers.cc:597] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.687474 20917 tablet_replica.cc:333] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.693130 20917 raft_consensus.cc:2243] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.695226 20917 raft_consensus.cc:2272] T 5bf8f563ecd14874baedead593c9a98a P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.692085 26625 consensus_peers.cc:597] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.702611 26551 consensus_peers.cc:597] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.703279 26551 consensus_peers.cc:597] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.705627 20917 tablet_replica.cc:333] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.707805 20917 raft_consensus.cc:2243] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.714725 20917 raft_consensus.cc:2272] T 1ca98a19b190437eafaa2f7cd74e53df P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.719367 26625 consensus_peers.cc:597] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.721139 20917 tablet_replica.cc:333] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.722182 20917 raft_consensus.cc:2243] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:29:37.723238 28427 consensus_queue.cc:1175] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260709 12:29:37.724395 20917 raft_consensus.cc:2272] T 98f2bb8815884926800b1e9c023f2897 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.730499 20917 tablet_replica.cc:333] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.731423 20917 raft_consensus.cc:2243] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.732129 20917 raft_consensus.cc:2272] T 488122ee22144275b3f537809a55060d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.735229 20917 tablet_replica.cc:333] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.736027 20917 raft_consensus.cc:2243] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.736625 20917 raft_consensus.cc:2272] T b75ba30f9857421393dc3f00cdf47f21 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.742897 20917 tablet_replica.cc:333] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.743793 20917 raft_consensus.cc:2243] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.745950 20917 raft_consensus.cc:2272] T 579a9b2cdca24a6a95444e424f03a551 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.749409 20917 tablet_replica.cc:333] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.750923 20917 raft_consensus.cc:2243] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:29:37.751647 26551 consensus_peers.cc:597] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.752215 20917 raft_consensus.cc:2272] T 6180fe8f3be6486d829a4b44cc3c7f9d P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.755223 20917 tablet_replica.cc:333] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.756009 20917 raft_consensus.cc:2243] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.756652 20917 raft_consensus.cc:2272] T cc8bb74cfe63435e983f2e9258c229ba P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.760522 20917 tablet_replica.cc:333] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea: stopping tablet replica
I20260709 12:29:37.761261 20917 raft_consensus.cc:2243] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.761914 20917 raft_consensus.cc:2272] T a2acc4a4b3b54b9381d3203a4023ba71 P 131fcd2f6a7a4ab39ad3dd26b08c92ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:37.836771 26551 consensus_peers.cc:597] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.877363 26625 consensus_peers.cc:597] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.884480 26625 consensus_peers.cc:597] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.891343 26551 consensus_peers.cc:597] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:37.983525 26551 connection.cc:573] client connection to 127.20.109.66:34053 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:29:37.998229 20917 tablet_server.cc:196] TabletServer@127.20.109.66:0 shutdown complete.
W20260709 12:29:38.059154 26625 consensus_peers.cc:597] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:38.154333 26551 consensus_peers.cc:597] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:38.198613 26625 consensus_peers.cc:597] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:38.198938 26551 consensus_peers.cc:597] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:38.250077 26551 consensus_peers.cc:597] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:38.291160 26625 consensus_peers.cc:597] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:38.291899 26551 consensus_peers.cc:597] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:38.368320 20917 tablet_server.cc:179] TabletServer@127.20.109.67:0 shutting down...
W20260709 12:29:38.381136 26551 consensus_peers.cc:597] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:38.406984 26625 consensus_peers.cc:597] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.408103 26625 consensus_peers.cc:597] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.428421 26625 consensus_peers.cc:597] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:38.463151 26625 consensus_peers.cc:597] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:38.520622 26625 consensus_peers.cc:597] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.521258 26625 consensus_peers.cc:597] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.540915 26625 consensus_peers.cc:597] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.559588 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:38.564507 20917 tablet_replica.cc:333] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.566928 20917 raft_consensus.cc:2243] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:29:38.567206 26625 consensus_peers.cc:597] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.568146 26625 consensus_peers.cc:597] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.568859 20917 raft_consensus.cc:2272] T ddef97e10ce649ae82d02133a094f7ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.572134 20917 tablet_replica.cc:333] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.573527 20917 raft_consensus.cc:2243] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.575762 20917 raft_consensus.cc:2272] T e346f965eb91472e99c529ad927e2636 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.579203 20917 tablet_replica.cc:333] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.584564 20917 raft_consensus.cc:2243] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.597800 20917 raft_consensus.cc:2272] T 71584399dd7f43d8950539126b066e37 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.605329 26625 consensus_peers.cc:597] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.600821 20917 tablet_replica.cc:333] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.614889 20917 raft_consensus.cc:2243] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.615983 20917 raft_consensus.cc:2272] T 91df34303a124f3eb4e5103bd9254c6a P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.621927 20917 tablet_replica.cc:333] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.626986 20917 raft_consensus.cc:2243] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:38.631100 26625 consensus_peers.cc:597] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.632042 20917 raft_consensus.cc:2272] T 71d43124d4854915a84f60d5a8d16915 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.635069 20917 tablet_replica.cc:333] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.635931 20917 raft_consensus.cc:2243] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.636626 20917 raft_consensus.cc:2272] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.646322 20917 tablet_replica.cc:333] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.647334 20917 raft_consensus.cc:2243] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.648167 20917 raft_consensus.cc:2272] T 958b4fe6e86040349d99c54da8473245 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.649477 28397 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.650075 28397 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:38.651057 20917 tablet_replica.cc:333] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.651930 20917 raft_consensus.cc:2243] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.652025 28397 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:38.653148 20917 raft_consensus.cc:2272] T ea21ef264e8c4b2d982ec57324d121ff P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.657414 20917 tablet_replica.cc:333] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
W20260709 12:29:38.657958 26625 leader_election.cc:336] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.658236 20917 raft_consensus.cc:2243] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:38.658785 26625 leader_election.cc:336] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:29:38.658895 20917 raft_consensus.cc:2272] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.659179 26625 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:38.659893 28397 raft_consensus.cc:2749] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:38.661810 20917 tablet_replica.cc:333] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.662765 20917 raft_consensus.cc:2243] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.663376 20917 raft_consensus.cc:2272] T 55ed770173234cb8984ad0a8be82a8d1 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.667315 20917 tablet_replica.cc:333] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.668159 20917 raft_consensus.cc:2243] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.668888 20917 raft_consensus.cc:2272] T d97898f8f78e456084abffdb741c2b01 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.669431 28397 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
W20260709 12:29:38.669912 26625 consensus_peers.cc:597] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.669965 28397 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:38.669998 28437 raft_consensus.cc:493] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.670971 28437 raft_consensus.cc:515] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:38.672232 28397 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:38.672837 28437 leader_election.cc:290] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:38.681857 26551 leader_election.cc:336] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:38.682498 26551 leader_election.cc:336] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.682914 26551 leader_election.cc:304] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:38.685346 28437 raft_consensus.cc:2749] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:38.686882 26625 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:38.687282 20917 tablet_replica.cc:333] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
W20260709 12:29:38.687628 26625 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.688099 26625 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:38.688215 20917 raft_consensus.cc:2243] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.688970 20917 raft_consensus.cc:2272] T 325ddf3240694c36a217b486f7f82472 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.690761 28397 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:38.692993 28437 raft_consensus.cc:493] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.693509 20917 tablet_replica.cc:333] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.693565 28437 raft_consensus.cc:515] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:38.694672 20917 raft_consensus.cc:2243] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.695269 20917 raft_consensus.cc:2272] T 734b294b669c4944aaabdb8977f85fc2 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.696056 26625 consensus_peers.cc:597] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.696457 28437 leader_election.cc:290] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:38.704979 26551 leader_election.cc:336] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:38.706245 26625 consensus_peers.cc:597] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.707841 26551 leader_election.cc:336] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.708472 26551 leader_election.cc:304] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:38.709743 28437 raft_consensus.cc:2749] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:38.713891 28485 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.714463 28485 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:38.716038 20917 tablet_replica.cc:333] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.716614 28485 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4b371ddb5e924d6e8b56b476a69a27d0 (127.20.109.68:41855)
W20260709 12:29:38.712944 26625 consensus_peers.cc:597] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:38.718446 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f2bb8815884926800b1e9c023f2897" candidate_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" is_pre_election: true
I20260709 12:29:38.716930 20917 raft_consensus.cc:2243] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.725099 20917 raft_consensus.cc:2272] T 57aa38006440444a86a6ec5138a99183 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.728858 26551 leader_election.cc:336] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.731254 20917 tablet_replica.cc:333] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.732470 26550 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4b371ddb5e924d6e8b56b476a69a27d0
I20260709 12:29:38.733008 20917 raft_consensus.cc:2243] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.733623 28485 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:38.733743 20917 raft_consensus.cc:2272] T 828700bf20fa4c988e072c6d158102fc P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.735801 26625 consensus_peers.cc:597] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.736763 26625 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:38.737304 26625 consensus_peers.cc:597] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:38.736805 20917 tablet_replica.cc:333] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.746969 28485 raft_consensus.cc:493] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.747413 20917 raft_consensus.cc:2243] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.747591 28485 raft_consensus.cc:515] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:38.749691 28485 leader_election.cc:290] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
I20260709 12:29:38.754004 20917 raft_consensus.cc:2272] T 22fcb1f4dc2c4377a60316fa1c70a8b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.758822 20917 tablet_replica.cc:333] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
W20260709 12:29:38.759656 26551 leader_election.cc:336] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:38.760921 26551 leader_election.cc:336] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:38.761373 26551 leader_election.cc:304] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:38.763092 28485 raft_consensus.cc:2749] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:29:38.764884 26625 consensus_peers.cc:597] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.765239 28485 raft_consensus.cc:493] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.765791 28485 raft_consensus.cc:515] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } }
I20260709 12:29:38.767925 28485 leader_election.cc:290] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:38.759686 20917 raft_consensus.cc:2243] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.771446 20917 raft_consensus.cc:2272] T 62cf18772950487998aeb7a43530703f P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.773206 26551 consensus_peers.cc:597] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:38.775357 20917 tablet_replica.cc:333] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.776343 20917 raft_consensus.cc:2243] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.778012 20917 raft_consensus.cc:2272] T 22f24da90c1944079124e5b4c1ba4733 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.778172 26551 leader_election.cc:336] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:38.779021 26551 leader_election.cc:336] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.779443 26551 leader_election.cc:304] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ecb621c9f7f4c6698e141f131a14c4e; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:38.780215 28485 raft_consensus.cc:2749] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:29:38.781086 20917 tablet_replica.cc:333] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.781994 20917 raft_consensus.cc:2243] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.782646 20917 raft_consensus.cc:2272] T fec4b7b54d6547299b2a1a4c618afcde P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.784045 28465 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.784682 28465 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:38.785723 20917 tablet_replica.cc:333] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.786689 20917 raft_consensus.cc:2243] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.786927 28465 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:38.787267 20917 raft_consensus.cc:2272] T eac3baa350f54fe492420693918644a7 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.791878 20917 tablet_replica.cc:333] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
W20260709 12:29:38.792343 26625 leader_election.cc:336] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.792758 20917 raft_consensus.cc:2243] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 LEADER]: Raft consensus shutting down.
W20260709 12:29:38.793228 26625 leader_election.cc:336] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:29:38.793681 26625 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:38.794010 20917 raft_consensus.cc:2272] T 2f18e20a50264529b43abc6da23a41db P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.794409 28465 raft_consensus.cc:2749] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:38.797042 20917 tablet_replica.cc:333] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.797950 20917 raft_consensus.cc:2243] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.798611 20917 raft_consensus.cc:2272] T fb27c0ed64f74c578dbcd030e17d00a4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.800426 28465 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.801031 28465 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:38.802073 20917 tablet_replica.cc:333] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.803089 20917 raft_consensus.cc:2243] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.803293 28465 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:38.804212 20917 raft_consensus.cc:2272] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.808741 26625 leader_election.cc:336] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:38.809728 26625 leader_election.cc:336] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:38.810137 26625 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:38.810895 28465 raft_consensus.cc:2749] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:38.811204 20917 tablet_replica.cc:333] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.812237 20917 raft_consensus.cc:2243] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.812903 20917 raft_consensus.cc:2272] T 50ca2070ba0446fd83db9a1ac2b7f3b8 P 4ecb621c9f7f4c6698e141f131a14c4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.816947 20917 tablet_replica.cc:333] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.817791 20917 raft_consensus.cc:2243] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.818396 20917 raft_consensus.cc:2272] T 98dacc178cef46228ca27e7e2085dd8a P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.821475 20917 tablet_replica.cc:333] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.822304 20917 raft_consensus.cc:2243] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.822954 20917 raft_consensus.cc:2272] T fdb336eb1945459da39038940beae620 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.825860 20917 tablet_replica.cc:333] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.834290 20917 raft_consensus.cc:2243] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.835290 20917 raft_consensus.cc:2272] T 579a9b2cdca24a6a95444e424f03a551 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.838750 26625 consensus_peers.cc:597] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:38.844300 20917 tablet_replica.cc:333] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.845497 20917 raft_consensus.cc:2243] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.846684 20917 raft_consensus.cc:2272] T cc8bb74cfe63435e983f2e9258c229ba P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.849895 20917 tablet_replica.cc:333] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.851518 20917 raft_consensus.cc:2243] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.852130 20917 raft_consensus.cc:2272] T 6aefe5d0dc7846ca9db57012baae4777 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.855168 20917 tablet_replica.cc:333] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.855988 20917 raft_consensus.cc:2243] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.856654 20917 raft_consensus.cc:2272] T 1a863d2269ed4c85b7844c44d071ef2f P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.860248 20917 tablet_replica.cc:333] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.861078 20917 raft_consensus.cc:2243] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.862349 20917 raft_consensus.cc:2272] T 488122ee22144275b3f537809a55060d P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.865468 20917 tablet_replica.cc:333] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.868219 20917 raft_consensus.cc:2243] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:29:38.868351 26625 consensus_peers.cc:597] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:38.869462 20917 raft_consensus.cc:2272] T eee116af186a4716920d4630b13d5b51 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.872476 20917 tablet_replica.cc:333] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.873311 20917 raft_consensus.cc:2243] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.873948 20917 raft_consensus.cc:2272] T 1ca98a19b190437eafaa2f7cd74e53df P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.877729 20917 tablet_replica.cc:333] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.879613 20917 raft_consensus.cc:2243] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.880240 20917 raft_consensus.cc:2272] T 98f2bb8815884926800b1e9c023f2897 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.880643 26625 consensus_peers.cc:597] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:38.881529 26625 consensus_peers.cc:597] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.883116 20917 tablet_replica.cc:333] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.884037 20917 raft_consensus.cc:2243] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.885217 20917 raft_consensus.cc:2272] T a00d7cbf01954fb19c18146550c0ca07 P 4ecb621c9f7f4c6698e141f131a14c4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.888482 20917 tablet_replica.cc:333] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.889257 20917 raft_consensus.cc:2243] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.890502 20917 raft_consensus.cc:2272] T b75ba30f9857421393dc3f00cdf47f21 P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.894693 26625 consensus_peers.cc:597] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.895727 20917 tablet_replica.cc:333] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.896587 20917 raft_consensus.cc:2243] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.897213 20917 raft_consensus.cc:2272] T f373d8db1e3349c48d8c4dfcdada9e41 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.897415 26625 consensus_peers.cc:597] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:38.900214 20917 tablet_replica.cc:333] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.901106 20917 raft_consensus.cc:2243] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.902235 20917 raft_consensus.cc:2272] T 102123f032ed4637895154c8d3cfe658 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.905507 20917 tablet_replica.cc:333] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.906279 20917 raft_consensus.cc:2243] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.906952 20917 raft_consensus.cc:2272] T ede359b4a846419ca0057e565814c444 P 4ecb621c9f7f4c6698e141f131a14c4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.909614 20917 tablet_replica.cc:333] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.910444 20917 raft_consensus.cc:2243] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.911099 20917 raft_consensus.cc:2272] T 486de29ef17f4eb9aa01601103eaf921 P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.914393 20917 tablet_replica.cc:333] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.915186 20917 raft_consensus.cc:2243] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.915815 20917 raft_consensus.cc:2272] T a2acc4a4b3b54b9381d3203a4023ba71 P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.918706 20917 tablet_replica.cc:333] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.919430 20917 raft_consensus.cc:2243] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.920251 20917 raft_consensus.cc:2272] T caf253f7acbf409180c569cd29f50cee P 4ecb621c9f7f4c6698e141f131a14c4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.924654 20917 tablet_replica.cc:333] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.925383 20917 raft_consensus.cc:2243] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.926239 28465 raft_consensus.cc:493] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.926504 20917 raft_consensus.cc:2272] T 6a2a8cf91f76492d8418cba471ffe78e P 4ecb621c9f7f4c6698e141f131a14c4e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.926924 28465 raft_consensus.cc:515] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:38.929212 28465 leader_election.cc:290] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:38.929631 20917 tablet_replica.cc:333] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e: stopping tablet replica
I20260709 12:29:38.930390 20917 raft_consensus.cc:2243] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.930994 20917 raft_consensus.cc:2272] T 0a2846cdd8904c908b6cb1a8f6e42aaf P 4ecb621c9f7f4c6698e141f131a14c4e [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.934396 26625 leader_election.cc:336] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:38.935271 26625 leader_election.cc:336] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.935664 26625 leader_election.cc:304] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:38.936335 28465 raft_consensus.cc:2749] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:29:38.951030 28465 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.951622 28465 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:38.953866 28465 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:38.959631 26625 leader_election.cc:336] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:38.960278 26625 leader_election.cc:336] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:38.960685 26625 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:38.961403 28465 raft_consensus.cc:2749] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:38.985996 26625 consensus_peers.cc:597] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:38.991168 28465 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:38.991729 28465 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:38.994025 28465 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:39.007370 26625 leader_election.cc:336] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:39.010165 28465 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:39.010825 28465 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:39.013063 28465 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:39.031046 26625 leader_election.cc:336] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:39.031520 26625 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:39.032226 28465 raft_consensus.cc:2749] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:39.037992 26625 leader_election.cc:336] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:39.046782 26625 leader_election.cc:336] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
I20260709 12:29:39.047250 26625 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:39.052959 28397 raft_consensus.cc:2749] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:39.076617 28465 raft_consensus.cc:493] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:39.077167 28465 raft_consensus.cc:515] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:39.079331 28465 leader_election.cc:290] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:39.084837 26625 consensus_peers.cc:597] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:39.089285 26625 leader_election.cc:336] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:39.090032 26625 leader_election.cc:336] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:39.090428 26625 leader_election.cc:304] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:39.091209 28465 raft_consensus.cc:2749] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:29:39.096524 28465 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:39.097131 28465 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:39.099550 28465 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:39.110733 26625 leader_election.cc:336] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:39.111824 26625 leader_election.cc:336] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:39.112246 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:39.113023 28465 raft_consensus.cc:2749] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:39.184741 26625 consensus_peers.cc:597] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:39.185395 26625 consensus_peers.cc:597] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:39.221611 28465 raft_consensus.cc:493] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:39.222105 28465 raft_consensus.cc:515] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:39.223922 28465 leader_election.cc:290] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:39.240927 26625 leader_election.cc:336] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
W20260709 12:29:39.242373 26625 leader_election.cc:336] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:39.243602 26625 leader_election.cc:304] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:39.244951 28397 raft_consensus.cc:2749] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:39.261971 26625 consensus_peers.cc:597] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:39.268401 26625 consensus_peers.cc:597] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:39.671293 28484 raft_consensus.cc:493] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:39.671891 28484 raft_consensus.cc:515] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:39.684491 28484 leader_election.cc:290] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:39.698879 26625 leader_election.cc:336] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
W20260709 12:29:39.700075 26625 leader_election.cc:336] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:39.700747 26625 leader_election.cc:304] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:39.701503 28484 raft_consensus.cc:2749] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:39.715982 26625 consensus_peers.cc:597] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:39.839908 28489 raft_consensus.cc:493] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:39.840479 28489 raft_consensus.cc:515] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:39.842661 28489 leader_election.cc:290] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:39.851415 26625 leader_election.cc:336] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:39.853380 26625 leader_election.cc:336] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
I20260709 12:29:39.853826 26625 leader_election.cc:304] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:39.854552 28489 raft_consensus.cc:2749] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:39.862071 28489 raft_consensus.cc:493] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:39.862582 28489 raft_consensus.cc:515] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:39.864702 28489 leader_election.cc:290] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:39.877601 26625 leader_election.cc:336] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:39.878500 26625 leader_election.cc:336] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
I20260709 12:29:39.878997 26625 leader_election.cc:304] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:39.879727 28489 raft_consensus.cc:2749] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:29:39.908900 26625 consensus_peers.cc:597] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:39.928581 26625 consensus_peers.cc:597] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:39.963887 26625 consensus_peers.cc:597] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:39.999670 28489 raft_consensus.cc:493] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:40.000226 28489 raft_consensus.cc:515] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:40.002300 28489 leader_election.cc:290] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:40.024878 26625 leader_election.cc:336] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
W20260709 12:29:40.025878 26625 leader_election.cc:336] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:40.026345 26625 leader_election.cc:304] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:40.027117 28489 raft_consensus.cc:2749] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:40.028119 26625 consensus_peers.cc:597] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:40.041993 20917 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26608)
I20260709 12:29:40.059819 28489 raft_consensus.cc:493] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:40.060549 28489 raft_consensus.cc:515] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:40.062903 28489 leader_election.cc:290] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:40.078802 26625 leader_election.cc:336] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
W20260709 12:29:40.081176 26625 leader_election.cc:336] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:40.082796 26625 leader_election.cc:304] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.083938 28489 raft_consensus.cc:2749] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:40.090910 28489 raft_consensus.cc:493] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:40.091467 28489 raft_consensus.cc:515] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:40.093571 28489 leader_election.cc:290] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:40.108417 26625 consensus_peers.cc:597] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:40.109347 26625 leader_election.cc:336] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:40.110451 26625 leader_election.cc:336] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
I20260709 12:29:40.110945 26625 leader_election.cc:304] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.111730 28489 raft_consensus.cc:2749] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:40.131078 26625 consensus_peers.cc:597] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:40.156792 28489 raft_consensus.cc:493] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:40.157368 28489 raft_consensus.cc:515] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:40.159835 28489 leader_election.cc:290] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:40.167723 26625 leader_election.cc:336] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
W20260709 12:29:40.168498 26625 leader_election.cc:336] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:40.168955 26625 leader_election.cc:304] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.169688 28489 raft_consensus.cc:2749] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:29:40.203352 26625 consensus_peers.cc:597] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:40.203958 26625 consensus_peers.cc:597] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:40.217628 26625 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:40.234489 28489 raft_consensus.cc:493] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:40.235194 28489 raft_consensus.cc:515] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:40.237394 28489 leader_election.cc:290] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:40.251884 26625 leader_election.cc:336] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
W20260709 12:29:40.253139 26625 leader_election.cc:336] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:40.253605 26625 leader_election.cc:304] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 4ecb621c9f7f4c6698e141f131a14c4e, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.255637 28489 raft_consensus.cc:2749] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:40.260568 26625 consensus_peers.cc:597] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:40.263137 26625 consensus_peers.cc:597] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:40.306434 28489 raft_consensus.cc:493] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4ecb621c9f7f4c6698e141f131a14c4e)
I20260709 12:29:40.307006 28489 raft_consensus.cc:515] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:40.309075 28489 leader_election.cc:290] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:40.324455 26625 consensus_peers.cc:597] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:40.325327 26625 leader_election.cc:336] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:40.328441 26625 leader_election.cc:336] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
I20260709 12:29:40.328976 26625 leader_election.cc:304] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:40.329754 28489 raft_consensus.cc:2749] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:40.352186 26625 consensus_peers.cc:597] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:29:40.464747 28489 raft_consensus.cc:493] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:40.465368 28489 raft_consensus.cc:515] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:40.467603 28489 leader_election.cc:290] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:40.479313 26625 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:40.483019 26625 leader_election.cc:336] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:40.483500 26625 leader_election.cc:304] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.484330 28489 raft_consensus.cc:2749] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:29:40.508898 26625 consensus_peers.cc:597] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Couldn't send request to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:40.549767 28494 raft_consensus.cc:493] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:40.556524 28494 raft_consensus.cc:515] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:40.562220 28489 raft_consensus.cc:493] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:40.564028 28489 raft_consensus.cc:515] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:40.570374 28489 leader_election.cc:290] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:40.556561 28493 raft_consensus.cc:493] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:40.571421 28493 raft_consensus.cc:515] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:40.573858 28493 leader_election.cc:290] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
I20260709 12:29:40.576119 28494 leader_election.cc:290] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:40.591329 26625 leader_election.cc:336] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:40.598189 26625 leader_election.cc:336] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
I20260709 12:29:40.598747 26625 leader_election.cc:304] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.599596 28493 raft_consensus.cc:2749] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:40.599820 26625 leader_election.cc:336] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:40.601903 26625 leader_election.cc:336] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:40.602430 26625 leader_election.cc:304] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.603230 28493 raft_consensus.cc:2749] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:40.603402 26625 leader_election.cc:336] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:40.605988 26625 leader_election.cc:336] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
I20260709 12:29:40.606408 26625 leader_election.cc:304] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:40.607231 28493 raft_consensus.cc:2749] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:40.608734 26625 consensus_peers.cc:597] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:40.684083 26625 consensus_peers.cc:597] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:40.688424 28493 raft_consensus.cc:493] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:40.689400 28493 raft_consensus.cc:515] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } } peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } }
I20260709 12:29:40.692058 28493 leader_election.cc:290] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541), 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053)
W20260709 12:29:40.701593 26625 leader_election.cc:336] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:40.708073 26625 leader_election.cc:336] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:40.708571 26625 leader_election.cc:304] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.711006 28493 raft_consensus.cc:2749] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:29:40.722632 20917 tablet_server.cc:196] TabletServer@127.20.109.67:0 shutdown complete.
I20260709 12:29:40.788066 28493 raft_consensus.cc:493] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:40.789021 28493 raft_consensus.cc:515] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } } peers { permanent_uuid: "baa04b33c4e846e49c1e22e5f9bfe644" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 39541 } }
I20260709 12:29:40.791908 28493 leader_election.cc:290] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541)
W20260709 12:29:40.813210 26625 leader_election.cc:336] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111)
W20260709 12:29:40.814180 26625 leader_election.cc:336] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:40.814677 26625 leader_election.cc:304] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, baa04b33c4e846e49c1e22e5f9bfe644
I20260709 12:29:40.815618 28493 raft_consensus.cc:2749] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:40.849701 26625 consensus_peers.cc:597] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:40.875180 26625 consensus_peers.cc:597] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:40.875989 28493 raft_consensus.cc:493] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:40.876838 28493 raft_consensus.cc:515] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:40.879601 28493 leader_election.cc:290] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
W20260709 12:29:40.886193 26625 leader_election.cc:336] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
W20260709 12:29:40.888872 26625 leader_election.cc:336] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
I20260709 12:29:40.889397 26625 leader_election.cc:304] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:40.890256 28493 raft_consensus.cc:2749] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:40.904745 20917 tablet_server.cc:179] TabletServer@127.20.109.68:0 shutting down...
W20260709 12:29:40.933494 26625 consensus_peers.cc:597] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:40.937585 26625 consensus_peers.cc:597] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:40.969636 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:40.970923 20917 tablet_replica.cc:333] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:40.972079 20917 raft_consensus.cc:2243] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:40.972833 20917 raft_consensus.cc:2272] T fec4b7b54d6547299b2a1a4c618afcde P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:40.975920 20917 tablet_replica.cc:333] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:40.976783 20917 raft_consensus.cc:2243] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:40.978144 20917 raft_consensus.cc:2272] T e346f965eb91472e99c529ad927e2636 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:40.980887 20917 tablet_replica.cc:333] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:40.981601 20917 raft_consensus.cc:2243] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:40.982018 28493 raft_consensus.cc:493] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 131fcd2f6a7a4ab39ad3dd26b08c92ea)
I20260709 12:29:40.982404 20917 raft_consensus.cc:2272] T b867f2d6360645d4a8c7a56339b7ef56 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:40.982746 28493 raft_consensus.cc:515] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131fcd2f6a7a4ab39ad3dd26b08c92ea" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 34053 } } peers { permanent_uuid: "4ecb621c9f7f4c6698e141f131a14c4e" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38163 } } peers { permanent_uuid: "4b371ddb5e924d6e8b56b476a69a27d0" member_type: VOTER last_known_addr { host: "127.20.109.68" port: 41855 } }
I20260709 12:29:40.985246 28493 leader_election.cc:290] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053), 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163)
I20260709 12:29:40.986279 20917 tablet_replica.cc:333] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:40.987294 20917 raft_consensus.cc:2243] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:40.988428 20917 raft_consensus.cc:2272] T 71584399dd7f43d8950539126b066e37 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:40.991531 26625 leader_election.cc:336] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 131fcd2f6a7a4ab39ad3dd26b08c92ea (127.20.109.66:34053): Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111)
I20260709 12:29:40.991705 20917 tablet_replica.cc:333] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:40.992655 20917 raft_consensus.cc:2243] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:40.994421 20917 raft_consensus.cc:2272] T 001d53e77bda4b339dbb0c3b7e65eef3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:40.995209 26625 leader_election.cc:336] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111)
I20260709 12:29:40.997018 26625 leader_election.cc:304] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b371ddb5e924d6e8b56b476a69a27d0; no voters: 131fcd2f6a7a4ab39ad3dd26b08c92ea, 4ecb621c9f7f4c6698e141f131a14c4e
I20260709 12:29:40.997764 28493 raft_consensus.cc:2749] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:40.998040 20917 tablet_replica.cc:333] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:40.999132 20917 raft_consensus.cc:2243] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.000542 20917 raft_consensus.cc:2272] T 1482f526e3e847889ab33113a4254db7 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.004057 20917 tablet_replica.cc:333] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.005179 20917 raft_consensus.cc:2243] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.006305 20917 raft_consensus.cc:2272] T 958b4fe6e86040349d99c54da8473245 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:41.007202 26625 consensus_peers.cc:597] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:41.009600 20917 tablet_replica.cc:333] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.010501 20917 raft_consensus.cc:2243] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.011584 20917 raft_consensus.cc:2272] T 6ab5bed2ac8d429cbf2b3802b44b7888 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.013988 20917 tablet_replica.cc:333] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.014794 20917 raft_consensus.cc:2243] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.015502 20917 raft_consensus.cc:2272] T 5a5a23561d854cb098b5ecc2eec7f3b4 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.017942 20917 tablet_replica.cc:333] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.018517 20917 raft_consensus.cc:2243] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.019773 20917 raft_consensus.cc:2272] T caf253f7acbf409180c569cd29f50cee P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.022866 20917 tablet_replica.cc:333] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.023723 20917 raft_consensus.cc:2243] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.024681 20917 raft_consensus.cc:2272] T 6a2a8cf91f76492d8418cba471ffe78e P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.027973 20917 tablet_replica.cc:333] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.030845 20917 raft_consensus.cc:2243] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.032689 20917 raft_consensus.cc:2272] T 207cf65124de4fd1a9e0f6f3332bd1c3 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:41.033856 26625 consensus_peers.cc:597] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer baa04b33c4e846e49c1e22e5f9bfe644 (127.20.109.65:39541): Couldn't send request to peer baa04b33c4e846e49c1e22e5f9bfe644. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:39541: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:29:41.036653 20917 tablet_replica.cc:333] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.037664 20917 raft_consensus.cc:2243] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.038457 20917 raft_consensus.cc:2272] T 36b9151618004ebba90012bfc0c4c39b P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:41.038641 26625 consensus_peers.cc:597] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:41.043718 20917 tablet_replica.cc:333] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.044361 20917 raft_consensus.cc:2243] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.044888 20917 raft_consensus.cc:2272] T 62cf18772950487998aeb7a43530703f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.047464 20917 tablet_replica.cc:333] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.048060 20917 raft_consensus.cc:2243] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.048806 20917 raft_consensus.cc:2272] T 22f24da90c1944079124e5b4c1ba4733 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.051102 20917 tablet_replica.cc:333] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.051743 20917 raft_consensus.cc:2243] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.052947 20917 raft_consensus.cc:2272] T 247d4b40ff7f4c7ca1055cb3856c254d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.056851 20917 tablet_replica.cc:333] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.057700 20917 raft_consensus.cc:2243] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.058849 20917 raft_consensus.cc:2272] T b6201f65047045ac9ae106afdade627d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.061081 20917 tablet_replica.cc:333] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.061645 20917 raft_consensus.cc:2243] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.062767 20917 raft_consensus.cc:2272] T 734b294b669c4944aaabdb8977f85fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.065161 20917 tablet_replica.cc:333] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.065778 20917 raft_consensus.cc:2243] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.066977 20917 raft_consensus.cc:2272] T 55ed770173234cb8984ad0a8be82a8d1 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.069449 20917 tablet_replica.cc:333] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.070087 20917 raft_consensus.cc:2243] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.070839 20917 raft_consensus.cc:2272] T d97898f8f78e456084abffdb741c2b01 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.074640 20917 tablet_replica.cc:333] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.075758 20917 raft_consensus.cc:2243] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.077778 20917 raft_consensus.cc:2272] T d32ec030f9c24f4591d2794595b4bd1c P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.080746 20917 tablet_replica.cc:333] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.081470 20917 raft_consensus.cc:2243] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.082247 20917 raft_consensus.cc:2272] T afa1d77d71ae4c8993d446d81e4c1e5f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.085363 20917 tablet_replica.cc:333] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.086191 20917 raft_consensus.cc:2243] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:41.086211 26625 consensus_peers.cc:597] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 -> Peer 4ecb621c9f7f4c6698e141f131a14c4e (127.20.109.67:38163): Couldn't send request to peer 4ecb621c9f7f4c6698e141f131a14c4e. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.67:38163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:41.086928 20917 raft_consensus.cc:2272] T be63fec868ca40ea8667c7fac2c3c613 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.089332 20917 tablet_replica.cc:333] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.089982 20917 raft_consensus.cc:2243] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.090534 20917 raft_consensus.cc:2272] T a00d7cbf01954fb19c18146550c0ca07 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.092829 20917 tablet_replica.cc:333] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.093431 20917 raft_consensus.cc:2243] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.094514 20917 raft_consensus.cc:2272] T 1a863d2269ed4c85b7844c44d071ef2f P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.096725 20917 tablet_replica.cc:333] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.097357 20917 raft_consensus.cc:2243] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.097975 20917 raft_consensus.cc:2272] T 2f18e20a50264529b43abc6da23a41db P 4b371ddb5e924d6e8b56b476a69a27d0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.100762 20917 tablet_replica.cc:333] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.101557 20917 raft_consensus.cc:2243] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.102738 20917 raft_consensus.cc:2272] T d55bc7c762df41c8b7c71ed2384f9fcb P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.105098 20917 tablet_replica.cc:333] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.105664 20917 raft_consensus.cc:2243] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.106758 20917 raft_consensus.cc:2272] T 32ca6dc5d4574e99b2919d9261d9cb28 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.108935 20917 tablet_replica.cc:333] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.109560 20917 raft_consensus.cc:2243] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.110206 20917 raft_consensus.cc:2272] T 98f2bb8815884926800b1e9c023f2897 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.112465 20917 tablet_replica.cc:333] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.113019 20917 raft_consensus.cc:2243] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.114008 20917 raft_consensus.cc:2272] T 98dacc178cef46228ca27e7e2085dd8a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.116367 20917 tablet_replica.cc:333] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.117174 20917 raft_consensus.cc:2243] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.118556 20917 raft_consensus.cc:2272] T fdb336eb1945459da39038940beae620 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:41.119024 26625 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.66:34053: connect: Connection refused (error 111) [suppressed 577 similar messages]
I20260709 12:29:41.121301 20917 tablet_replica.cc:333] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.122088 20917 raft_consensus.cc:2243] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.123118 20917 raft_consensus.cc:2272] T a0eddc7ff9ef4017b178747494e76fc2 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.125244 20917 tablet_replica.cc:333] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.125749 20917 raft_consensus.cc:2243] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.126771 20917 raft_consensus.cc:2272] T f373d8db1e3349c48d8c4dfcdada9e41 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.128639 20917 tablet_replica.cc:333] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.129130 20917 raft_consensus.cc:2243] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.129694 20917 raft_consensus.cc:2272] T 102123f032ed4637895154c8d3cfe658 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.131659 20917 tablet_replica.cc:333] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.132179 20917 raft_consensus.cc:2243] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.132723 20917 raft_consensus.cc:2272] T 6180fe8f3be6486d829a4b44cc3c7f9d P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.134840 20917 tablet_replica.cc:333] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.135336 20917 raft_consensus.cc:2243] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.136386 20917 raft_consensus.cc:2272] T 6aefe5d0dc7846ca9db57012baae4777 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.138643 20917 tablet_replica.cc:333] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.139184 20917 raft_consensus.cc:2243] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.139717 20917 raft_consensus.cc:2272] T cc8bb74cfe63435e983f2e9258c229ba P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.141939 20917 tablet_replica.cc:333] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.142504 20917 raft_consensus.cc:2243] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.143587 20917 raft_consensus.cc:2272] T ede359b4a846419ca0057e565814c444 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.145871 20917 tablet_replica.cc:333] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.146415 20917 raft_consensus.cc:2243] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.147006 20917 raft_consensus.cc:2272] T eee116af186a4716920d4630b13d5b51 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.149367 20917 tablet_replica.cc:333] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.149864 20917 raft_consensus.cc:2243] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.150429 20917 raft_consensus.cc:2272] T 5bf8f563ecd14874baedead593c9a98a P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.152552 20917 tablet_replica.cc:333] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.153105 20917 raft_consensus.cc:2243] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.154132 20917 raft_consensus.cc:2272] T 486de29ef17f4eb9aa01601103eaf921 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.156297 20917 tablet_replica.cc:333] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.156809 20917 raft_consensus.cc:2243] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.157815 20917 raft_consensus.cc:2272] T a2acc4a4b3b54b9381d3203a4023ba71 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.160159 20917 tablet_replica.cc:333] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.160651 20917 raft_consensus.cc:2243] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.161861 20917 raft_consensus.cc:2272] T 57aa38006440444a86a6ec5138a99183 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.164314 20917 tablet_replica.cc:333] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0: stopping tablet replica
I20260709 12:29:41.164836 20917 raft_consensus.cc:2243] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.165444 20917 raft_consensus.cc:2272] T 90f36d35c0b94881b6f8db11a1caa351 P 4b371ddb5e924d6e8b56b476a69a27d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.283802 20917 tablet_server.cc:196] TabletServer@127.20.109.68:0 shutdown complete.
I20260709 12:29:41.366910 20917 master.cc:562] Master@127.20.109.126:41885 shutting down...
I20260709 12:29:41.404130 20917 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.404903 20917 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.405253 20917 tablet_replica.cc:333] T 00000000000000000000000000000000 P c1f77ce91dcd42a18ee69e76f6c05165: stopping tablet replica
I20260709 12:29:41.999631 20917 master.cc:584] Master@127.20.109.126:41885 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (60759 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:29:42.090423 20917 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.109.126:37423
I20260709 12:29:42.091634 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:42.096916 28495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:42.097424 28496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:42.099284 28498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:42.099542 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:42.101099 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:42.101294 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:42.101457 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600182101442 us; error 0 us; skew 500 ppm
I20260709 12:29:42.102035 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:42.104687 20917 webserver.cc:533] Webserver started at http://127.20.109.126:35667/ using document root <none> and password file <none>
I20260709 12:29:42.105188 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:42.105363 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:42.105623 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:42.106878 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/master-0-root/instance:
uuid: "a657f02e030145a5b7609cf79ecdf615"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:42.111264 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:29:42.114470 28503 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.115168 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:42.115432 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/master-0-root
uuid: "a657f02e030145a5b7609cf79ecdf615"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:42.115687 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:42.124135 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:42.125382 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:42.164541 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.126:37423
I20260709 12:29:42.164647 28554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.126:37423 every 8 connection(s)
I20260709 12:29:42.168620 28555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.180505 28555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615: Bootstrap starting.
I20260709 12:29:42.185628 28555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.190047 28555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615: No bootstrap required, opened a new log
I20260709 12:29:42.192472 28555 raft_consensus.cc:359] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657f02e030145a5b7609cf79ecdf615" member_type: VOTER }
I20260709 12:29:42.193027 28555 raft_consensus.cc:385] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.193260 28555 raft_consensus.cc:740] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a657f02e030145a5b7609cf79ecdf615, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.193910 28555 consensus_queue.cc:260] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657f02e030145a5b7609cf79ecdf615" member_type: VOTER }
I20260709 12:29:42.194468 28555 raft_consensus.cc:399] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:42.194770 28555 raft_consensus.cc:493] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:42.195062 28555 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.200088 28555 raft_consensus.cc:515] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657f02e030145a5b7609cf79ecdf615" member_type: VOTER }
I20260709 12:29:42.200639 28555 leader_election.cc:304] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a657f02e030145a5b7609cf79ecdf615; no voters: 
I20260709 12:29:42.201766 28555 leader_election.cc:290] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:42.202204 28558 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.203765 28558 raft_consensus.cc:697] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 1 LEADER]: Becoming Leader. State: Replica: a657f02e030145a5b7609cf79ecdf615, State: Running, Role: LEADER
I20260709 12:29:42.204761 28555 sys_catalog.cc:565] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:42.204654 28558 consensus_queue.cc:237] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657f02e030145a5b7609cf79ecdf615" member_type: VOTER }
I20260709 12:29:42.210760 28560 sys_catalog.cc:455] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a657f02e030145a5b7609cf79ecdf615. Latest consensus state: current_term: 1 leader_uuid: "a657f02e030145a5b7609cf79ecdf615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657f02e030145a5b7609cf79ecdf615" member_type: VOTER } }
I20260709 12:29:42.211359 28560 sys_catalog.cc:458] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:42.212459 28559 sys_catalog.cc:455] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a657f02e030145a5b7609cf79ecdf615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657f02e030145a5b7609cf79ecdf615" member_type: VOTER } }
I20260709 12:29:42.213111 28559 sys_catalog.cc:458] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:42.213233 28567 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:42.218678 28567 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:42.219734 20917 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:42.227494 28567 catalog_manager.cc:1383] Generated new cluster ID: bda1a327ffa041efa25bc92cae125405
I20260709 12:29:42.227867 28567 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:42.250283 28567 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:42.251617 28567 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:42.264987 28567 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615: Generated new TSK 0
I20260709 12:29:42.265556 28567 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:42.286818 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:42.293684 28576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:42.294301 28577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:42.297010 28579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:42.297049 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:42.298421 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:42.298652 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:42.298820 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600182298802 us; error 0 us; skew 500 ppm
I20260709 12:29:42.299453 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:42.302111 20917 webserver.cc:533] Webserver started at http://127.20.109.65:43729/ using document root <none> and password file <none>
I20260709 12:29:42.302692 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:42.302886 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:42.303145 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:42.304332 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root/instance:
uuid: "d5f98cb9816c4d33b08ac8fb604be606"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:42.310576 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:42.314543 28584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.315446 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:29:42.315732 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "d5f98cb9816c4d33b08ac8fb604be606"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:42.316008 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:42.344565 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:42.345820 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:42.347385 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:42.349812 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:42.350009 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.350195 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:42.350345 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.397125 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:46559
I20260709 12:29:42.397240 28646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:46559 every 8 connection(s)
I20260709 12:29:42.402410 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:42.409291 28651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:42.410452 28652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:42.413537 28655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:42.413888 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:42.415424 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:42.415639 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:42.415774 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600182415762 us; error 0 us; skew 500 ppm
I20260709 12:29:42.416375 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:42.418903 20917 webserver.cc:533] Webserver started at http://127.20.109.66:37377/ using document root <none> and password file <none>
I20260709 12:29:42.419359 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:42.419518 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:42.419721 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:42.420753 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-1-root/instance:
uuid: "90ac18d3524d4dc2921c78de3d660fad"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:42.425241 28647 heartbeater.cc:344] Connected to a master server at 127.20.109.126:37423
I20260709 12:29:42.425622 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 12:29:42.425736 28647 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:42.426694 28647 heartbeater.cc:507] Master 127.20.109.126:37423 requested a full tablet report, sending...
I20260709 12:29:42.429207 28520 ts_manager.cc:194] Registered new tserver with Master: d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559)
I20260709 12:29:42.430166 28659 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.431051 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:29:42.431319 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-1-root
uuid: "90ac18d3524d4dc2921c78de3d660fad"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:42.431483 28520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54738
I20260709 12:29:42.431593 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:42.455753 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:42.457020 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:42.458530 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:42.460875 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:42.461068 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.461320 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:42.461472 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.504266 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.66:39037
I20260709 12:29:42.504408 28721 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.66:39037 every 8 connection(s)
I20260709 12:29:42.509295 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:42.516927 28725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:42.517995 28726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:42.523036 28728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:42.523468 28722 heartbeater.cc:344] Connected to a master server at 127.20.109.126:37423
I20260709 12:29:42.524015 28722 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:42.524042 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:42.525033 28722 heartbeater.cc:507] Master 127.20.109.126:37423 requested a full tablet report, sending...
I20260709 12:29:42.525142 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:42.525449 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:42.525612 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600182525596 us; error 0 us; skew 500 ppm
I20260709 12:29:42.526331 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:42.527237 28520 ts_manager.cc:194] Registered new tserver with Master: 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:42.529026 28520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54742
I20260709 12:29:42.529284 20917 webserver.cc:533] Webserver started at http://127.20.109.67:37955/ using document root <none> and password file <none>
I20260709 12:29:42.529861 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:42.530097 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:42.530396 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:42.531572 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-2-root/instance:
uuid: "82b94f9ad924401599f0c147ac57133f"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:42.536103 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:42.539676 28733 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.540509 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:42.540827 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-2-root
uuid: "82b94f9ad924401599f0c147ac57133f"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:42.541098 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:42.554430 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:42.555799 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:42.557330 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:42.559664 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:42.559886 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.560112 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:42.560266 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:42.602201 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.67:40253
I20260709 12:29:42.602454 28795 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.67:40253 every 8 connection(s)
I20260709 12:29:42.616557 28796 heartbeater.cc:344] Connected to a master server at 127.20.109.126:37423
I20260709 12:29:42.617022 28796 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:42.617820 28796 heartbeater.cc:507] Master 127.20.109.126:37423 requested a full tablet report, sending...
I20260709 12:29:42.619692 28520 ts_manager.cc:194] Registered new tserver with Master: 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:42.620420 20917 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014817551s
I20260709 12:29:42.621038 28520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54744
I20260709 12:29:42.646512 28520 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54746:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:42.649500 28520 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:42.721915 28612 tablet_service.cc:1511] Processing CreateTablet for tablet 90bed1cd94e04ae8ada2500662d0604c (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:42.723379 28611 tablet_service.cc:1511] Processing CreateTablet for tablet 2dca7ef2e7894e1cb821a5e9d4411d24 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:42.724436 28612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bed1cd94e04ae8ada2500662d0604c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.723402 28610 tablet_service.cc:1511] Processing CreateTablet for tablet ef5216da1ea44987b5eea6f25d0c04c4 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:42.726138 28610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef5216da1ea44987b5eea6f25d0c04c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.727519 28611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dca7ef2e7894e1cb821a5e9d4411d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.728499 28609 tablet_service.cc:1511] Processing CreateTablet for tablet f0948271dba74025b360f84f8bb97c3a (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:42.729873 28609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0948271dba74025b360f84f8bb97c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.742161 28687 tablet_service.cc:1511] Processing CreateTablet for tablet 90bed1cd94e04ae8ada2500662d0604c (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:42.743716 28687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bed1cd94e04ae8ada2500662d0604c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.745908 28686 tablet_service.cc:1511] Processing CreateTablet for tablet 2dca7ef2e7894e1cb821a5e9d4411d24 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:42.747437 28686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dca7ef2e7894e1cb821a5e9d4411d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.751842 28685 tablet_service.cc:1511] Processing CreateTablet for tablet ef5216da1ea44987b5eea6f25d0c04c4 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:42.753401 28685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef5216da1ea44987b5eea6f25d0c04c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.746003 28684 tablet_service.cc:1511] Processing CreateTablet for tablet f0948271dba74025b360f84f8bb97c3a (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:42.756393 28684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0948271dba74025b360f84f8bb97c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.759023 28608 tablet_service.cc:1511] Processing CreateTablet for tablet 3544ec3203ec465d8c5b8c48e0d0cb50 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:42.760493 28608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3544ec3203ec465d8c5b8c48e0d0cb50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.765043 28683 tablet_service.cc:1511] Processing CreateTablet for tablet 3544ec3203ec465d8c5b8c48e0d0cb50 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:42.768321 28607 tablet_service.cc:1511] Processing CreateTablet for tablet 24ac61fc69f048dcb4c37d7908f76e4e (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:42.769768 28607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ac61fc69f048dcb4c37d7908f76e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.772703 28682 tablet_service.cc:1511] Processing CreateTablet for tablet 24ac61fc69f048dcb4c37d7908f76e4e (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:42.766484 28683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3544ec3203ec465d8c5b8c48e0d0cb50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.777335 28681 tablet_service.cc:1511] Processing CreateTablet for tablet 207193718bc944d08f549a0b3a77944c (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:42.777946 28682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ac61fc69f048dcb4c37d7908f76e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.780442 28681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207193718bc944d08f549a0b3a77944c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.781944 28606 tablet_service.cc:1511] Processing CreateTablet for tablet 3d38d038e60448edb5c1780af6d12458 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:42.782382 28680 tablet_service.cc:1511] Processing CreateTablet for tablet 3d38d038e60448edb5c1780af6d12458 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:42.783488 28606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d38d038e60448edb5c1780af6d12458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.783655 28680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d38d038e60448edb5c1780af6d12458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.789974 28605 tablet_service.cc:1511] Processing CreateTablet for tablet c5abfe93d1004f509ef9a17b27c38a06 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:42.791522 28605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5abfe93d1004f509ef9a17b27c38a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.799490 28679 tablet_service.cc:1511] Processing CreateTablet for tablet c5abfe93d1004f509ef9a17b27c38a06 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:42.800977 28679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5abfe93d1004f509ef9a17b27c38a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.803845 28678 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7eee75d8ec439dafb7cc34db6c5b96 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:42.805359 28678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7eee75d8ec439dafb7cc34db6c5b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.808305 28604 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7eee75d8ec439dafb7cc34db6c5b96 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:42.809727 28604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7eee75d8ec439dafb7cc34db6c5b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.818825 28609 tablet_service.cc:1511] Processing CreateTablet for tablet 207193718bc944d08f549a0b3a77944c (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:42.820413 28609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207193718bc944d08f549a0b3a77944c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.861987 28811 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:42.868956 28811 tablet_bootstrap.cc:654] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.903679 28812 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:42.920279 28811 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:42.920897 28811 ts_tablet_manager.cc:1403] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.011s
I20260709 12:29:42.921134 28812 tablet_bootstrap.cc:654] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.923868 28811 raft_consensus.cc:359] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:42.924728 28811 raft_consensus.cc:385] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.925028 28811 raft_consensus.cc:740] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.925865 28811 consensus_queue.cc:260] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:42.928280 28647 heartbeater.cc:499] Master 127.20.109.126:37423 was elected leader, sending a full tablet report...
I20260709 12:29:42.928655 28811 ts_tablet_manager.cc:1434] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:42.929811 28811 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:42.932870 28812 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:42.933538 28812 ts_tablet_manager.cc:1403] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
I20260709 12:29:42.935644 28761 tablet_service.cc:1511] Processing CreateTablet for tablet 90bed1cd94e04ae8ada2500662d0604c (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:42.936666 28811 tablet_bootstrap.cc:654] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.937194 28761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bed1cd94e04ae8ada2500662d0604c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.936913 28812 raft_consensus.cc:359] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:42.937668 28812 raft_consensus.cc:385] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.937973 28812 raft_consensus.cc:740] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.938908 28812 consensus_queue.cc:260] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:42.944520 28760 tablet_service.cc:1511] Processing CreateTablet for tablet 2dca7ef2e7894e1cb821a5e9d4411d24 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:42.947506 28759 tablet_service.cc:1511] Processing CreateTablet for tablet ef5216da1ea44987b5eea6f25d0c04c4 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:42.949370 28759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef5216da1ea44987b5eea6f25d0c04c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.952059 28758 tablet_service.cc:1511] Processing CreateTablet for tablet f0948271dba74025b360f84f8bb97c3a (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:42.955027 28757 tablet_service.cc:1511] Processing CreateTablet for tablet 3544ec3203ec465d8c5b8c48e0d0cb50 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:42.957800 28756 tablet_service.cc:1511] Processing CreateTablet for tablet 24ac61fc69f048dcb4c37d7908f76e4e (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:42.960726 28755 tablet_service.cc:1511] Processing CreateTablet for tablet 207193718bc944d08f549a0b3a77944c (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:42.962628 28752 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7eee75d8ec439dafb7cc34db6c5b96 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:42.965224 28753 tablet_service.cc:1511] Processing CreateTablet for tablet c5abfe93d1004f509ef9a17b27c38a06 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:42.970286 28754 tablet_service.cc:1511] Processing CreateTablet for tablet 3d38d038e60448edb5c1780af6d12458 (DEFAULT_TABLE table=test-workload [id=1558109b120c453ea647ea2bbea10602]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:42.974490 28758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0948271dba74025b360f84f8bb97c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.976644 28753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5abfe93d1004f509ef9a17b27c38a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.978711 28756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ac61fc69f048dcb4c37d7908f76e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.979455 28755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207193718bc944d08f549a0b3a77944c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.982827 28754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d38d038e60448edb5c1780af6d12458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.987017 28757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3544ec3203ec465d8c5b8c48e0d0cb50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.991050 28760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dca7ef2e7894e1cb821a5e9d4411d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.995067 28752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7eee75d8ec439dafb7cc34db6c5b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:43.037088 28811 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.037875 28811 ts_tablet_manager.cc:1403] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.108s	user 0.048s	sys 0.048s
I20260709 12:29:43.041034 28811 raft_consensus.cc:359] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.043766 28722 heartbeater.cc:499] Master 127.20.109.126:37423 was elected leader, sending a full tablet report...
I20260709 12:29:43.043990 28812 ts_tablet_manager.cc:1434] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.110s	user 0.052s	sys 0.054s
I20260709 12:29:43.045202 28812 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.051750 28812 tablet_bootstrap.cc:654] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.042207 28811 raft_consensus.cc:385] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.059063 28811 raft_consensus.cc:740] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.060191 28811 consensus_queue.cc:260] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.085063 28811 ts_tablet_manager.cc:1434] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.047s	user 0.001s	sys 0.005s
I20260709 12:29:43.086301 28811 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:43.100888 28812 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.101508 28812 ts_tablet_manager.cc:1403] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.032s
I20260709 12:29:43.105173 28811 tablet_bootstrap.cc:654] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.104868 28812 raft_consensus.cc:359] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.108598 28812 raft_consensus.cc:385] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.109187 28812 raft_consensus.cc:740] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.109848 28815 raft_consensus.cc:493] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.110126 28812 consensus_queue.cc:260] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.111171 28815 raft_consensus.cc:515] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.112861 28812 ts_tablet_manager.cc:1434] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:29:43.113956 28812 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.117192 28815 leader_election.cc:290] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.121078 28812 tablet_bootstrap.cc:654] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.114464 28818 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.133572 28812 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.134393 28812 ts_tablet_manager.cc:1403] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.014s
I20260709 12:29:43.137674 28812 raft_consensus.cc:359] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.139273 28812 raft_consensus.cc:385] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.139626 28812 raft_consensus.cc:740] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.140826 28812 consensus_queue.cc:260] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.143608 28812 ts_tablet_manager.cc:1434] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:29:43.144749 28812 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.148309 28818 tablet_bootstrap.cc:654] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:43.152132 28648 tablet.cc:2406] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:29:43.158695 28812 tablet_bootstrap.cc:654] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.168455 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
W20260709 12:29:43.170140 28588 leader_election.cc:343] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.171702 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.171862 28812 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.172655 28812 ts_tablet_manager.cc:1403] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.004s
I20260709 12:29:43.173611 28818 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
W20260709 12:29:43.173573 28587 leader_election.cc:343] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.174257 28818 ts_tablet_manager.cc:1403] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.003s
I20260709 12:29:43.174170 28587 leader_election.cc:304] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:43.175004 28815 raft_consensus.cc:2749] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.175333 28811 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.175295 28812 raft_consensus.cc:359] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.175969 28811 ts_tablet_manager.cc:1403] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.047s
I20260709 12:29:43.176083 28812 raft_consensus.cc:385] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.176409 28812 raft_consensus.cc:740] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.177049 28812 consensus_queue.cc:260] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.177235 28818 raft_consensus.cc:359] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:43.177963 28818 raft_consensus.cc:385] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.178261 28818 raft_consensus.cc:740] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.178989 28811 raft_consensus.cc:359] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.179162 28818 consensus_queue.cc:260] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:43.179783 28811 raft_consensus.cc:385] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.179987 28812 ts_tablet_manager.cc:1434] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:29:43.180109 28811 raft_consensus.cc:740] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.181504 28812 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.181187 28811 consensus_queue.cc:260] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.183764 28811 ts_tablet_manager.cc:1434] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:43.184998 28811 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:43.191295 28812 tablet_bootstrap.cc:654] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.193094 28811 tablet_bootstrap.cc:654] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.206318 28811 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.206983 28811 ts_tablet_manager.cc:1403] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.009s
I20260709 12:29:43.207324 28796 heartbeater.cc:499] Master 127.20.109.126:37423 was elected leader, sending a full tablet report...
I20260709 12:29:43.208273 28818 ts_tablet_manager.cc:1434] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.034s	user 0.015s	sys 0.016s
I20260709 12:29:43.209427 28818 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.210566 28811 raft_consensus.cc:359] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.211400 28811 raft_consensus.cc:385] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.211702 28811 raft_consensus.cc:740] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.212651 28811 consensus_queue.cc:260] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
W20260709 12:29:43.215143 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:43.215210 28811 ts_tablet_manager.cc:1434] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:43.216635 28811 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:43.218763 28818 tablet_bootstrap.cc:654] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.224543 28811 tablet_bootstrap.cc:654] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.225030 28817 raft_consensus.cc:493] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.225772 28817 raft_consensus.cc:515] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.237807 28811 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.238497 28811 ts_tablet_manager.cc:1403] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:29:43.241995 28811 raft_consensus.cc:359] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.243036 28811 raft_consensus.cc:385] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.243355 28811 raft_consensus.cc:740] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.244191 28811 consensus_queue.cc:260] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.246888 28811 ts_tablet_manager.cc:1434] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:43.248042 28811 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:43.255770 28811 tablet_bootstrap.cc:654] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.266920 28817 leader_election.cc:290] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.268370 28811 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.269177 28811 ts_tablet_manager.cc:1403] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:29:43.272776 28811 raft_consensus.cc:359] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.273612 28811 raft_consensus.cc:385] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.273926 28811 raft_consensus.cc:740] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.274940 28811 consensus_queue.cc:260] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.277493 28811 ts_tablet_manager.cc:1434] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:43.278748 28811 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:43.283922 28811 tablet_bootstrap.cc:654] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.290584 28812 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.291188 28812 ts_tablet_manager.cc:1403] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.110s	user 0.042s	sys 0.053s
I20260709 12:29:43.294752 28812 raft_consensus.cc:359] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.295665 28812 raft_consensus.cc:385] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.295982 28812 raft_consensus.cc:740] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.296777 28812 consensus_queue.cc:260] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.299098 28812 ts_tablet_manager.cc:1434] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:29:43.300161 28812 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.306981 28812 tablet_bootstrap.cc:654] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.315917 28817 raft_consensus.cc:493] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.316582 28817 raft_consensus.cc:515] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.319072 28817 leader_election.cc:290] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.333648 28815 raft_consensus.cc:493] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.334301 28815 raft_consensus.cc:515] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:43.337857 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:43.339761 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.340445 28771 raft_consensus.cc:2468] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 0.
W20260709 12:29:43.340619 28588 leader_election.cc:343] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.341709 28587 leader_election.cc:304] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:43.343575 28815 leader_election.cc:290] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:43.344129 28815 raft_consensus.cc:2804] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.344491 28815 raft_consensus.cc:493] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.344827 28815 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.355019 28817 raft_consensus.cc:493] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.355720 28817 raft_consensus.cc:515] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.358222 28817 leader_election.cc:290] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.360427 28815 raft_consensus.cc:515] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:43.377696 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.380816 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38d038e60448edb5c1780af6d12458" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.382475 28770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.384609 28811 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.385222 28811 ts_tablet_manager.cc:1403] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.065s
I20260709 12:29:43.388334 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38d038e60448edb5c1780af6d12458" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.388734 28811 raft_consensus.cc:359] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.389228 28622 raft_consensus.cc:2468] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 0.
I20260709 12:29:43.389626 28811 raft_consensus.cc:385] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.390015 28811 raft_consensus.cc:740] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.393122 28811 consensus_queue.cc:260] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.393748 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:43.396535 28811 ts_tablet_manager.cc:1434] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:29:43.397807 28811 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:43.397678 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.398790 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.399649 28621 raft_consensus.cc:2468] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 0.
W20260709 12:29:43.402484 28588 leader_election.cc:343] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:43.383088 28662 leader_election.cc:343] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:43.403959 28662 leader_election.cc:343] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.406517 28811 tablet_bootstrap.cc:654] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.408236 28620 raft_consensus.cc:2468] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 0.
I20260709 12:29:43.410575 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.411868 28771 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.410943 28815 leader_election.cc:290] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Requested vote from peers 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:43.416057 28663 leader_election.cc:304] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
W20260709 12:29:43.416769 28662 leader_election.cc:343] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.418118 28817 raft_consensus.cc:2804] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.418687 28817 raft_consensus.cc:493] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.419050 28817 raft_consensus.cc:3060] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.419203 28812 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.419790 28812 ts_tablet_manager.cc:1403] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.120s	user 0.033s	sys 0.043s
I20260709 12:29:43.420292 28663 leader_election.cc:304] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:43.422866 28812 raft_consensus.cc:359] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:43.424787 28812 raft_consensus.cc:385] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.425096 28812 raft_consensus.cc:740] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.424074 28811 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.426034 28811 ts_tablet_manager.cc:1403] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.006s
I20260709 12:29:43.428105 28839 raft_consensus.cc:2804] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.428798 28839 raft_consensus.cc:493] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.428702 28811 raft_consensus.cc:359] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.429215 28839 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.429180 28817 raft_consensus.cc:515] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.429770 28812 consensus_queue.cc:260] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:43.429437 28811 raft_consensus.cc:385] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.431860 28811 raft_consensus.cc:740] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.431471 28663 leader_election.cc:304] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:43.432574 28811 consensus_queue.cc:260] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.434759 28811 ts_tablet_manager.cc:1434] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:29:43.434630 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38d038e60448edb5c1780af6d12458" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.434630 28818 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.435963 28818 ts_tablet_manager.cc:1403] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.227s	user 0.082s	sys 0.107s
I20260709 12:29:43.436072 28811 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
W20260709 12:29:43.436676 28662 leader_election.cc:343] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.437315 28817 leader_election.cc:290] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.438123 28817 raft_consensus.cc:2804] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.438527 28817 raft_consensus.cc:493] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.438956 28817 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.439248 28771 raft_consensus.cc:2468] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 1.
I20260709 12:29:43.440456 28587 leader_election.cc:304] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:43.441588 28815 raft_consensus.cc:2804] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.442108 28815 raft_consensus.cc:697] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Becoming Leader. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Running, Role: LEADER
I20260709 12:29:43.442294 28811 tablet_bootstrap.cc:654] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.443239 28815 consensus_queue.cc:237] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:43.448127 28818 raft_consensus.cc:359] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.448908 28818 raft_consensus.cc:385] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.449193 28818 raft_consensus.cc:740] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.452530 28837 raft_consensus.cc:493] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.453195 28837 raft_consensus.cc:515] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.456935 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:43.457677 28697 raft_consensus.cc:2468] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 0.
I20260709 12:29:43.459386 28588 leader_election.cc:304] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:43.463742 28837 leader_election.cc:290] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.464368 28837 raft_consensus.cc:2804] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.464742 28837 raft_consensus.cc:493] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.465058 28837 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.465129 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
W20260709 12:29:43.466778 28587 leader_election.cc:343] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.470060 28840 raft_consensus.cc:493] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.473598 28839 raft_consensus.cc:515] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.474205 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38d038e60448edb5c1780af6d12458" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:43.474453 28811 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.474871 28620 raft_consensus.cc:3060] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.475075 28811 ts_tablet_manager.cc:1403] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.008s
I20260709 12:29:43.471616 28840 raft_consensus.cc:515] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:43.477311 28839 leader_election.cc:290] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.478282 28840 leader_election.cc:290] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.479164 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.479512 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.480288 28769 raft_consensus.cc:2393] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90ac18d3524d4dc2921c78de3d660fad in current term 1: Already voted for candidate d5f98cb9816c4d33b08ac8fb604be606 in this term.
W20260709 12:29:43.480680 28662 leader_election.cc:343] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.482784 28811 raft_consensus.cc:359] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.483529 28811 raft_consensus.cc:385] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.483834 28811 raft_consensus.cc:740] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.484426 28817 raft_consensus.cc:515] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.484580 28811 consensus_queue.cc:260] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.486681 28817 leader_election.cc:290] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.487039 28811 ts_tablet_manager.cc:1434] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:29:43.487123 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:43.487814 28621 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.488078 28811 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:43.488346 28812 ts_tablet_manager.cc:1434] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.068s	user 0.020s	sys 0.010s
I20260709 12:29:43.489353 28812 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.489667 28518 catalog_manager.cc:5697] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d5f98cb9816c4d33b08ac8fb604be606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.490782 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.493333 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:43.493903 28622 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.494168 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.494539 28837 raft_consensus.cc:515] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
W20260709 12:29:43.495823 28662 leader_election.cc:343] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.497488 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:43.498127 28697 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.498402 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
W20260709 12:29:43.499956 28587 leader_election.cc:343] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.500552 28620 raft_consensus.cc:2468] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 1.
I20260709 12:29:43.503326 28621 raft_consensus.cc:2468] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 1.
I20260709 12:29:43.506572 28622 raft_consensus.cc:2468] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 1.
I20260709 12:29:43.507115 28697 raft_consensus.cc:2468] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 1.
I20260709 12:29:43.507242 28663 leader_election.cc:304] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad; no voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:43.507776 28837 leader_election.cc:290] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Requested vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.508296 28817 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.508809 28663 leader_election.cc:304] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:43.509814 28811 tablet_bootstrap.cc:654] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.510154 28663 leader_election.cc:304] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:43.465161 28818 consensus_queue.cc:260] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.511698 28588 leader_election.cc:304] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:43.513726 28812 tablet_bootstrap.cc:654] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.514027 28837 raft_consensus.cc:2804] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.514640 28837 raft_consensus.cc:697] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Becoming Leader. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Running, Role: LEADER
I20260709 12:29:43.515637 28837 consensus_queue.cc:237] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.514853 28840 raft_consensus.cc:2804] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.517755 28840 raft_consensus.cc:697] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:43.518682 28818 ts_tablet_manager.cc:1434] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.004s
I20260709 12:29:43.518658 28840 consensus_queue.cc:237] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.519922 28818 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.520509 28817 raft_consensus.cc:2749] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.522614 28839 raft_consensus.cc:2804] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.523234 28839 raft_consensus.cc:697] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:43.523239 28663 leader_election.cc:304] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:43.524194 28839 consensus_queue.cc:237] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.527267 28817 raft_consensus.cc:2804] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.532385 28817 raft_consensus.cc:697] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:43.533507 28844 raft_consensus.cc:493] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.534107 28844 raft_consensus.cc:515] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.533381 28817 consensus_queue.cc:237] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.537843 28844 leader_election.cc:290] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.541666 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:43.539565 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.543555 28769 raft_consensus.cc:2468] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 0.
I20260709 12:29:43.545079 28587 leader_election.cc:304] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:43.545877 28837 raft_consensus.cc:493] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:43.546162 28588 leader_election.cc:343] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.546339 28837 raft_consensus.cc:515] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.548712 28837 leader_election.cc:290] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.549223 28837 raft_consensus.cc:2804] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.549815 28837 raft_consensus.cc:493] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.550173 28837 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.550405 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.550765 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
W20260709 12:29:43.552067 28587 leader_election.cc:343] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:43.552760 28588 leader_election.cc:343] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.553237 28588 leader_election.cc:304] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:43.554574 28844 raft_consensus.cc:2749] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.549140 28811 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: No bootstrap required, opened a new log
I20260709 12:29:43.558383 28811 ts_tablet_manager.cc:1403] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.004s
I20260709 12:29:43.566777 28818 tablet_bootstrap.cc:654] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.569692 28812 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.571483 28812 ts_tablet_manager.cc:1403] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.008s
I20260709 12:29:43.569983 28811 raft_consensus.cc:359] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.572184 28811 raft_consensus.cc:385] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.572497 28811 raft_consensus.cc:740] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.566651 28837 raft_consensus.cc:515] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.572650 28519 catalog_manager.cc:5697] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 0 to 1, leader changed from <none> to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 1 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.574574 28519 catalog_manager.cc:5697] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 0 to 1, leader changed from <none> to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 1 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.581112 28818 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.581670 28818 ts_tablet_manager.cc:1403] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.005s
I20260709 12:29:43.576329 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
W20260709 12:29:43.584101 28588 leader_election.cc:343] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.582844 28518 catalog_manager.cc:5697] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d5f98cb9816c4d33b08ac8fb604be606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.584638 28818 raft_consensus.cc:359] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.585918 28818 raft_consensus.cc:385] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.586375 28818 raft_consensus.cc:740] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.574586 28812 raft_consensus.cc:359] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.577656 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.587253 28812 raft_consensus.cc:385] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.587404 28769 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.587612 28812 raft_consensus.cc:740] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.587754 28818 consensus_queue.cc:260] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.588423 28812 consensus_queue.cc:260] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.590113 28818 ts_tablet_manager.cc:1434] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:43.590842 28812 ts_tablet_manager.cc:1434] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:29:43.591200 28818 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.591952 28812 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.597817 28818 tablet_bootstrap.cc:654] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.575778 28811 consensus_queue.cc:260] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.577737 28837 leader_election.cc:290] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Requested vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.600925 28811 ts_tablet_manager.cc:1434] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.005s
I20260709 12:29:43.600304 28517 catalog_manager.cc:5697] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 0 to 1, leader changed from <none> to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 1 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.601650 28812 tablet_bootstrap.cc:654] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.609436 28812 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.610013 28812 ts_tablet_manager.cc:1403] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 12:29:43.612830 28812 raft_consensus.cc:359] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.613572 28812 raft_consensus.cc:385] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.613905 28812 raft_consensus.cc:740] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.614651 28818 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.615293 28818 ts_tablet_manager.cc:1403] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.014s
I20260709 12:29:43.614764 28812 consensus_queue.cc:260] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.617115 28769 raft_consensus.cc:2468] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 1.
I20260709 12:29:43.617668 28812 ts_tablet_manager.cc:1434] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:43.618747 28812 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.618310 28818 raft_consensus.cc:359] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.619257 28818 raft_consensus.cc:385] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.619596 28818 raft_consensus.cc:740] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.619791 28587 leader_election.cc:304] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:43.620977 28837 raft_consensus.cc:2804] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.620635 28818 consensus_queue.cc:260] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.621519 28837 raft_consensus.cc:697] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Becoming Leader. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Running, Role: LEADER
I20260709 12:29:43.622483 28837 consensus_queue.cc:237] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.623158 28818 ts_tablet_manager.cc:1434] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:29:43.624239 28818 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.619499 28844 raft_consensus.cc:493] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.626183 28844 raft_consensus.cc:515] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.626478 28817 raft_consensus.cc:493] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.629094 28817 raft_consensus.cc:515] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.631086 28818 tablet_bootstrap.cc:654] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.631417 28817 leader_election.cc:290] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.632560 28812 tablet_bootstrap.cc:654] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.633262 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.635218 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:43.635902 28697 raft_consensus.cc:2468] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 0.
I20260709 12:29:43.628499 28844 leader_election.cc:290] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.637347 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.637997 28771 raft_consensus.cc:2468] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 0.
I20260709 12:29:43.640187 28588 leader_election.cc:304] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:43.641713 28844 raft_consensus.cc:2804] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.637939 28817 raft_consensus.cc:493] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.642139 28844 raft_consensus.cc:493] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.642551 28844 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.642632 28818 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.642810 28817 raft_consensus.cc:515] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.643608 28818 ts_tablet_manager.cc:1403] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 12:29:43.646693 28817 leader_election.cc:290] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.648069 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.646503 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.642634 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.649430 28769 raft_consensus.cc:2393] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90ac18d3524d4dc2921c78de3d660fad in current term 1: Already voted for candidate d5f98cb9816c4d33b08ac8fb604be606 in this term.
I20260709 12:29:43.650873 28662 leader_election.cc:304] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad; no voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:43.651026 28817 raft_consensus.cc:493] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.651723 28817 raft_consensus.cc:515] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.652235 28839 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.654960 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207193718bc944d08f549a0b3a77944c" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.655646 28622 raft_consensus.cc:2468] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 0.
I20260709 12:29:43.657069 28663 leader_election.cc:304] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:43.657953 28840 raft_consensus.cc:2804] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.658529 28840 raft_consensus.cc:493] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.659018 28840 raft_consensus.cc:3060] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.663439 28815 raft_consensus.cc:493] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.663988 28815 raft_consensus.cc:515] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.648741 28771 raft_consensus.cc:2468] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 0.
I20260709 12:29:43.666081 28662 leader_election.cc:304] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: 
I20260709 12:29:43.666092 28815 leader_election.cc:290] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.667109 28841 raft_consensus.cc:2804] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.667377 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:43.667657 28841 raft_consensus.cc:493] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.668042 28841 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.668617 28839 raft_consensus.cc:2749] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.678508 28840 raft_consensus.cc:515] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.679101 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.679291 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207193718bc944d08f549a0b3a77944c" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.680205 28769 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 0.
W20260709 12:29:43.681128 28662 leader_election.cc:343] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:43.677208 28588 leader_election.cc:343] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.683029 28587 leader_election.cc:304] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:43.675913 28818 raft_consensus.cc:359] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.686286 28841 raft_consensus.cc:515] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.688086 28818 raft_consensus.cc:385] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.688460 28818 raft_consensus.cc:740] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.688683 28518 catalog_manager.cc:5697] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d5f98cb9816c4d33b08ac8fb604be606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.689433 28818 consensus_queue.cc:260] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.679658 28817 leader_election.cc:290] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.690408 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:43.691270 28812 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.691751 28812 ts_tablet_manager.cc:1403] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.027s
I20260709 12:29:43.687228 28844 raft_consensus.cc:515] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.693089 28621 raft_consensus.cc:2393] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90ac18d3524d4dc2921c78de3d660fad in current term 1: Already voted for candidate d5f98cb9816c4d33b08ac8fb604be606 in this term.
I20260709 12:29:43.694550 28812 raft_consensus.cc:359] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.695276 28812 raft_consensus.cc:385] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.695529 28812 raft_consensus.cc:740] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.696183 28818 ts_tablet_manager.cc:1434] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.002s
I20260709 12:29:43.696200 28812 consensus_queue.cc:260] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.697332 28818 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.698315 28812 ts_tablet_manager.cc:1434] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:29:43.699230 28812 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad: Bootstrap starting.
I20260709 12:29:43.700975 28844 leader_election.cc:290] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Requested vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.702585 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:43.703382 28697 raft_consensus.cc:2393] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5f98cb9816c4d33b08ac8fb604be606 in current term 1: Already voted for candidate 90ac18d3524d4dc2921c78de3d660fad in this term.
I20260709 12:29:43.703317 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207193718bc944d08f549a0b3a77944c" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:43.704177 28621 raft_consensus.cc:3060] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.703321 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.706735 28812 tablet_bootstrap.cc:654] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.706655 28769 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.716120 28818 tablet_bootstrap.cc:654] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.687491 28837 raft_consensus.cc:2804] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.717150 28837 raft_consensus.cc:493] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.718897 28769 raft_consensus.cc:2468] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 1.
I20260709 12:29:43.720507 28621 raft_consensus.cc:2468] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 1.
I20260709 12:29:43.721145 28837 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.721827 28587 leader_election.cc:304] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:43.722168 28663 leader_election.cc:304] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:43.722747 28844 raft_consensus.cc:2804] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.723232 28844 raft_consensus.cc:697] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Becoming Leader. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Running, Role: LEADER
I20260709 12:29:43.723567 28817 raft_consensus.cc:2804] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.721374 28812 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad: No bootstrap required, opened a new log
I20260709 12:29:43.724278 28840 leader_election.cc:290] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.724510 28812 ts_tablet_manager.cc:1403] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 12:29:43.724892 28841 leader_election.cc:290] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.725605 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207193718bc944d08f549a0b3a77944c" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.725963 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.724109 28817 raft_consensus.cc:697] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
W20260709 12:29:43.727165 28662 leader_election.cc:343] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.727504 28817 consensus_queue.cc:237] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.728893 28812 raft_consensus.cc:359] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.729487 28812 raft_consensus.cc:385] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.729689 28812 raft_consensus.cc:740] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.726747 28771 raft_consensus.cc:2393] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 90ac18d3524d4dc2921c78de3d660fad in current term 1: Already voted for candidate d5f98cb9816c4d33b08ac8fb604be606 in this term.
I20260709 12:29:43.730329 28812 consensus_queue.cc:260] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.731880 28662 leader_election.cc:304] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad; no voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:43.732364 28812 ts_tablet_manager.cc:1434] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:29:43.732697 28841 raft_consensus.cc:2749] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.732053 28837 raft_consensus.cc:515] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.724081 28844 consensus_queue.cc:237] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.735172 28837 leader_election.cc:290] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Requested vote from peers 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.735832 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:43.736502 28697 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.736440 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "d5f98cb9816c4d33b08ac8fb604be606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.737243 28771 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.742523 28826 raft_consensus.cc:493] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.743175 28826 raft_consensus.cc:515] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.741341 28518 catalog_manager.cc:5697] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 0 to 1, leader changed from <none> to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 1 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.748790 28826 leader_election.cc:290] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:43.753217 28697 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 1.
I20260709 12:29:43.752645 28517 catalog_manager.cc:5697] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d5f98cb9816c4d33b08ac8fb604be606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.754474 28588 leader_election.cc:304] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:43.755434 28844 raft_consensus.cc:2804] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.756116 28844 raft_consensus.cc:697] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Becoming Leader. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Running, Role: LEADER
I20260709 12:29:43.756980 28844 consensus_queue.cc:237] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.761176 28818 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.761626 28817 raft_consensus.cc:493] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.761772 28818 ts_tablet_manager.cc:1403] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.002s
I20260709 12:29:43.766382 28818 raft_consensus.cc:359] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.762223 28817 raft_consensus.cc:515] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.771191 28771 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5f98cb9816c4d33b08ac8fb604be606 in term 1.
I20260709 12:29:43.767642 28818 raft_consensus.cc:385] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.772627 28818 raft_consensus.cc:740] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.773737 28818 consensus_queue.cc:260] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.776546 28818 ts_tablet_manager.cc:1434] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 12:29:43.778887 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.779451 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:43.781790 28818 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
W20260709 12:29:43.782161 28662 leader_election.cc:343] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.783051 28621 raft_consensus.cc:2468] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 0.
I20260709 12:29:43.780040 28817 leader_election.cc:290] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.784307 28663 leader_election.cc:304] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:43.785017 28817 raft_consensus.cc:2804] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.785521 28817 raft_consensus.cc:493] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.785907 28817 raft_consensus.cc:3060] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.790262 28818 tablet_bootstrap.cc:654] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.790946 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.796687 28817 raft_consensus.cc:515] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.801119 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:43.801432 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:43.802028 28621 raft_consensus.cc:3060] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:43.803004 28662 leader_election.cc:343] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.804634 28817 leader_election.cc:290] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:43.806834 28818 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.807978 28818 ts_tablet_manager.cc:1403] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.015s
I20260709 12:29:43.810827 28621 raft_consensus.cc:2468] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 1.
I20260709 12:29:43.811359 28818 raft_consensus.cc:359] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.812101 28663 leader_election.cc:304] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:43.812829 28826 raft_consensus.cc:493] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.813369 28826 raft_consensus.cc:515] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.813889 28817 raft_consensus.cc:2804] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.814394 28817 raft_consensus.cc:697] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:43.814553 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:43.815537 28826 leader_election.cc:290] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:43.815320 28817 consensus_queue.cc:237] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.815337 28697 raft_consensus.cc:2393] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82b94f9ad924401599f0c147ac57133f in current term 1: Already voted for candidate d5f98cb9816c4d33b08ac8fb604be606 in this term.
I20260709 12:29:43.817147 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606" is_pre_election: true
I20260709 12:29:43.818027 28622 raft_consensus.cc:2393] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82b94f9ad924401599f0c147ac57133f in current term 1: Already voted for candidate 90ac18d3524d4dc2921c78de3d660fad in this term.
I20260709 12:29:43.820266 28737 leader_election.cc:304] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f; no voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:43.821748 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:43.823148 28826 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.825901 28517 catalog_manager.cc:5697] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d5f98cb9816c4d33b08ac8fb604be606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.827293 28737 leader_election.cc:304] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f; no voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:43.812158 28818 raft_consensus.cc:385] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.828557 28818 raft_consensus.cc:740] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.829281 28818 consensus_queue.cc:260] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.830013 28518 catalog_manager.cc:5697] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 0 to 1, leader changed from <none> to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 1 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.830878 28826 raft_consensus.cc:2749] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.831672 28826 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.837633 28826 raft_consensus.cc:2749] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.838909 28837 consensus_queue.cc:1048] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:43.840621 28818 ts_tablet_manager.cc:1434] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.005s
I20260709 12:29:43.841697 28818 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.848852 28818 tablet_bootstrap.cc:654] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.854704 28818 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.855192 28818 ts_tablet_manager.cc:1403] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:29:43.857924 28818 raft_consensus.cc:359] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.858570 28818 raft_consensus.cc:385] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.858861 28818 raft_consensus.cc:740] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.859616 28818 consensus_queue.cc:260] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.861660 28818 ts_tablet_manager.cc:1434] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:29:43.863852 28818 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.869335 28818 tablet_bootstrap.cc:654] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.870123 28837 consensus_queue.cc:1048] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.879722 28818 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.880125 28818 ts_tablet_manager.cc:1403] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:29:43.882153 28818 raft_consensus.cc:359] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.882691 28818 raft_consensus.cc:385] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.882913 28818 raft_consensus.cc:740] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.883528 28818 consensus_queue.cc:260] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.885375 28818 ts_tablet_manager.cc:1434] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:43.886373 28818 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f: Bootstrap starting.
I20260709 12:29:43.891757 28818 tablet_bootstrap.cc:654] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.896497 28818 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f: No bootstrap required, opened a new log
I20260709 12:29:43.896991 28818 ts_tablet_manager.cc:1403] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:29:43.899297 28818 raft_consensus.cc:359] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.899849 28818 raft_consensus.cc:385] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.900056 28818 raft_consensus.cc:740] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.900617 28818 consensus_queue.cc:260] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:43.902489 28818 ts_tablet_manager.cc:1434] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:29:43.904445 20917 ts_manager.cc:295] Set tserver state for d5f98cb9816c4d33b08ac8fb604be606 to MAINTENANCE_MODE
I20260709 12:29:43.905265 20917 tablet_server.cc:179] TabletServer@127.20.109.65:0 shutting down...
I20260709 12:29:43.906226 28837 consensus_queue.cc:1048] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.933933 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:43.936947 20917 tablet_replica.cc:333] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.937791 20917 raft_consensus.cc:2243] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:43.938560 20917 pending_rounds.cc:70] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Trying to abort 1 pending ops.
I20260709 12:29:43.938844 20917 pending_rounds.cc:77] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626352579883008 op_type: NO_OP noop_request { }
I20260709 12:29:43.939222 20917 raft_consensus.cc:2889] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:43.939062 28815 consensus_queue.cc:1048] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.939612 20917 raft_consensus.cc:2272] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.942925 20917 tablet_replica.cc:333] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.943845 20917 raft_consensus.cc:2243] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:43.944322 20917 raft_consensus.cc:2272] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.947433 20917 tablet_replica.cc:333] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.948220 20917 raft_consensus.cc:2243] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:43.948683 20917 raft_consensus.cc:2272] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.950587 20917 tablet_replica.cc:333] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.951210 20917 raft_consensus.cc:2243] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:43.951828 20917 pending_rounds.cc:70] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Trying to abort 1 pending ops.
I20260709 12:29:43.952060 20917 pending_rounds.cc:77] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626352193961984 op_type: NO_OP noop_request { }
I20260709 12:29:43.952409 20917 raft_consensus.cc:2889] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:43.952729 20917 raft_consensus.cc:2272] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.955459 20917 tablet_replica.cc:333] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.956027 20917 raft_consensus.cc:2243] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:43.956604 20917 pending_rounds.cc:70] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Trying to abort 1 pending ops.
I20260709 12:29:43.956761 20917 pending_rounds.cc:77] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626352678760448 op_type: NO_OP noop_request { }
I20260709 12:29:43.957016 20917 raft_consensus.cc:2889] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:43.957270 20917 raft_consensus.cc:2272] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.959465 20917 tablet_replica.cc:333] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.960011 20917 raft_consensus.cc:2243] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:43.960819 20917 raft_consensus.cc:2272] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.963037 20917 tablet_replica.cc:333] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.963568 20917 raft_consensus.cc:2243] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:43.963924 20917 raft_consensus.cc:2272] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.965605 20917 tablet_replica.cc:333] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.966069 20917 raft_consensus.cc:2243] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:43.966403 20917 raft_consensus.cc:2272] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.968003 20917 tablet_replica.cc:333] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.968451 20917 raft_consensus.cc:2243] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:43.968773 20917 raft_consensus.cc:2272] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.970316 20917 tablet_replica.cc:333] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: stopping tablet replica
I20260709 12:29:43.970759 20917 raft_consensus.cc:2243] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:43.971494 20917 raft_consensus.cc:2272] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:43.992909 28817 consensus_queue.cc:1048] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:44.000095 20917 tablet_server.cc:196] TabletServer@127.20.109.65:0 shutdown complete.
I20260709 12:29:44.006995 28826 raft_consensus.cc:493] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.007642 28826 raft_consensus.cc:515] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:44.009758 28826 leader_election.cc:290] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:44.010838 28769 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:44.018409 28663 consensus_peers.cc:597] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:44.018711 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207193718bc944d08f549a0b3a77944c" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:44.021703 28771 raft_consensus.cc:3060] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.025240 28839 consensus_queue.cc:1048] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:44.031046 28839 consensus_queue.cc:1048] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:44.039703 28737 leader_election.cc:336] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:44.040277 28737 leader_election.cc:304] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f; no voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:44.041131 28826 raft_consensus.cc:2749] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:29:44.042363 28663 consensus_peers.cc:597] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:44.050881 28663 consensus_peers.cc:597] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:44.216398 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:44.265606 28770 raft_consensus.cc:3060] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.271054 28771 raft_consensus.cc:3060] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.272537 28817 consensus_queue.cc:1048] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:44.280025 28817 consensus_queue.cc:1048] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:44.287241 28663 consensus_peers.cc:597] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:44.297731 28663 consensus_peers.cc:597] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:45.217432 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:45.357174 28890 raft_consensus.cc:493] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5f98cb9816c4d33b08ac8fb604be606)
I20260709 12:29:45.357700 28890 raft_consensus.cc:515] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:45.359287 28890 leader_election.cc:290] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.361394 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
W20260709 12:29:45.364005 28737 leader_election.cc:336] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.364360 28737 leader_election.cc:304] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f; no voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:45.364907 28890 raft_consensus.cc:2749] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:45.374045 28817 raft_consensus.cc:493] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5f98cb9816c4d33b08ac8fb604be606)
I20260709 12:29:45.374495 28817 raft_consensus.cc:515] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:45.376066 28817 leader_election.cc:290] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:45.377086 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
I20260709 12:29:45.377717 28771 raft_consensus.cc:2468] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 1.
I20260709 12:29:45.378948 28890 raft_consensus.cc:493] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.379094 28662 leader_election.cc:304] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: 
I20260709 12:29:45.379474 28890 raft_consensus.cc:515] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
W20260709 12:29:45.380430 28663 leader_election.cc:336] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.381480 28890 leader_election.cc:290] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.381573 28889 raft_consensus.cc:2804] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:45.382076 28889 raft_consensus.cc:493] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting leader election (detected failure of leader d5f98cb9816c4d33b08ac8fb604be606)
I20260709 12:29:45.382382 28889 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.383569 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:45.384056 28697 raft_consensus.cc:2468] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 1.
I20260709 12:29:45.385084 28737 leader_election.cc:304] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: 
W20260709 12:29:45.385876 28737 leader_election.cc:336] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.385929 28890 raft_consensus.cc:2804] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:45.386462 28890 raft_consensus.cc:493] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.386864 28890 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.389494 28889 raft_consensus.cc:515] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:45.391357 28889 leader_election.cc:290] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:45.392390 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:45.392863 28771 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.392768 28890 raft_consensus.cc:515] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.394202 28890 leader_election.cc:290] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.396507 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:45.397137 28697 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:45.398051 28663 leader_election.cc:336] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
W20260709 12:29:45.398906 28737 leader_election.cc:336] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.399370 28771 raft_consensus.cc:2468] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 2.
I20260709 12:29:45.400595 28662 leader_election.cc:304] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:45.401574 28889 raft_consensus.cc:2804] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.401968 28889 raft_consensus.cc:697] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 2 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:45.402667 28889 consensus_queue.cc:237] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:45.404083 28697 raft_consensus.cc:2468] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:45.405534 28737 leader_election.cc:304] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:45.406404 28890 raft_consensus.cc:2804] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.407788 28890 raft_consensus.cc:697] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:45.408587 28890 consensus_queue.cc:237] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.411578 28518 catalog_manager.cc:5697] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 1 to 2, leader changed from d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65) to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 2 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:45.416410 28517 catalog_manager.cc:5697] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 1 to 2, leader changed from d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:45.438990 28889 raft_consensus.cc:493] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5f98cb9816c4d33b08ac8fb604be606)
I20260709 12:29:45.439450 28889 raft_consensus.cc:515] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.441191 28889 leader_election.cc:290] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:45.442263 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82b94f9ad924401599f0c147ac57133f" is_pre_election: true
W20260709 12:29:45.444584 28663 leader_election.cc:336] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.444857 28890 raft_consensus.cc:493] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5f98cb9816c4d33b08ac8fb604be606)
I20260709 12:29:45.444998 28663 leader_election.cc:304] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad; no voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:45.445451 28890 raft_consensus.cc:515] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.445683 28889 raft_consensus.cc:2749] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:45.447072 28890 leader_election.cc:290] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.448414 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:45.448935 28697 raft_consensus.cc:2468] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 1.
I20260709 12:29:45.449848 28737 leader_election.cc:304] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: 
I20260709 12:29:45.450582 28890 raft_consensus.cc:2804] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:29:45.450624 28737 leader_election.cc:336] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.450942 28890 raft_consensus.cc:493] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d5f98cb9816c4d33b08ac8fb604be606)
I20260709 12:29:45.451287 28890 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.456364 28890 raft_consensus.cc:515] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.458477 28890 leader_election.cc:290] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.460295 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:45.460872 28697 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:45.462428 28737 leader_election.cc:336] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.466408 28697 raft_consensus.cc:2468] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:45.467605 28737 leader_election.cc:304] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:45.468312 28890 raft_consensus.cc:2804] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.468711 28890 raft_consensus.cc:697] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:45.469439 28890 consensus_queue.cc:237] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.471000 28894 raft_consensus.cc:493] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.471444 28894 raft_consensus.cc:515] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.473614 28894 leader_election.cc:290] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.475785 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:45.476413 28697 raft_consensus.cc:2468] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 1.
I20260709 12:29:45.477377 28737 leader_election.cc:304] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: 
I20260709 12:29:45.478086 28894 raft_consensus.cc:2804] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:29:45.478178 28737 leader_election.cc:336] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.478431 28894 raft_consensus.cc:493] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.478979 28894 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.478155 28517 catalog_manager.cc:5697] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 1 to 2, leader changed from d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:45.485354 28894 raft_consensus.cc:515] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.487108 28894 leader_election.cc:290] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.488619 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:45.489209 28697 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:45.490509 28737 leader_election.cc:336] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.494661 28697 raft_consensus.cc:2468] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:45.495621 28737 leader_election.cc:304] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:45.496263 28894 raft_consensus.cc:2804] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.496652 28894 raft_consensus.cc:697] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:45.497419 28894 consensus_queue.cc:237] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.505024 28517 catalog_manager.cc:5697] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 1 to 2, leader changed from d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:45.711057 28894 raft_consensus.cc:493] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.711548 28894 raft_consensus.cc:515] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.713157 28894 leader_election.cc:290] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.714768 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad" is_pre_election: true
I20260709 12:29:45.715420 28697 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 1.
I20260709 12:29:45.716382 28737 leader_election.cc:304] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: 
I20260709 12:29:45.716988 28894 raft_consensus.cc:2804] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:29:45.717017 28737 leader_election.cc:336] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.717401 28894 raft_consensus.cc:493] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.717722 28894 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.722885 28894 raft_consensus.cc:515] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.724500 28894 leader_election.cc:290] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:45.726058 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:45.726679 28697 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:45.728420 28737 leader_election.cc:336] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111)
I20260709 12:29:45.732452 28697 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:45.733542 28737 leader_election.cc:304] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:45.734228 28894 raft_consensus.cc:2804] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.734578 28894 raft_consensus.cc:697] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:45.735373 28894 consensus_queue.cc:237] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:45.742267 28517 catalog_manager.cc:5697] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 1 to 2, leader changed from d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:45.862309 28771 raft_consensus.cc:1275] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:45.863569 28889 consensus_queue.cc:1048] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:45.884677 28663 consensus_peers.cc:597] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:45.897576 28737 consensus_peers.cc:597] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:45.935389 28737 consensus_peers.cc:597] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:45.957561 28697 raft_consensus.cc:1275] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:45.957810 28696 raft_consensus.cc:1275] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:45.958906 28890 consensus_queue.cc:1048] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:45.959167 28894 consensus_queue.cc:1048] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.987093 28696 raft_consensus.cc:1275] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:45.988339 28894 consensus_queue.cc:1048] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:46.001206 28737 consensus_peers.cc:597] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:46.218961 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:46.231842 28696 raft_consensus.cc:1275] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:46.239670 28910 consensus_queue.cc:1048] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:29:46.263028 28663 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111) [suppressed 40 similar messages]
W20260709 12:29:46.634536 28737 consensus_peers.cc:597] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:46.640668 28663 consensus_peers.cc:597] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:46.641535 28663 consensus_peers.cc:597] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:46.674283 28663 consensus_peers.cc:597] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:46.717296 28663 consensus_peers.cc:597] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:47.142155 28663 consensus_peers.cc:597] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:47.220151 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:29:47.305476 28551 debug-util.cc:398] Leaking SignalData structure 0x7b080003dec0 after lost signal to thread 20920
W20260709 12:29:47.306767 28551 debug-util.cc:398] Leaking SignalData structure 0x7b0800030ea0 after lost signal to thread 28554
W20260709 12:29:47.308000 28551 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd660 after lost signal to thread 28721
W20260709 12:29:47.309064 28551 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3420 after lost signal to thread 28795
W20260709 12:29:48.221203 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:29:48.516702 28737 consensus_peers.cc:597] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:48.606914 28737 consensus_peers.cc:597] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:48.609524 28663 consensus_peers.cc:597] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:48.719745 28737 consensus_peers.cc:597] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:48.967092 28737 consensus_peers.cc:597] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:49.011680 28663 consensus_peers.cc:597] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:49.175515 28663 consensus_peers.cc:597] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:49.215960 28663 consensus_peers.cc:597] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:49.222235 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:29:49.239934 28663 consensus_peers.cc:597] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:49.303699 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:49.309991 28924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:49.311993 28925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:49.315589 28927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:49.315837 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:49.317032 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:49.317247 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:49.317421 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600189317402 us; error 0 us; skew 500 ppm
I20260709 12:29:49.318053 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:49.320832 20917 webserver.cc:533] Webserver started at http://127.20.109.65:43729/ using document root <none> and password file <none>
I20260709 12:29:49.321311 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:49.321477 20917 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:29:49.325278 20917 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:29:49.329152 28932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:49.330016 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:29:49.330315 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "d5f98cb9816c4d33b08ac8fb604be606"
format_stamp: "Formatted at 2026-07-09 12:29:42 on dist-test-slave-sc4p"
I20260709 12:29:49.330626 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:49.347299 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:49.348492 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:49.350078 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:49.353991 28939 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:29:49.406703 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:29:49.406981 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.003s	sys 0.000s
I20260709 12:29:49.407258 20917 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:29:49.411707 28939 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.427433 28939 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:29:49.428437 28939 tablet_bootstrap.cc:492] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.429078 28939 ts_tablet_manager.cc:1403] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 12:29:49.431753 28939 raft_consensus.cc:359] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.432760 28939 raft_consensus.cc:740] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.433514 28939 consensus_queue.cc:260] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.436264 28939 ts_tablet_manager.cc:1434] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 12:29:49.437134 28939 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.450372 28939 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:49.451248 28939 tablet_bootstrap.cc:492] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.451918 28939 ts_tablet_manager.cc:1403] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:29:49.454460 28939 raft_consensus.cc:359] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.455201 28939 raft_consensus.cc:740] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.455874 28939 consensus_queue.cc:260] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.457814 28939 ts_tablet_manager.cc:1434] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:49.458621 28939 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.460932 20917 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:29:49.461282 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.054s	user 0.051s	sys 0.000s
I20260709 12:29:49.473811 28939 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:49.474922 28939 tablet_bootstrap.cc:492] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.475757 28939 ts_tablet_manager.cc:1403] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 12:29:49.481611 28939 raft_consensus.cc:359] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.483664 28939 raft_consensus.cc:740] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.484673 28939 consensus_queue.cc:260] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.487107 28939 ts_tablet_manager.cc:1434] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:29:49.488759 28939 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.504127 28939 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:49.505365 28939 tablet_bootstrap.cc:492] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.506064 28939 ts_tablet_manager.cc:1403] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:29:49.508481 28939 raft_consensus.cc:359] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:49.509173 28939 raft_consensus.cc:740] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.509857 28939 consensus_queue.cc:260] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:49.512463 28939 ts_tablet_manager.cc:1434] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:49.513327 28939 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.535115 28939 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:29:49.536250 28939 tablet_bootstrap.cc:492] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.536962 28939 ts_tablet_manager.cc:1403] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 12:29:49.539530 28939 raft_consensus.cc:359] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.540457 28939 raft_consensus.cc:740] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.541253 28939 consensus_queue.cc:260] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.543327 28939 ts_tablet_manager.cc:1434] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:49.544078 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:46559
I20260709 12:29:49.544232 28939 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.544206 29001 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:46559 every 8 connection(s)
I20260709 12:29:49.573838 28939 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:49.575004 28939 tablet_bootstrap.cc:492] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.575825 28939 ts_tablet_manager.cc:1403] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.015s
I20260709 12:29:49.578899 28939 raft_consensus.cc:359] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.579751 28939 raft_consensus.cc:740] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.580789 28939 consensus_queue.cc:260] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.584071 28939 ts_tablet_manager.cc:1434] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:49.584363 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:49.592954 29002 heartbeater.cc:344] Connected to a master server at 127.20.109.126:37423
I20260709 12:29:49.594238 29002 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:49.595254 29002 heartbeater.cc:507] Master 127.20.109.126:37423 requested a full tablet report, sending...
I20260709 12:29:49.601962 28517 ts_manager.cc:194] Re-registered known tserver with Master: d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559)
I20260709 12:29:49.613963 28517 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60874
I20260709 12:29:49.592152 28939 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.618290 29002 heartbeater.cc:499] Master 127.20.109.126:37423 was elected leader, sending a full tablet report...
I20260709 12:29:49.635600 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
mode: GRACEFUL
new_leader_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:35500
I20260709 12:29:49.636332 28697 raft_consensus.cc:606] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Received request to transfer leadership to TS 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:49.637126 28939 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:29:49.638121 28939 tablet_bootstrap.cc:492] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.638949 28939 ts_tablet_manager.cc:1403] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.004s
I20260709 12:29:49.640262 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
mode: GRACEFUL
new_leader_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:35500
I20260709 12:29:49.640938 28697 raft_consensus.cc:606] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Received request to transfer leadership to TS 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:49.641595 28939 raft_consensus.cc:359] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.642450 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:49.642561 28939 raft_consensus.cc:740] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.643265 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:49.643563 28913 raft_consensus.cc:993] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad: : Instructing follower 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:49.643532 28939 consensus_queue.cc:260] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.644199 28913 raft_consensus.cc:1081] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Signalling peer 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:49.646000 28939 ts_tablet_manager.cc:1434] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:49.644207 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:49.646929 28939 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.646030 28771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:33258
I20260709 12:29:49.649155 28771 raft_consensus.cc:493] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:49.649513 28771 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.671093 28976 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.671412 28771 raft_consensus.cc:515] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.678578 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:49.679189 28697 raft_consensus.cc:3055] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:49.679492 28697 raft_consensus.cc:740] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:49.680006 28976 pending_rounds.cc:85] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Aborting all ops after (but not including) 0
I20260709 12:29:49.680403 28976 pending_rounds.cc:107] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:29:49.680716 28976 raft_consensus.cc:2889] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:49.680837 28975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
W20260709 12:29:49.682543 28737 leader_election.cc:343] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:49.680266 28697 consensus_queue.cc:260] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.683593 28939 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:49.683595 28697 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.684616 28939 tablet_bootstrap.cc:492] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.685016 28771 leader_election.cc:290] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:49.685350 28939 ts_tablet_manager.cc:1403] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.007s
I20260709 12:29:49.688362 28939 raft_consensus.cc:359] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.689055 28939 raft_consensus.cc:740] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.689826 28939 consensus_queue.cc:260] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.691956 28939 ts_tablet_manager.cc:1434] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:49.692900 28939 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.697129 28697 raft_consensus.cc:2468] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:49.703871 28737 leader_election.cc:304] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, 90ac18d3524d4dc2921c78de3d660fad; no voters: d5f98cb9816c4d33b08ac8fb604be606
I20260709 12:29:49.705163 28921 raft_consensus.cc:2804] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:49.734815 28921 raft_consensus.cc:697] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:49.735882 28921 consensus_queue.cc:237] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.753911 28939 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:49.755043 28939 tablet_bootstrap.cc:492] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.755776 28939 ts_tablet_manager.cc:1403] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.038s
I20260709 12:29:49.758118 28939 raft_consensus.cc:359] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.757642 28518 catalog_manager.cc:5697] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 1 to 2, leader changed from 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:49.758991 28939 raft_consensus.cc:740] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.759862 28939 consensus_queue.cc:260] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.761839 28939 ts_tablet_manager.cc:1434] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:49.762699 28939 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap starting.
I20260709 12:29:49.783481 28939 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:49.784405 28939 tablet_bootstrap.cc:492] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Bootstrap complete.
I20260709 12:29:49.785068 28939 ts_tablet_manager.cc:1403] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:29:49.787511 28939 raft_consensus.cc:359] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.788139 28939 raft_consensus.cc:740] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f98cb9816c4d33b08ac8fb604be606, State: Initialized, Role: FOLLOWER
I20260709 12:29:49.788754 28939 consensus_queue.cc:260] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.790655 28939 ts_tablet_manager.cc:1434] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:29:49.931546 28913 raft_consensus.cc:993] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad: : Instructing follower 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:49.932026 28923 raft_consensus.cc:1081] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Signalling peer 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:49.933545 28771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:33258
I20260709 12:29:49.933997 28771 raft_consensus.cc:493] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:49.934269 28771 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.939467 28771 raft_consensus.cc:515] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.941116 28771 leader_election.cc:290] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:49.942062 28975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:49.942338 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:49.942788 28975 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.943034 28697 raft_consensus.cc:3055] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:49.943416 28697 raft_consensus.cc:740] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:49.944226 28697 consensus_queue.cc:260] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.945552 28697 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.948295 28975 raft_consensus.cc:2468] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:49.949402 28737 leader_election.cc:304] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:49.950162 28921 raft_consensus.cc:2804] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:49.950654 28921 raft_consensus.cc:697] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:49.951462 28921 consensus_queue.cc:237] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:49.953399 28697 raft_consensus.cc:2468] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:49.959656 28518 catalog_manager.cc:5697] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 1 to 2, leader changed from 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:50.019860 28975 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:50.027699 28976 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:50.035138 28976 pending_rounds.cc:85] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Aborting all ops after (but not including) 0
I20260709 12:29:50.035383 28976 pending_rounds.cc:107] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:29:50.035624 28976 raft_consensus.cc:2889] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:50.066534 28976 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:50.128204 28976 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:50.133862 28976 pending_rounds.cc:85] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Aborting all ops after (but not including) 0
I20260709 12:29:50.134369 28976 pending_rounds.cc:107] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:29:50.134671 28976 raft_consensus.cc:2889] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:50.159238 28697 raft_consensus.cc:1275] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:50.160532 28921 consensus_queue.cc:1048] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:50.174327 28976 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:50.180788 28976 raft_consensus.cc:1275] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:50.181895 29019 consensus_queue.cc:1048] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:50.223454 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:50.431821 28697 raft_consensus.cc:1275] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:50.433506 29019 consensus_queue.cc:1048] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:50.443993 28976 raft_consensus.cc:1275] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:50.445490 28921 consensus_queue.cc:1048] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:50.676334 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:50.696189 28771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
mode: GRACEFUL
new_leader_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:59142
I20260709 12:29:50.696857 28771 raft_consensus.cc:606] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Received request to transfer leadership to TS 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:50.699468 28771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
mode: GRACEFUL
new_leader_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:59142
I20260709 12:29:50.699934 28771 raft_consensus.cc:606] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Received request to transfer leadership to TS 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:50.702570 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
mode: GRACEFUL
new_leader_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:35500
I20260709 12:29:50.703058 28697 raft_consensus.cc:606] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Received request to transfer leadership to TS 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:50.704293 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:29:50.704746 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:50.705466 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:50.778045 29017 raft_consensus.cc:993] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f: : Instructing follower 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:50.778650 29039 raft_consensus.cc:1081] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Signalling peer 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:50.780149 28697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:38642
I20260709 12:29:50.780676 28697 raft_consensus.cc:493] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:50.780985 28697 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:50.788671 28697 raft_consensus.cc:515] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:50.790280 28697 leader_election.cc:290] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:50.791406 28974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:50.791524 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:50.792289 28974 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:50.792407 28771 raft_consensus.cc:3055] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:50.792781 28771 raft_consensus.cc:740] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:50.793634 28771 consensus_queue.cc:260] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:50.794849 28771 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:50.798765 28974 raft_consensus.cc:2468] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:50.800151 28663 leader_election.cc:304] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:50.801002 29031 raft_consensus.cc:2804] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:50.801482 29031 raft_consensus.cc:697] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:50.801677 28771 raft_consensus.cc:2468] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:50.802675 29031 consensus_queue.cc:237] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:50.810585 28518 catalog_manager.cc:5697] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 2 to 3, leader changed from 82b94f9ad924401599f0c147ac57133f (127.20.109.67) to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 3 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:51.119083 29031 raft_consensus.cc:993] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad: : Instructing follower 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:51.119611 28923 raft_consensus.cc:1081] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Signalling peer 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:51.120998 28771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:33258
I20260709 12:29:51.121407 28771 raft_consensus.cc:493] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:51.121678 28771 raft_consensus.cc:3060] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:51.128274 29017 raft_consensus.cc:993] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f: : Instructing follower 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:51.128240 28771 raft_consensus.cc:515] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.128767 29017 raft_consensus.cc:1081] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Signalling peer 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:51.129887 28771 leader_election.cc:290] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:51.130199 28697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:38642
I20260709 12:29:51.130729 28974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:51.130883 28697 raft_consensus.cc:493] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:51.131273 28696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7eee75d8ec439dafb7cc34db6c5b96" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:51.131439 28697 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:51.131453 28974 raft_consensus.cc:3060] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:51.131999 28696 raft_consensus.cc:3055] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:51.132490 28696 raft_consensus.cc:740] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:51.133437 28696 consensus_queue.cc:260] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.134819 28696 raft_consensus.cc:3060] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:51.139915 28697 raft_consensus.cc:515] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.141041 28974 raft_consensus.cc:2468] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:51.142506 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:51.142633 28974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:51.142527 28737 leader_election.cc:304] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:51.143128 28771 raft_consensus.cc:3055] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:51.143429 28697 leader_election.cc:290] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:51.143556 28771 raft_consensus.cc:740] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:51.143924 28696 raft_consensus.cc:2468] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:51.143508 28974 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:51.144699 28771 consensus_queue.cc:260] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.146167 28771 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:51.147233 29039 raft_consensus.cc:2804] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:51.147992 29039 raft_consensus.cc:697] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:51.149037 29039 consensus_queue.cc:237] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.153043 28974 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:51.153857 28771 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:51.154300 28663 leader_election.cc:304] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:51.155270 28923 raft_consensus.cc:2804] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:51.155716 28923 raft_consensus.cc:697] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:51.156705 28923 consensus_queue.cc:237] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.161619 28518 catalog_manager.cc:5697] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 1 to 2, leader changed from 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:51.167436 28517 catalog_manager.cc:5697] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 2 to 3, leader changed from 82b94f9ad924401599f0c147ac57133f (127.20.109.67) to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 3 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:51.224516 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:51.370208 28771 raft_consensus.cc:1275] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:51.371502 28923 consensus_queue.cc:1048] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:51.383124 28974 raft_consensus.cc:1275] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:51.384876 29050 consensus_queue.cc:1048] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:51.596076 28974 raft_consensus.cc:1275] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:51.597472 29039 consensus_queue.cc:1048] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:51.607281 28696 raft_consensus.cc:1275] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:51.608932 29056 consensus_queue.cc:1048] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:51.711841 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:51.719322 28696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
mode: GRACEFUL
new_leader_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:35500
I20260709 12:29:51.719815 28696 raft_consensus.cc:606] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Received request to transfer leadership to TS 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:51.722244 28696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
mode: GRACEFUL
new_leader_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:35500
I20260709 12:29:51.723270 28696 raft_consensus.cc:606] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 2 LEADER]: Received request to transfer leadership to TS 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:51.725710 28771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
mode: GRACEFUL
new_leader_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:59142
I20260709 12:29:51.726173 28771 raft_consensus.cc:606] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Received request to transfer leadership to TS 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:51.727339 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:29:51.727795 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:51.728310 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:51.758831 28771 raft_consensus.cc:1275] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:51.760095 28923 consensus_queue.cc:1048] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:51.769091 28976 raft_consensus.cc:1275] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:51.770943 29050 consensus_queue.cc:1048] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:51.788375 29050 raft_consensus.cc:993] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad: : Instructing follower 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:51.788805 28923 raft_consensus.cc:1081] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Signalling peer 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:51.790107 28771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:33258
I20260709 12:29:51.790546 28771 raft_consensus.cc:493] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:51.790832 28771 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:51.795722 28771 raft_consensus.cc:515] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.797123 28771 leader_election.cc:290] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 4 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:51.798134 28975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:51.798187 28696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3544ec3203ec465d8c5b8c48e0d0cb50" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:51.798731 28975 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:51.798800 28696 raft_consensus.cc:3055] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:51.799177 28696 raft_consensus.cc:740] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:51.799804 28696 consensus_queue.cc:260] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.800715 28696 raft_consensus.cc:3060] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:51.804823 28975 raft_consensus.cc:2468] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 4.
I20260709 12:29:51.806011 28696 raft_consensus.cc:2468] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 4.
I20260709 12:29:51.806047 28737 leader_election.cc:304] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:51.807016 29056 raft_consensus.cc:2804] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:51.807482 29056 raft_consensus.cc:697] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 4 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:51.808176 29056 consensus_queue.cc:237] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:51.814493 28517 catalog_manager.cc:5697] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 3 to 4, leader changed from 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 4 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:51.991567 29017 raft_consensus.cc:993] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f: : Instructing follower 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:51.992045 29056 raft_consensus.cc:1081] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Signalling peer 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:51.993595 28696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:38642
I20260709 12:29:51.994091 28696 raft_consensus.cc:493] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:51.994383 28696 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.000087 28696 raft_consensus.cc:515] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:52.001822 28696 leader_election.cc:290] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:52.002864 28975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:52.003132 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:52.003588 28975 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.003647 28771 raft_consensus.cc:3055] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:52.004004 28771 raft_consensus.cc:740] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:52.004688 28771 consensus_queue.cc:260] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:52.005609 28771 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.009045 28975 raft_consensus.cc:2468] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:52.010172 28663 leader_election.cc:304] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:52.011034 28771 raft_consensus.cc:2468] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:52.011149 28923 raft_consensus.cc:2804] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:52.011679 28923 raft_consensus.cc:697] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:52.012562 28923 consensus_queue.cc:237] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:52.019533 28517 catalog_manager.cc:5697] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 2 to 3, leader changed from 82b94f9ad924401599f0c147ac57133f (127.20.109.67) to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 3 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:52.056986 29050 raft_consensus.cc:993] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad: : Instructing follower 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:52.057410 28923 raft_consensus.cc:1081] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 2 LEADER]: Signalling peer 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:52.058761 28771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:33258
I20260709 12:29:52.059167 28771 raft_consensus.cc:493] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:52.059434 28771 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.063921 28771 raft_consensus.cc:515] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:52.065315 28771 leader_election.cc:290] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 3 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:52.065941 28975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:52.066367 28696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bed1cd94e04ae8ada2500662d0604c" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:52.066498 28975 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.066936 28696 raft_consensus.cc:3055] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:52.067212 28696 raft_consensus.cc:740] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:52.067919 28696 consensus_queue.cc:260] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:52.068917 28696 raft_consensus.cc:3060] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.071622 28975 raft_consensus.cc:2468] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 3.
I20260709 12:29:52.072590 28737 leader_election.cc:304] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:52.073335 29056 raft_consensus.cc:2804] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:52.073736 29056 raft_consensus.cc:697] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 3 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:52.073983 28696 raft_consensus.cc:2468] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 3.
I20260709 12:29:52.074565 29056 consensus_queue.cc:237] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } }
I20260709 12:29:52.082275 28517 catalog_manager.cc:5697] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 2 to 3, leader changed from 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 3 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:52.204892 28975 raft_consensus.cc:1275] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:52.206156 29056 consensus_queue.cc:1048] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:52.213173 28696 raft_consensus.cc:1275] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:52.216454 29056 consensus_queue.cc:1048] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:29:52.225409 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:52.495452 28771 raft_consensus.cc:1275] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:52.496934 29059 consensus_queue.cc:1048] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:52.505942 28975 raft_consensus.cc:1275] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:52.508056 28923 consensus_queue.cc:1048] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:52.657825 28696 raft_consensus.cc:1275] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:52.659003 29056 consensus_queue.cc:1048] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:52.670930 28975 raft_consensus.cc:1275] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:52.673183 29039 consensus_queue.cc:1048] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:52.734730 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:52.741685 28696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
mode: GRACEFUL
new_leader_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:35500
I20260709 12:29:52.742216 28696 raft_consensus.cc:606] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Received request to transfer leadership to TS 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:52.744714 28771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
mode: GRACEFUL
new_leader_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:59142
I20260709 12:29:52.745239 28771 raft_consensus.cc:606] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Received request to transfer leadership to TS 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:52.747931 28771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
mode: GRACEFUL
new_leader_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:59142
I20260709 12:29:52.748612 28771 raft_consensus.cc:606] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Received request to transfer leadership to TS 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:52.749711 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:29:52.750211 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:52.750782 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:52.891381 29039 raft_consensus.cc:993] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f: : Instructing follower 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:52.891894 29017 raft_consensus.cc:1081] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Signalling peer 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:52.893266 28696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:38642
I20260709 12:29:52.893704 28696 raft_consensus.cc:493] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:52.893957 28696 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.899093 28696 raft_consensus.cc:515] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:52.900666 28696 leader_election.cc:290] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:52.901504 28975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:52.901754 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dca7ef2e7894e1cb821a5e9d4411d24" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:52.902199 28975 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.902274 28771 raft_consensus.cc:3055] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:52.902690 28771 raft_consensus.cc:740] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:52.903514 28771 consensus_queue.cc:260] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:52.904742 28771 raft_consensus.cc:3060] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:52.909327 28975 raft_consensus.cc:2468] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:52.910545 28663 leader_election.cc:304] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:52.910979 28771 raft_consensus.cc:2468] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:52.911247 28923 raft_consensus.cc:2804] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:52.911761 28923 raft_consensus.cc:697] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:52.912678 28923 consensus_queue.cc:237] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:52.919657 28520 catalog_manager.cc:5697] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 2 to 3, leader changed from 82b94f9ad924401599f0c147ac57133f (127.20.109.67) to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 3 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:53.226274 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:53.265638 29075 raft_consensus.cc:993] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f: : Instructing follower 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:53.266170 29039 raft_consensus.cc:1081] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Signalling peer 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:53.267688 28696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:38642
I20260709 12:29:53.268163 28696 raft_consensus.cc:493] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:53.268450 28696 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:53.274537 28696 raft_consensus.cc:515] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.276212 28696 leader_election.cc:290] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:53.276899 28975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:53.277201 28771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0948271dba74025b360f84f8bb97c3a" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:53.277572 28975 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:53.277729 28771 raft_consensus.cc:3055] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:53.278084 28771 raft_consensus.cc:740] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:53.278927 28771 consensus_queue.cc:260] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.280200 28771 raft_consensus.cc:3060] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:53.284968 28975 raft_consensus.cc:2468] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:53.286194 28663 leader_election.cc:304] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:53.286356 29031 raft_consensus.cc:993] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad: : Instructing follower 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:53.286975 29074 raft_consensus.cc:1081] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Signalling peer 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:53.287086 29031 raft_consensus.cc:2804] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:53.287252 28771 raft_consensus.cc:2468] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:53.287611 29031 raft_consensus.cc:697] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:53.289000 29031 consensus_queue.cc:237] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.289422 28771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:33258
I20260709 12:29:53.289928 28771 raft_consensus.cc:493] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:53.290181 28771 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:53.295847 28771 raft_consensus.cc:515] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.295954 28520 catalog_manager.cc:5697] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 2 to 3, leader changed from 82b94f9ad924401599f0c147ac57133f (127.20.109.67) to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 3 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:53.297394 28771 leader_election.cc:290] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 4 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:53.298131 28975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:53.298820 28975 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:53.298810 28696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ac61fc69f048dcb4c37d7908f76e4e" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:53.299579 28696 raft_consensus.cc:3055] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:53.299894 28696 raft_consensus.cc:740] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:53.300725 28696 consensus_queue.cc:260] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.301939 28696 raft_consensus.cc:3060] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:53.306142 28975 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 4.
I20260709 12:29:53.307308 28737 leader_election.cc:304] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:53.308070 29039 raft_consensus.cc:2804] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:53.308478 29039 raft_consensus.cc:697] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 4 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:53.308905 28696 raft_consensus.cc:2468] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 4.
I20260709 12:29:53.309186 29039 consensus_queue.cc:237] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.316781 28520 catalog_manager.cc:5697] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 3 to 4, leader changed from 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 4 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:53.390406 28771 raft_consensus.cc:1275] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:53.391661 29031 consensus_queue.cc:1048] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:53.395730 28975 raft_consensus.cc:1275] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:53.397183 28923 consensus_queue.cc:1048] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:53.757087 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:53.764060 28696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207193718bc944d08f549a0b3a77944c"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
mode: GRACEFUL
new_leader_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:35500
I20260709 12:29:53.764628 28696 raft_consensus.cc:606] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Received request to transfer leadership to TS 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:53.767071 28770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
mode: GRACEFUL
new_leader_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:59142
I20260709 12:29:53.767537 28770 raft_consensus.cc:606] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Received request to transfer leadership to TS 90ac18d3524d4dc2921c78de3d660fad
I20260709 12:29:53.769891 28696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
mode: GRACEFUL
new_leader_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:35500
I20260709 12:29:53.770355 28696 raft_consensus.cc:606] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Received request to transfer leadership to TS 82b94f9ad924401599f0c147ac57133f
I20260709 12:29:53.771337 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:29:53.771792 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:53.772344 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:53.827052 28975 raft_consensus.cc:1275] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:53.828768 29039 consensus_queue.cc:1048] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:53.838977 28696 raft_consensus.cc:1275] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:53.840631 29086 consensus_queue.cc:1048] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:53.855381 29074 raft_consensus.cc:993] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad: : Instructing follower 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:53.855840 28923 raft_consensus.cc:1081] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Signalling peer 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:53.857451 28770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "207193718bc944d08f549a0b3a77944c"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:33258
I20260709 12:29:53.858112 28770 raft_consensus.cc:493] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:53.858440 28770 raft_consensus.cc:3060] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.861804 28975 raft_consensus.cc:1275] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:53.863202 28923 consensus_queue.cc:1048] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:53.866474 28770 raft_consensus.cc:515] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.868839 28770 leader_election.cc:290] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:53.869503 28976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207193718bc944d08f549a0b3a77944c" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:53.870293 28976 raft_consensus.cc:3060] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.870309 28696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207193718bc944d08f549a0b3a77944c" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:53.870991 28696 raft_consensus.cc:3055] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:53.871322 28696 raft_consensus.cc:740] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:53.872206 28696 consensus_queue.cc:260] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.873329 28696 raft_consensus.cc:3060] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.875790 28771 raft_consensus.cc:1275] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:53.878279 29031 consensus_queue.cc:1048] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:53.886247 28976 raft_consensus.cc:2468] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:53.887702 28737 leader_election.cc:304] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:53.888574 29086 raft_consensus.cc:2804] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.889073 29086 raft_consensus.cc:697] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:53.890065 29086 consensus_queue.cc:237] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.894757 28696 raft_consensus.cc:2468] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 2.
I20260709 12:29:53.903092 29039 raft_consensus.cc:993] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f: : Instructing follower 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:53.903544 29092 raft_consensus.cc:1081] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Signalling peer 90ac18d3524d4dc2921c78de3d660fad to start an election
I20260709 12:29:53.905009 28696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06"
dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
 from {username='slave'} at 127.0.0.1:38642
I20260709 12:29:53.905459 28696 raft_consensus.cc:493] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:53.905820 28696 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:53.909710 28517 catalog_manager.cc:5697] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 1 to 2, leader changed from 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 2 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:53.910856 28696 raft_consensus.cc:515] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.913038 28696 leader_election.cc:290] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 82b94f9ad924401599f0c147ac57133f (127.20.109.67:40253)
I20260709 12:29:53.913293 28976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:53.913599 28770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5abfe93d1004f509ef9a17b27c38a06" candidate_uuid: "90ac18d3524d4dc2921c78de3d660fad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "82b94f9ad924401599f0c147ac57133f"
I20260709 12:29:53.913936 28976 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:53.914222 28770 raft_consensus.cc:3055] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:53.914534 28770 raft_consensus.cc:740] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:53.915386 28770 consensus_queue.cc:260] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.916621 28770 raft_consensus.cc:3060] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:53.921063 28976 raft_consensus.cc:2468] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:53.922653 28663 leader_election.cc:304] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90ac18d3524d4dc2921c78de3d660fad, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:53.923560 29089 raft_consensus.cc:2804] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:53.924019 29089 raft_consensus.cc:697] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Leader. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:53.923833 28770 raft_consensus.cc:2468] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90ac18d3524d4dc2921c78de3d660fad in term 3.
I20260709 12:29:53.925072 29089 consensus_queue.cc:237] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:53.931754 28517 catalog_manager.cc:5697] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad reported cstate change: term changed from 2 to 3, leader changed from 82b94f9ad924401599f0c147ac57133f (127.20.109.67) to 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66). New cstate: current_term: 3 leader_uuid: "90ac18d3524d4dc2921c78de3d660fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:54.008978 29031 raft_consensus.cc:993] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad: : Instructing follower 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:54.009445 29089 raft_consensus.cc:1081] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Signalling peer 82b94f9ad924401599f0c147ac57133f to start an election
I20260709 12:29:54.010864 28770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4"
dest_uuid: "82b94f9ad924401599f0c147ac57133f"
 from {username='slave'} at 127.0.0.1:33258
I20260709 12:29:54.011343 28770 raft_consensus.cc:493] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:54.011641 28770 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:54.017092 28770 raft_consensus.cc:515] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:54.018923 28770 leader_election.cc:290] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 4 election: Requested vote from peers d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559), 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037)
I20260709 12:29:54.019745 28976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d5f98cb9816c4d33b08ac8fb604be606"
I20260709 12:29:54.019955 28696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef5216da1ea44987b5eea6f25d0c04c4" candidate_uuid: "82b94f9ad924401599f0c147ac57133f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "90ac18d3524d4dc2921c78de3d660fad"
I20260709 12:29:54.020440 28696 raft_consensus.cc:3055] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:54.020440 28976 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:54.020855 28696 raft_consensus.cc:740] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 90ac18d3524d4dc2921c78de3d660fad, State: Running, Role: LEADER
I20260709 12:29:54.021615 28696 consensus_queue.cc:260] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:54.022853 28696 raft_consensus.cc:3060] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:54.028085 28976 raft_consensus.cc:2468] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 4.
I20260709 12:29:54.029332 28737 leader_election.cc:304] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b94f9ad924401599f0c147ac57133f, d5f98cb9816c4d33b08ac8fb604be606; no voters: 
I20260709 12:29:54.029703 28696 raft_consensus.cc:2468] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82b94f9ad924401599f0c147ac57133f in term 4.
I20260709 12:29:54.029965 29092 raft_consensus.cc:2804] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:54.030445 29092 raft_consensus.cc:697] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 4 LEADER]: Becoming Leader. State: Replica: 82b94f9ad924401599f0c147ac57133f, State: Running, Role: LEADER
I20260709 12:29:54.031175 29092 consensus_queue.cc:237] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } }
I20260709 12:29:54.038007 28517 catalog_manager.cc:5697] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f reported cstate change: term changed from 3 to 4, leader changed from 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66) to 82b94f9ad924401599f0c147ac57133f (127.20.109.67). New cstate: current_term: 4 leader_uuid: "82b94f9ad924401599f0c147ac57133f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:54.227205 28568 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:54.294919 28976 raft_consensus.cc:1275] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:54.296317 29092 consensus_queue.cc:1048] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:54.306166 28696 raft_consensus.cc:1275] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:54.309185 29086 consensus_queue.cc:1048] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:54.383524 28770 raft_consensus.cc:1275] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:54.384831 29089 consensus_queue.cc:1048] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b94f9ad924401599f0c147ac57133f" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:54.394309 28976 raft_consensus.cc:1275] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Refusing update from remote peer 90ac18d3524d4dc2921c78de3d660fad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:54.396461 29101 consensus_queue.cc:1048] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:54.566118 28696 raft_consensus.cc:1275] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:54.567286 29086 consensus_queue.cc:1048] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ac18d3524d4dc2921c78de3d660fad" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:54.575520 28976 raft_consensus.cc:1275] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Refusing update from remote peer 82b94f9ad924401599f0c147ac57133f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:54.577289 29086 consensus_queue.cc:1048] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f98cb9816c4d33b08ac8fb604be606" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:54.778700 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:54.810212 20917 tablet_server.cc:179] TabletServer@127.20.109.65:46559 shutting down...
W20260709 12:29:54.814278 28737 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 64 similar messages]
W20260709 12:29:54.817422 28737 consensus_peers.cc:597] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:54.834477 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:54.835364 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.836221 20917 raft_consensus.cc:2243] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.836732 20917 raft_consensus.cc:2272] T f0948271dba74025b360f84f8bb97c3a P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.840193 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.840747 20917 raft_consensus.cc:2243] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.841305 20917 raft_consensus.cc:2272] T ef5216da1ea44987b5eea6f25d0c04c4 P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.845309 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.846019 20917 raft_consensus.cc:2243] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.846446 20917 raft_consensus.cc:2272] T 3544ec3203ec465d8c5b8c48e0d0cb50 P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.849007 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.849534 20917 raft_consensus.cc:2243] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.849941 20917 raft_consensus.cc:2272] T 24ac61fc69f048dcb4c37d7908f76e4e P d5f98cb9816c4d33b08ac8fb604be606 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.852362 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.852913 20917 raft_consensus.cc:2243] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.853327 20917 raft_consensus.cc:2272] T 2dca7ef2e7894e1cb821a5e9d4411d24 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.855405 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.855906 20917 raft_consensus.cc:2243] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.856288 20917 raft_consensus.cc:2272] T 90bed1cd94e04ae8ada2500662d0604c P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.858397 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.858982 20917 raft_consensus.cc:2243] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.859414 20917 raft_consensus.cc:2272] T 3d38d038e60448edb5c1780af6d12458 P d5f98cb9816c4d33b08ac8fb604be606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.861562 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.862143 20917 raft_consensus.cc:2243] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.862571 20917 raft_consensus.cc:2272] T 207193718bc944d08f549a0b3a77944c P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.865568 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.866129 20917 raft_consensus.cc:2243] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.866652 20917 raft_consensus.cc:2272] T 6d7eee75d8ec439dafb7cc34db6c5b96 P d5f98cb9816c4d33b08ac8fb604be606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.868716 20917 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:54.869185 20917 raft_consensus.cc:2243] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.869602 20917 raft_consensus.cc:2272] T c5abfe93d1004f509ef9a17b27c38a06 P d5f98cb9816c4d33b08ac8fb604be606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.902875 20917 tablet_server.cc:196] TabletServer@127.20.109.65:46559 shutdown complete.
W20260709 12:29:54.917392 28663 consensus_peers.cc:597] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:54.920677 28663 consensus_peers.cc:597] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:54.933804 20917 tablet_server.cc:179] TabletServer@127.20.109.66:0 shutting down...
W20260709 12:29:54.959784 28663 consensus_peers.cc:597] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:54.967214 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:54.967921 20917 tablet_replica.cc:333] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:54.968695 20917 raft_consensus.cc:2243] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.969156 20917 raft_consensus.cc:2272] T 24ac61fc69f048dcb4c37d7908f76e4e P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.971634 20917 tablet_replica.cc:333] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:54.972271 20917 raft_consensus.cc:2243] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:54.973045 20917 raft_consensus.cc:2272] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.975473 20917 tablet_replica.cc:333] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:54.976258 20917 raft_consensus.cc:2243] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.976774 20917 raft_consensus.cc:2272] T 90bed1cd94e04ae8ada2500662d0604c P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.979146 20917 tablet_replica.cc:333] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:54.979781 20917 raft_consensus.cc:2243] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:54.980696 20917 raft_consensus.cc:2272] T f0948271dba74025b360f84f8bb97c3a P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.983060 20917 tablet_replica.cc:333] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:54.983659 20917 raft_consensus.cc:2243] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.984110 20917 raft_consensus.cc:2272] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.986420 20917 tablet_replica.cc:333] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:54.987035 20917 raft_consensus.cc:2243] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:54.987845 20917 raft_consensus.cc:2272] T c5abfe93d1004f509ef9a17b27c38a06 P 90ac18d3524d4dc2921c78de3d660fad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.990370 20917 tablet_replica.cc:333] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:54.991089 20917 raft_consensus.cc:2243] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.991557 20917 raft_consensus.cc:2272] T 207193718bc944d08f549a0b3a77944c P 90ac18d3524d4dc2921c78de3d660fad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.994935 20917 tablet_replica.cc:333] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:54.995522 20917 raft_consensus.cc:2243] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:54.995958 20917 raft_consensus.cc:2272] T ef5216da1ea44987b5eea6f25d0c04c4 P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:54.999272 20917 tablet_replica.cc:333] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:55.000115 20917 raft_consensus.cc:2243] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:55.001102 20917 raft_consensus.cc:2272] T 3d38d038e60448edb5c1780af6d12458 P 90ac18d3524d4dc2921c78de3d660fad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.003717 20917 tablet_replica.cc:333] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad: stopping tablet replica
I20260709 12:29:55.004360 20917 raft_consensus.cc:2243] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:55.005081 20917 raft_consensus.cc:2272] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 90ac18d3524d4dc2921c78de3d660fad [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:55.009044 28737 consensus_peers.cc:597] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f -> Peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Couldn't send request to peer 90ac18d3524d4dc2921c78de3d660fad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:55.009841 28737 consensus_peers.cc:597] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f -> Peer 90ac18d3524d4dc2921c78de3d660fad (127.20.109.66:39037): Couldn't send request to peer 90ac18d3524d4dc2921c78de3d660fad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:55.040988 20917 tablet_server.cc:196] TabletServer@127.20.109.66:0 shutdown complete.
I20260709 12:29:55.068717 20917 tablet_server.cc:179] TabletServer@127.20.109.67:0 shutting down...
W20260709 12:29:55.087746 28737 consensus_peers.cc:597] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:55.104019 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:55.105223 20917 tablet_replica.cc:333] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.106236 20917 raft_consensus.cc:2243] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:55.106935 20917 raft_consensus.cc:2272] T 3d38d038e60448edb5c1780af6d12458 P 82b94f9ad924401599f0c147ac57133f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.109578 20917 tablet_replica.cc:333] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.110281 20917 raft_consensus.cc:2243] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:55.110795 20917 raft_consensus.cc:2272] T f0948271dba74025b360f84f8bb97c3a P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.113001 20917 tablet_replica.cc:333] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.113818 20917 raft_consensus.cc:2243] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:55.114926 20917 raft_consensus.cc:2272] T 3544ec3203ec465d8c5b8c48e0d0cb50 P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.117825 20917 tablet_replica.cc:333] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
W20260709 12:29:55.118531 28737 consensus_peers.cc:597] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f -> Peer d5f98cb9816c4d33b08ac8fb604be606 (127.20.109.65:46559): Couldn't send request to peer d5f98cb9816c4d33b08ac8fb604be606. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:46559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:55.118709 20917 raft_consensus.cc:2243] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:55.119627 20917 raft_consensus.cc:2272] T ef5216da1ea44987b5eea6f25d0c04c4 P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.122157 20917 tablet_replica.cc:333] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.122830 20917 raft_consensus.cc:2243] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:55.123281 20917 raft_consensus.cc:2272] T 2dca7ef2e7894e1cb821a5e9d4411d24 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.125331 20917 tablet_replica.cc:333] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.125886 20917 raft_consensus.cc:2243] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:55.126704 20917 raft_consensus.cc:2272] T 24ac61fc69f048dcb4c37d7908f76e4e P 82b94f9ad924401599f0c147ac57133f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.128750 20917 tablet_replica.cc:333] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.129285 20917 raft_consensus.cc:2243] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:55.130023 20917 raft_consensus.cc:2272] T 207193718bc944d08f549a0b3a77944c P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.132982 20917 tablet_replica.cc:333] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.133517 20917 raft_consensus.cc:2243] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:55.134236 20917 raft_consensus.cc:2272] T 6d7eee75d8ec439dafb7cc34db6c5b96 P 82b94f9ad924401599f0c147ac57133f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.136242 20917 tablet_replica.cc:333] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.136711 20917 raft_consensus.cc:2243] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:55.137120 20917 raft_consensus.cc:2272] T c5abfe93d1004f509ef9a17b27c38a06 P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.139854 20917 tablet_replica.cc:333] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f: stopping tablet replica
I20260709 12:29:55.140403 20917 raft_consensus.cc:2243] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:55.141142 20917 raft_consensus.cc:2272] T 90bed1cd94e04ae8ada2500662d0604c P 82b94f9ad924401599f0c147ac57133f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.174263 20917 tablet_server.cc:196] TabletServer@127.20.109.67:0 shutdown complete.
I20260709 12:29:55.198871 20917 master.cc:562] Master@127.20.109.126:37423 shutting down...
I20260709 12:29:55.219271 20917 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:55.219821 20917 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:55.220130 20917 tablet_replica.cc:333] T 00000000000000000000000000000000 P a657f02e030145a5b7609cf79ecdf615: stopping tablet replica
I20260709 12:29:55.257580 20917 master.cc:584] Master@127.20.109.126:37423 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13215 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:29:55.305657 20917 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.109.126:44357
I20260709 12:29:55.307268 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:55.313289 29113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:55.313316 29114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:55.314751 29116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:55.315482 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:55.316483 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:55.316670 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:55.316833 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600195316813 us; error 0 us; skew 500 ppm
I20260709 12:29:55.317371 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:55.319811 20917 webserver.cc:533] Webserver started at http://127.20.109.126:40661/ using document root <none> and password file <none>
I20260709 12:29:55.320314 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:55.320479 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:55.320744 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:55.321913 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/master-0-root/instance:
uuid: "0ddc8036cc7945038055b515cd90e9a7"
format_stamp: "Formatted at 2026-07-09 12:29:55 on dist-test-slave-sc4p"
I20260709 12:29:55.326226 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:29:55.329540 29121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.330227 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:55.330490 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/master-0-root
uuid: "0ddc8036cc7945038055b515cd90e9a7"
format_stamp: "Formatted at 2026-07-09 12:29:55 on dist-test-slave-sc4p"
I20260709 12:29:55.330785 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:55.347900 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:55.349092 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:55.387189 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.126:44357
I20260709 12:29:55.387298 29172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.126:44357 every 8 connection(s)
I20260709 12:29:55.391232 29173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:55.404086 29173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7: Bootstrap starting.
I20260709 12:29:55.409065 29173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:55.413194 29173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7: No bootstrap required, opened a new log
I20260709 12:29:55.415349 29173 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc8036cc7945038055b515cd90e9a7" member_type: VOTER }
I20260709 12:29:55.415731 29173 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:55.415933 29173 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddc8036cc7945038055b515cd90e9a7, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.416452 29173 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc8036cc7945038055b515cd90e9a7" member_type: VOTER }
I20260709 12:29:55.416882 29173 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:55.417078 29173 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:55.417313 29173 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:55.421906 29173 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc8036cc7945038055b515cd90e9a7" member_type: VOTER }
I20260709 12:29:55.422372 29173 leader_election.cc:304] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ddc8036cc7945038055b515cd90e9a7; no voters: 
I20260709 12:29:55.423403 29173 leader_election.cc:290] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:55.423702 29176 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:55.424995 29176 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddc8036cc7945038055b515cd90e9a7, State: Running, Role: LEADER
I20260709 12:29:55.425545 29176 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc8036cc7945038055b515cd90e9a7" member_type: VOTER }
I20260709 12:29:55.426105 29173 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:55.429430 29177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ddc8036cc7945038055b515cd90e9a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc8036cc7945038055b515cd90e9a7" member_type: VOTER } }
I20260709 12:29:55.430477 29177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:55.430320 29178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ddc8036cc7945038055b515cd90e9a7. Latest consensus state: current_term: 1 leader_uuid: "0ddc8036cc7945038055b515cd90e9a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc8036cc7945038055b515cd90e9a7" member_type: VOTER } }
I20260709 12:29:55.431151 29178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:55.433431 29183 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:55.440877 29183 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:55.442090 20917 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:55.450214 29183 catalog_manager.cc:1383] Generated new cluster ID: cd0393058abb421a98eb91adbde83e47
I20260709 12:29:55.450542 29183 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:55.479310 29183 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:55.480626 29183 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:55.493312 29183 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7: Generated new TSK 0
I20260709 12:29:55.493942 29183 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:55.509449 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:55.515272 29194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:55.516347 29195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:55.517485 29197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:55.518157 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:55.519115 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:55.519306 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:55.519474 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600195519459 us; error 0 us; skew 500 ppm
I20260709 12:29:55.520092 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:55.522397 20917 webserver.cc:533] Webserver started at http://127.20.109.65:39009/ using document root <none> and password file <none>
I20260709 12:29:55.522895 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:55.523056 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:55.523320 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:55.524397 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-0-root/instance:
uuid: "cefa45cad0f44b36b7197b221981465c"
format_stamp: "Formatted at 2026-07-09 12:29:55 on dist-test-slave-sc4p"
I20260709 12:29:55.529285 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:55.533141 29202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.534067 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:29:55.534426 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "cefa45cad0f44b36b7197b221981465c"
format_stamp: "Formatted at 2026-07-09 12:29:55 on dist-test-slave-sc4p"
I20260709 12:29:55.534776 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:55.554041 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:55.555299 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:55.556710 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:55.558965 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:55.559149 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.559362 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:55.559522 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.600265 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:34035
I20260709 12:29:55.600484 29264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:34035 every 8 connection(s)
I20260709 12:29:55.605286 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:55.613315 29269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:55.613363 29270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:55.616739 29272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:55.617208 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:55.618505 29265 heartbeater.cc:344] Connected to a master server at 127.20.109.126:44357
I20260709 12:29:55.618675 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:55.618942 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:55.618986 29265 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:55.619210 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600195619187 us; error 0 us; skew 500 ppm
I20260709 12:29:55.620026 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:55.619994 29265 heartbeater.cc:507] Master 127.20.109.126:44357 requested a full tablet report, sending...
I20260709 12:29:55.622640 29138 ts_manager.cc:194] Registered new tserver with Master: cefa45cad0f44b36b7197b221981465c (127.20.109.65:34035)
I20260709 12:29:55.623210 20917 webserver.cc:533] Webserver started at http://127.20.109.66:33813/ using document root <none> and password file <none>
I20260709 12:29:55.623904 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:55.624135 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:55.624487 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:55.625188 29138 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39312
I20260709 12:29:55.626062 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-1-root/instance:
uuid: "0d80e18b519947dea51ebcb1b90c0c86"
format_stamp: "Formatted at 2026-07-09 12:29:55 on dist-test-slave-sc4p"
I20260709 12:29:55.631109 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:29:55.634577 29277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.635459 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:29:55.635731 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-1-root
uuid: "0d80e18b519947dea51ebcb1b90c0c86"
format_stamp: "Formatted at 2026-07-09 12:29:55 on dist-test-slave-sc4p"
I20260709 12:29:55.636027 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:55.666189 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:55.667569 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:55.669065 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:55.671435 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:55.671634 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.671828 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:55.671952 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.714087 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.66:42717
I20260709 12:29:55.714226 29339 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.66:42717 every 8 connection(s)
I20260709 12:29:55.719377 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:55.727306 29343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:55.727675 29344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:55.730979 29340 heartbeater.cc:344] Connected to a master server at 127.20.109.126:44357
I20260709 12:29:55.731456 29340 heartbeater.cc:461] Registering TS with master...
W20260709 12:29:55.731711 29346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:55.732312 29340 heartbeater.cc:507] Master 127.20.109.126:44357 requested a full tablet report, sending...
I20260709 12:29:55.733569 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:55.734444 29138 ts_manager.cc:194] Registered new tserver with Master: 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717)
I20260709 12:29:55.734948 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:55.735340 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:55.735550 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600195735528 us; error 0 us; skew 500 ppm
I20260709 12:29:55.736181 29138 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39314
I20260709 12:29:55.736187 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:55.739038 20917 webserver.cc:533] Webserver started at http://127.20.109.67:40165/ using document root <none> and password file <none>
I20260709 12:29:55.739485 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:55.739660 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:55.739903 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:55.740991 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-2-root/instance:
uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
format_stamp: "Formatted at 2026-07-09 12:29:55 on dist-test-slave-sc4p"
I20260709 12:29:55.745558 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:29:55.748899 29351 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.749715 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:55.750023 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-2-root
uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
format_stamp: "Formatted at 2026-07-09 12:29:55 on dist-test-slave-sc4p"
I20260709 12:29:55.750306 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893634731-20917-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:55.772799 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:55.773974 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:55.775401 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:55.777496 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:55.777690 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.777920 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:55.778069 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:55.815436 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.67:37435
I20260709 12:29:55.815541 29413 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.67:37435 every 8 connection(s)
I20260709 12:29:55.829615 29414 heartbeater.cc:344] Connected to a master server at 127.20.109.126:44357
I20260709 12:29:55.830120 29414 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:55.830915 29414 heartbeater.cc:507] Master 127.20.109.126:44357 requested a full tablet report, sending...
I20260709 12:29:55.832863 29138 ts_manager.cc:194] Registered new tserver with Master: 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435)
I20260709 12:29:55.833401 20917 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01476921s
I20260709 12:29:55.834708 29138 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39326
I20260709 12:29:55.859349 29138 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39328:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:55.861389 29138 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:55.907552 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 9dac54b48b274ac395fec06fb7ffc4d1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c56b35f6ac884412bd9d16b124c687cc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:55.909092 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dac54b48b274ac395fec06fb7ffc4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:55.913061 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 129a913411194f3a93fd78c7a808b51a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c56b35f6ac884412bd9d16b124c687cc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:55.913442 29378 tablet_service.cc:1511] Processing CreateTablet for tablet 9dac54b48b274ac395fec06fb7ffc4d1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c56b35f6ac884412bd9d16b124c687cc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:55.914503 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129a913411194f3a93fd78c7a808b51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:55.915153 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dac54b48b274ac395fec06fb7ffc4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:55.905301 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 129a913411194f3a93fd78c7a808b51a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c56b35f6ac884412bd9d16b124c687cc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:55.916356 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129a913411194f3a93fd78c7a808b51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:55.929013 29305 tablet_service.cc:1511] Processing CreateTablet for tablet 129a913411194f3a93fd78c7a808b51a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c56b35f6ac884412bd9d16b124c687cc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:55.930696 29305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129a913411194f3a93fd78c7a808b51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:55.933048 29304 tablet_service.cc:1511] Processing CreateTablet for tablet 9dac54b48b274ac395fec06fb7ffc4d1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c56b35f6ac884412bd9d16b124c687cc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:55.934410 29304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dac54b48b274ac395fec06fb7ffc4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:55.952564 29429 tablet_bootstrap.cc:492] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6: Bootstrap starting.
I20260709 12:29:55.959728 29430 tablet_bootstrap.cc:492] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c: Bootstrap starting.
I20260709 12:29:55.960690 29429 tablet_bootstrap.cc:654] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:55.965871 29430 tablet_bootstrap.cc:654] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:55.971299 29432 tablet_bootstrap.cc:492] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86: Bootstrap starting.
I20260709 12:29:55.974767 29429 tablet_bootstrap.cc:492] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6: No bootstrap required, opened a new log
I20260709 12:29:55.975263 29429 ts_tablet_manager.cc:1403] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 12:29:55.975521 29430 tablet_bootstrap.cc:492] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c: No bootstrap required, opened a new log
I20260709 12:29:55.976047 29430 ts_tablet_manager.cc:1403] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:29:55.977662 29429 raft_consensus.cc:359] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:55.978262 29429 raft_consensus.cc:385] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:55.978482 29429 raft_consensus.cc:740] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9749c0ee824515b1eafd775c4ea8e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.978930 29432 tablet_bootstrap.cc:654] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:55.979152 29430 raft_consensus.cc:359] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:55.979166 29429 consensus_queue.cc:260] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:55.980042 29430 raft_consensus.cc:385] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:55.980393 29430 raft_consensus.cc:740] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.981341 29430 consensus_queue.cc:260] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:55.981812 29414 heartbeater.cc:499] Master 127.20.109.126:44357 was elected leader, sending a full tablet report...
I20260709 12:29:55.982283 29429 ts_tablet_manager.cc:1434] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:55.983899 29429 tablet_bootstrap.cc:492] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6: Bootstrap starting.
I20260709 12:29:55.989236 29430 ts_tablet_manager.cc:1434] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.005s
I20260709 12:29:55.989296 29265 heartbeater.cc:499] Master 127.20.109.126:44357 was elected leader, sending a full tablet report...
I20260709 12:29:55.990487 29429 tablet_bootstrap.cc:654] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:55.990666 29430 tablet_bootstrap.cc:492] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c: Bootstrap starting.
I20260709 12:29:55.997025 29430 tablet_bootstrap.cc:654] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:55.998409 29432 tablet_bootstrap.cc:492] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86: No bootstrap required, opened a new log
I20260709 12:29:55.999123 29432 ts_tablet_manager.cc:1403] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.007s
I20260709 12:29:56.003218 29429 tablet_bootstrap.cc:492] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6: No bootstrap required, opened a new log
I20260709 12:29:56.003888 29429 ts_tablet_manager.cc:1403] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 12:29:56.003839 29432 raft_consensus.cc:359] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.004778 29432 raft_consensus.cc:385] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.005131 29432 raft_consensus.cc:740] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d80e18b519947dea51ebcb1b90c0c86, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.006048 29432 consensus_queue.cc:260] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.007402 29429 raft_consensus.cc:359] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.008281 29429 raft_consensus.cc:385] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.008641 29429 raft_consensus.cc:740] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9749c0ee824515b1eafd775c4ea8e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.009572 29429 consensus_queue.cc:260] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.013824 29429 ts_tablet_manager.cc:1434] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:29:56.013940 29430 tablet_bootstrap.cc:492] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c: No bootstrap required, opened a new log
I20260709 12:29:56.014635 29430 ts_tablet_manager.cc:1403] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.016s
I20260709 12:29:56.015678 29340 heartbeater.cc:499] Master 127.20.109.126:44357 was elected leader, sending a full tablet report...
I20260709 12:29:56.016185 29432 ts_tablet_manager.cc:1434] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 12:29:56.017131 29432 tablet_bootstrap.cc:492] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86: Bootstrap starting.
I20260709 12:29:56.017544 29430 raft_consensus.cc:359] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.018079 29430 raft_consensus.cc:385] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.018266 29430 raft_consensus.cc:740] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.019441 29436 raft_consensus.cc:493] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:56.019960 29436 raft_consensus.cc:515] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.022581 29436 leader_election.cc:290] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717), 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435)
I20260709 12:29:56.018878 29430 consensus_queue.cc:260] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.029911 29432 tablet_bootstrap.cc:654] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:56.035478 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dac54b48b274ac395fec06fb7ffc4d1" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" is_pre_election: true
I20260709 12:29:56.036325 29389 raft_consensus.cc:2468] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 0.
I20260709 12:29:56.038081 29206 leader_election.cc:304] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9749c0ee824515b1eafd775c4ea8e6, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.039059 29436 raft_consensus.cc:2804] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:56.039430 29436 raft_consensus.cc:493] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:56.039769 29436 raft_consensus.cc:3060] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.040639 29430 ts_tablet_manager.cc:1434] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:29:56.047920 29436 raft_consensus.cc:515] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.050648 29436 leader_election.cc:290] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 election: Requested vote from peers 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717), 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435)
I20260709 12:29:56.051608 29432 tablet_bootstrap.cc:492] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86: No bootstrap required, opened a new log
I20260709 12:29:56.051743 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dac54b48b274ac395fec06fb7ffc4d1" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86" is_pre_election: true
I20260709 12:29:56.051811 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dac54b48b274ac395fec06fb7ffc4d1" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
I20260709 12:29:56.052044 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dac54b48b274ac395fec06fb7ffc4d1" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86"
I20260709 12:29:56.052325 29432 ts_tablet_manager.cc:1403] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.012s
I20260709 12:29:56.052697 29389 raft_consensus.cc:3060] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:56.053833 29205 leader_election.cc:343] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:56.054950 29205 leader_election.cc:343] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:56.055222 29432 raft_consensus.cc:359] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.055964 29432 raft_consensus.cc:385] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.056293 29432 raft_consensus.cc:740] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d80e18b519947dea51ebcb1b90c0c86, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.057021 29432 consensus_queue.cc:260] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.058637 29432 ts_tablet_manager.cc:1434] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:29:56.059515 29389 raft_consensus.cc:2468] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 1.
I20260709 12:29:56.060567 29206 leader_election.cc:304] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c9749c0ee824515b1eafd775c4ea8e6, cefa45cad0f44b36b7197b221981465c; no voters: 0d80e18b519947dea51ebcb1b90c0c86
I20260709 12:29:56.061234 29436 raft_consensus.cc:2804] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:56.062439 29436 raft_consensus.cc:697] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Becoming Leader. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Running, Role: LEADER
I20260709 12:29:56.063339 29436 consensus_queue.cc:237] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.071208 29137 catalog_manager.cc:5697] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c reported cstate change: term changed from 0 to 1, leader changed from <none> to cefa45cad0f44b36b7197b221981465c (127.20.109.65). New cstate: current_term: 1 leader_uuid: "cefa45cad0f44b36b7197b221981465c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:56.082667 29434 raft_consensus.cc:493] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:56.083209 29434 raft_consensus.cc:515] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.087852 29434 leader_election.cc:290] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cefa45cad0f44b36b7197b221981465c (127.20.109.65:34035), 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717)
I20260709 12:29:56.095345 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129a913411194f3a93fd78c7a808b51a" candidate_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefa45cad0f44b36b7197b221981465c" is_pre_election: true
I20260709 12:29:56.096203 29240 raft_consensus.cc:2468] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c9749c0ee824515b1eafd775c4ea8e6 in term 0.
I20260709 12:29:56.097312 29355 leader_election.cc:304] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9749c0ee824515b1eafd775c4ea8e6, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.098155 29434 raft_consensus.cc:2804] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:56.098212 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129a913411194f3a93fd78c7a808b51a" candidate_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86" is_pre_election: true
I20260709 12:29:56.098491 29434 raft_consensus.cc:493] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:56.098886 29434 raft_consensus.cc:3060] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.098939 29315 raft_consensus.cc:2468] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c9749c0ee824515b1eafd775c4ea8e6 in term 0.
I20260709 12:29:56.105191 29434 raft_consensus.cc:515] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.106980 29434 leader_election.cc:290] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [CANDIDATE]: Term 1 election: Requested vote from peers cefa45cad0f44b36b7197b221981465c (127.20.109.65:34035), 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717)
I20260709 12:29:56.107856 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129a913411194f3a93fd78c7a808b51a" candidate_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefa45cad0f44b36b7197b221981465c"
I20260709 12:29:56.108055 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129a913411194f3a93fd78c7a808b51a" candidate_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86"
I20260709 12:29:56.108409 29240 raft_consensus.cc:3060] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.108639 29315 raft_consensus.cc:3060] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.114305 29240 raft_consensus.cc:2468] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c9749c0ee824515b1eafd775c4ea8e6 in term 1.
I20260709 12:29:56.114436 29315 raft_consensus.cc:2468] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c9749c0ee824515b1eafd775c4ea8e6 in term 1.
I20260709 12:29:56.115439 29355 leader_election.cc:304] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9749c0ee824515b1eafd775c4ea8e6, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.116104 29434 raft_consensus.cc:2804] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:56.117127 29434 raft_consensus.cc:697] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 LEADER]: Becoming Leader. State: Replica: 7c9749c0ee824515b1eafd775c4ea8e6, State: Running, Role: LEADER
I20260709 12:29:56.117767 29434 consensus_queue.cc:237] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.125751 29137 catalog_manager.cc:5697] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:56.200626 29137 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39332:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:56.202695 29137 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:56.228103 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 48826ba9d24f4cde8a82f7034de20895 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=051e1a8096be412685dd64b61f5fb87d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:56.229341 29305 tablet_service.cc:1511] Processing CreateTablet for tablet 48826ba9d24f4cde8a82f7034de20895 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=051e1a8096be412685dd64b61f5fb87d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:56.229761 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48826ba9d24f4cde8a82f7034de20895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:56.230830 29305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48826ba9d24f4cde8a82f7034de20895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:56.231278 29378 tablet_service.cc:1511] Processing CreateTablet for tablet 48826ba9d24f4cde8a82f7034de20895 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=051e1a8096be412685dd64b61f5fb87d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:56.232568 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48826ba9d24f4cde8a82f7034de20895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:56.245496 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 44131dda44e84f1e8524c54408928d28 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=051e1a8096be412685dd64b61f5fb87d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:56.246955 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44131dda44e84f1e8524c54408928d28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:56.247434 29432 tablet_bootstrap.cc:492] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86: Bootstrap starting.
I20260709 12:29:56.246846 29304 tablet_service.cc:1511] Processing CreateTablet for tablet 44131dda44e84f1e8524c54408928d28 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=051e1a8096be412685dd64b61f5fb87d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:56.248817 29304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44131dda44e84f1e8524c54408928d28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:56.249199 29430 tablet_bootstrap.cc:492] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c: Bootstrap starting.
I20260709 12:29:56.254997 29432 tablet_bootstrap.cc:654] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:56.257445 29430 tablet_bootstrap.cc:654] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:56.267354 29432 tablet_bootstrap.cc:492] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86: No bootstrap required, opened a new log
I20260709 12:29:56.267977 29432 ts_tablet_manager.cc:1403] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 12:29:56.270921 29432 raft_consensus.cc:359] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.271757 29432 raft_consensus.cc:385] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.272089 29432 raft_consensus.cc:740] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d80e18b519947dea51ebcb1b90c0c86, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.273006 29432 consensus_queue.cc:260] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.277455 29432 ts_tablet_manager.cc:1434] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:29:56.278930 29432 tablet_bootstrap.cc:492] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86: Bootstrap starting.
I20260709 12:29:56.278491 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 44131dda44e84f1e8524c54408928d28 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=051e1a8096be412685dd64b61f5fb87d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:56.279986 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44131dda44e84f1e8524c54408928d28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:56.284803 29432 tablet_bootstrap.cc:654] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:56.292670 29429 tablet_bootstrap.cc:492] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6: Bootstrap starting.
I20260709 12:29:56.299319 29429 tablet_bootstrap.cc:654] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:56.303877 29430 tablet_bootstrap.cc:492] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c: No bootstrap required, opened a new log
I20260709 12:29:56.303964 29429 tablet_bootstrap.cc:492] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6: No bootstrap required, opened a new log
I20260709 12:29:56.304584 29430 ts_tablet_manager.cc:1403] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.019s
I20260709 12:29:56.304991 29429 ts_tablet_manager.cc:1403] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 12:29:56.306660 29432 tablet_bootstrap.cc:492] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86: No bootstrap required, opened a new log
I20260709 12:29:56.307181 29432 ts_tablet_manager.cc:1403] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.020s
I20260709 12:29:56.307952 29429 raft_consensus.cc:359] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.308751 29429 raft_consensus.cc:385] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.308351 29430 raft_consensus.cc:359] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.309101 29429 raft_consensus.cc:740] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9749c0ee824515b1eafd775c4ea8e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.309274 29430 raft_consensus.cc:385] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.309676 29430 raft_consensus.cc:740] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.309931 29432 raft_consensus.cc:359] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.310140 29429 consensus_queue.cc:260] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.310781 29432 raft_consensus.cc:385] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.310611 29430 consensus_queue.cc:260] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.311160 29432 raft_consensus.cc:740] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d80e18b519947dea51ebcb1b90c0c86, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.312047 29432 consensus_queue.cc:260] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.312955 29430 ts_tablet_manager.cc:1434] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:56.314116 29429 ts_tablet_manager.cc:1434] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 12:29:56.314183 29430 tablet_bootstrap.cc:492] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c: Bootstrap starting.
I20260709 12:29:56.315308 29429 tablet_bootstrap.cc:492] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6: Bootstrap starting.
I20260709 12:29:56.314319 29432 ts_tablet_manager.cc:1434] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:29:56.322347 29430 tablet_bootstrap.cc:654] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:56.322338 29429 tablet_bootstrap.cc:654] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:56.327258 29436 raft_consensus.cc:493] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:56.327890 29436 raft_consensus.cc:515] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.331982 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48826ba9d24f4cde8a82f7034de20895" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" is_pre_election: true
I20260709 12:29:56.332473 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48826ba9d24f4cde8a82f7034de20895" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86" is_pre_election: true
I20260709 12:29:56.332652 29389 raft_consensus.cc:2468] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 0.
I20260709 12:29:56.333125 29315 raft_consensus.cc:2468] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 0.
I20260709 12:29:56.333448 29429 tablet_bootstrap.cc:492] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6: No bootstrap required, opened a new log
I20260709 12:29:56.333469 29430 tablet_bootstrap.cc:492] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c: No bootstrap required, opened a new log
I20260709 12:29:56.334069 29429 ts_tablet_manager.cc:1403] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:29:56.334182 29430 ts_tablet_manager.cc:1403] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:29:56.334465 29206 leader_election.cc:304] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9749c0ee824515b1eafd775c4ea8e6, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.335583 29442 raft_consensus.cc:2804] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:56.335969 29442 raft_consensus.cc:493] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:56.336090 29436 leader_election.cc:290] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717), 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435)
I20260709 12:29:56.336314 29442 raft_consensus.cc:3060] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.337607 29429 raft_consensus.cc:359] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.337862 29430 raft_consensus.cc:359] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.338426 29429 raft_consensus.cc:385] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.338668 29430 raft_consensus.cc:385] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:56.338891 29429 raft_consensus.cc:740] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9749c0ee824515b1eafd775c4ea8e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.339084 29430 raft_consensus.cc:740] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.339982 29430 consensus_queue.cc:260] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.339993 29429 consensus_queue.cc:260] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.342314 29430 ts_tablet_manager.cc:1434] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:56.342564 29429 ts_tablet_manager.cc:1434] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:56.345665 29442 raft_consensus.cc:515] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.348133 29442 leader_election.cc:290] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 election: Requested vote from peers 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717), 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435)
I20260709 12:29:56.348382 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48826ba9d24f4cde8a82f7034de20895" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
I20260709 12:29:56.348158 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48826ba9d24f4cde8a82f7034de20895" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86"
I20260709 12:29:56.348985 29389 raft_consensus.cc:3060] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.349350 29315 raft_consensus.cc:3060] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.357635 29389 raft_consensus.cc:2468] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 1.
I20260709 12:29:56.357991 29315 raft_consensus.cc:2468] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 1.
I20260709 12:29:56.358868 29206 leader_election.cc:304] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9749c0ee824515b1eafd775c4ea8e6, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.359542 29442 raft_consensus.cc:2804] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:56.359946 29442 raft_consensus.cc:697] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Becoming Leader. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Running, Role: LEADER
I20260709 12:29:56.360613 29442 consensus_queue.cc:237] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.367688 29137 catalog_manager.cc:5697] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c reported cstate change: term changed from 0 to 1, leader changed from <none> to cefa45cad0f44b36b7197b221981465c (127.20.109.65). New cstate: current_term: 1 leader_uuid: "cefa45cad0f44b36b7197b221981465c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:56.379853 29442 raft_consensus.cc:493] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:56.380345 29442 raft_consensus.cc:515] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.382095 29442 leader_election.cc:290] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717), 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435)
I20260709 12:29:56.383170 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44131dda44e84f1e8524c54408928d28" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86" is_pre_election: true
I20260709 12:29:56.383397 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44131dda44e84f1e8524c54408928d28" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" is_pre_election: true
I20260709 12:29:56.383982 29315 raft_consensus.cc:2468] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 0.
I20260709 12:29:56.384066 29389 raft_consensus.cc:2468] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 0.
I20260709 12:29:56.385195 29206 leader_election.cc:304] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9749c0ee824515b1eafd775c4ea8e6, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.385859 29442 raft_consensus.cc:2804] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:56.386240 29442 raft_consensus.cc:493] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:56.386562 29442 raft_consensus.cc:3060] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.391942 29442 raft_consensus.cc:515] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.393699 29442 leader_election.cc:290] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 election: Requested vote from peers 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717), 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435)
I20260709 12:29:56.394528 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44131dda44e84f1e8524c54408928d28" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86"
I20260709 12:29:56.395174 29315 raft_consensus.cc:3060] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.395154 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44131dda44e84f1e8524c54408928d28" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
I20260709 12:29:56.396024 29389 raft_consensus.cc:3060] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.401085 29315 raft_consensus.cc:2468] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 1.
I20260709 12:29:56.401468 29389 raft_consensus.cc:2468] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 1.
I20260709 12:29:56.402441 29205 leader_election.cc:304] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d80e18b519947dea51ebcb1b90c0c86, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.403374 29442 raft_consensus.cc:2804] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:56.403789 29442 raft_consensus.cc:697] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Becoming Leader. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Running, Role: LEADER
I20260709 12:29:56.404490 29442 consensus_queue.cc:237] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.411625 29135 catalog_manager.cc:5697] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c reported cstate change: term changed from 0 to 1, leader changed from <none> to cefa45cad0f44b36b7197b221981465c (127.20.109.65). New cstate: current_term: 1 leader_uuid: "cefa45cad0f44b36b7197b221981465c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:56.447258 29389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "129a913411194f3a93fd78c7a808b51a"
dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
mode: GRACEFUL
new_leader_uuid: "cefa45cad0f44b36b7197b221981465c"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:29:56.447726 29389 raft_consensus.cc:606] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 LEADER]: Received request to transfer leadership to TS cefa45cad0f44b36b7197b221981465c
I20260709 12:29:56.459129 29240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dac54b48b274ac395fec06fb7ffc4d1"
dest_uuid: "cefa45cad0f44b36b7197b221981465c"
mode: GRACEFUL
new_leader_uuid: "0d80e18b519947dea51ebcb1b90c0c86"
 from {username='slave'} at 127.0.0.1:39956
I20260709 12:29:56.459633 29240 raft_consensus.cc:606] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Received request to transfer leadership to TS 0d80e18b519947dea51ebcb1b90c0c86
I20260709 12:29:56.471977 29315 raft_consensus.cc:3060] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:56.480177 29442 consensus_queue.cc:1048] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:56.487476 29436 raft_consensus.cc:993] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c: : Instructing follower 0d80e18b519947dea51ebcb1b90c0c86 to start an election
I20260709 12:29:56.488195 29442 raft_consensus.cc:1081] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Signalling peer 0d80e18b519947dea51ebcb1b90c0c86 to start an election
I20260709 12:29:56.490023 29314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dac54b48b274ac395fec06fb7ffc4d1"
dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86"
 from {username='slave'} at 127.0.0.1:59662
I20260709 12:29:56.492862 29314 raft_consensus.cc:493] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:56.493270 29314 raft_consensus.cc:3060] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.499835 29442 consensus_queue.cc:1048] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:56.501200 29314 raft_consensus.cc:515] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.519610 29314 leader_election.cc:290] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [CANDIDATE]: Term 2 election: Requested vote from peers cefa45cad0f44b36b7197b221981465c (127.20.109.65:34035), 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435)
I20260709 12:29:56.521164 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dac54b48b274ac395fec06fb7ffc4d1" candidate_uuid: "0d80e18b519947dea51ebcb1b90c0c86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cefa45cad0f44b36b7197b221981465c"
I20260709 12:29:56.521831 29240 raft_consensus.cc:3055] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:56.522073 29240 raft_consensus.cc:740] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Running, Role: LEADER
I20260709 12:29:56.522897 29240 consensus_queue.cc:260] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.524089 29240 raft_consensus.cc:3060] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.531644 29240 raft_consensus.cc:2468] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d80e18b519947dea51ebcb1b90c0c86 in term 2.
I20260709 12:29:56.533056 29281 leader_election.cc:304] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d80e18b519947dea51ebcb1b90c0c86, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.534011 29439 raft_consensus.cc:2804] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:56.535501 29439 raft_consensus.cc:697] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 LEADER]: Becoming Leader. State: Replica: 0d80e18b519947dea51ebcb1b90c0c86, State: Running, Role: LEADER
I20260709 12:29:56.536461 29439 consensus_queue.cc:237] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.544799 29137 catalog_manager.cc:5697] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 reported cstate change: term changed from 1 to 2, leader changed from cefa45cad0f44b36b7197b221981465c (127.20.109.65) to 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "0d80e18b519947dea51ebcb1b90c0c86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:56.546043 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dac54b48b274ac395fec06fb7ffc4d1" candidate_uuid: "0d80e18b519947dea51ebcb1b90c0c86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
I20260709 12:29:56.546663 29389 raft_consensus.cc:3060] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.554764 29389 raft_consensus.cc:2468] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d80e18b519947dea51ebcb1b90c0c86 in term 2.
I20260709 12:29:56.613912 29434 consensus_queue.cc:1048] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:56.622294 29471 raft_consensus.cc:993] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6: : Instructing follower cefa45cad0f44b36b7197b221981465c to start an election
I20260709 12:29:56.623173 29434 raft_consensus.cc:1081] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 LEADER]: Signalling peer cefa45cad0f44b36b7197b221981465c to start an election
I20260709 12:29:56.626163 29239 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "129a913411194f3a93fd78c7a808b51a"
dest_uuid: "cefa45cad0f44b36b7197b221981465c"
 from {username='slave'} at 127.0.0.1:39942
I20260709 12:29:56.626863 29239 raft_consensus.cc:493] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:56.627218 29239 raft_consensus.cc:3060] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.631611 29434 consensus_queue.cc:1048] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:56.635018 29239 raft_consensus.cc:515] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.638507 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129a913411194f3a93fd78c7a808b51a" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86"
I20260709 12:29:56.638824 29240 raft_consensus.cc:1240] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Rejecting Update request from peer 7c9749c0ee824515b1eafd775c4ea8e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:56.639225 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129a913411194f3a93fd78c7a808b51a" candidate_uuid: "cefa45cad0f44b36b7197b221981465c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
I20260709 12:29:56.639742 29389 raft_consensus.cc:3055] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:56.639997 29389 raft_consensus.cc:740] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c9749c0ee824515b1eafd775c4ea8e6, State: Running, Role: LEADER
I20260709 12:29:56.640681 29389 consensus_queue.cc:260] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.641381 29389 raft_consensus.cc:3060] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.646798 29315 raft_consensus.cc:3060] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.653932 29315 raft_consensus.cc:2468] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 2.
I20260709 12:29:56.655153 29205 leader_election.cc:304] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d80e18b519947dea51ebcb1b90c0c86, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.656163 29442 raft_consensus.cc:2804] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:56.656620 29442 raft_consensus.cc:697] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 2 LEADER]: Becoming Leader. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Running, Role: LEADER
I20260709 12:29:56.657409 29442 consensus_queue.cc:237] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } }
I20260709 12:29:56.658357 29389 raft_consensus.cc:2468] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cefa45cad0f44b36b7197b221981465c in term 2.
I20260709 12:29:56.661015 29239 leader_election.cc:290] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [CANDIDATE]: Term 2 election: Requested vote from peers 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67:37435), 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717)
I20260709 12:29:56.664716 29135 catalog_manager.cc:5697] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c reported cstate change: term changed from 1 to 2, leader changed from 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67) to cefa45cad0f44b36b7197b221981465c (127.20.109.65). New cstate: current_term: 2 leader_uuid: "cefa45cad0f44b36b7197b221981465c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:56.705147 20917 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:29:56.706866 20917 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:29:56.707243 20917 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:29:56.718364 29239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44131dda44e84f1e8524c54408928d28"
dest_uuid: "cefa45cad0f44b36b7197b221981465c"
mode: GRACEFUL
new_leader_uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
 from {username='slave'} at 127.0.0.1:39974
I20260709 12:29:56.718967 29239 raft_consensus.cc:606] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Received request to transfer leadership to TS 7c9749c0ee824515b1eafd775c4ea8e6
I20260709 12:29:56.719990 20917 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:29:56.763275 29442 consensus_queue.cc:1048] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:56.775135 29436 consensus_queue.cc:1048] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:56.928730 29436 consensus_queue.cc:1048] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:56.935578 29462 raft_consensus.cc:993] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c: : Instructing follower 7c9749c0ee824515b1eafd775c4ea8e6 to start an election
I20260709 12:29:56.936144 29442 raft_consensus.cc:1081] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Signalling peer 7c9749c0ee824515b1eafd775c4ea8e6 to start an election
I20260709 12:29:56.938455 29388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44131dda44e84f1e8524c54408928d28"
dest_uuid: "7c9749c0ee824515b1eafd775c4ea8e6"
 from {username='slave'} at 127.0.0.1:38546
I20260709 12:29:56.939600 29388 raft_consensus.cc:493] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:56.940013 29388 raft_consensus.cc:3060] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.941957 29442 consensus_queue.cc:1048] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:56.952319 29388 raft_consensus.cc:515] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.954665 29388 leader_election.cc:290] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [CANDIDATE]: Term 2 election: Requested vote from peers cefa45cad0f44b36b7197b221981465c (127.20.109.65:34035), 0d80e18b519947dea51ebcb1b90c0c86 (127.20.109.66:42717)
I20260709 12:29:56.955467 29239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44131dda44e84f1e8524c54408928d28" candidate_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cefa45cad0f44b36b7197b221981465c"
I20260709 12:29:56.956162 29239 raft_consensus.cc:3055] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:56.956139 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44131dda44e84f1e8524c54408928d28" candidate_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d80e18b519947dea51ebcb1b90c0c86"
I20260709 12:29:56.956703 29239 raft_consensus.cc:740] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cefa45cad0f44b36b7197b221981465c, State: Running, Role: LEADER
I20260709 12:29:56.956954 29315 raft_consensus.cc:3060] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.958488 29239 consensus_queue.cc:260] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.960580 29239 raft_consensus.cc:3060] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:56.959357 29240 raft_consensus.cc:1275] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Refusing update from remote peer 0d80e18b519947dea51ebcb1b90c0c86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:56.962184 29439 consensus_queue.cc:1048] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:56.971563 29388 raft_consensus.cc:1275] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Refusing update from remote peer 0d80e18b519947dea51ebcb1b90c0c86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:56.973958 29239 raft_consensus.cc:2468] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c9749c0ee824515b1eafd775c4ea8e6 in term 2.
I20260709 12:29:56.974812 29469 consensus_queue.cc:1048] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:56.975363 29355 leader_election.cc:304] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9749c0ee824515b1eafd775c4ea8e6, cefa45cad0f44b36b7197b221981465c; no voters: 
I20260709 12:29:56.976294 29434 raft_consensus.cc:2804] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:56.976766 29434 raft_consensus.cc:697] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 LEADER]: Becoming Leader. State: Replica: 7c9749c0ee824515b1eafd775c4ea8e6, State: Running, Role: LEADER
I20260709 12:29:56.977579 29434 consensus_queue.cc:237] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } }
I20260709 12:29:56.979940 29315 raft_consensus.cc:2468] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c9749c0ee824515b1eafd775c4ea8e6 in term 2.
I20260709 12:29:56.985743 29135 catalog_manager.cc:5697] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 reported cstate change: term changed from 1 to 2, leader changed from cefa45cad0f44b36b7197b221981465c (127.20.109.65) to 7c9749c0ee824515b1eafd775c4ea8e6 (127.20.109.67). New cstate: current_term: 2 leader_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cefa45cad0f44b36b7197b221981465c" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 34035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:57.088059 20917 tablet_server.cc:179] TabletServer@127.20.109.65:0 shutting down...
I20260709 12:29:57.103789 29315 raft_consensus.cc:1275] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Refusing update from remote peer cefa45cad0f44b36b7197b221981465c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:57.105424 29442 consensus_queue.cc:1048] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d80e18b519947dea51ebcb1b90c0c86" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:57.113607 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:57.115324 20917 tablet_replica.cc:333] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c: stopping tablet replica
I20260709 12:29:57.116284 20917 raft_consensus.cc:2243] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.117496 20917 raft_consensus.cc:2272] T 48826ba9d24f4cde8a82f7034de20895 P cefa45cad0f44b36b7197b221981465c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.119065 29388 raft_consensus.cc:1275] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Refusing update from remote peer cefa45cad0f44b36b7197b221981465c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:57.121065 20917 tablet_replica.cc:333] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c: stopping tablet replica
I20260709 12:29:57.121376 29442 consensus_queue.cc:1048] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9749c0ee824515b1eafd775c4ea8e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:57.121973 20917 raft_consensus.cc:2243] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.122668 20917 raft_consensus.cc:2272] T 44131dda44e84f1e8524c54408928d28 P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.125164 20917 tablet_replica.cc:333] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c: stopping tablet replica
I20260709 12:29:57.125936 20917 raft_consensus.cc:2243] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.126948 20917 raft_consensus.cc:2272] T 129a913411194f3a93fd78c7a808b51a P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.130189 20917 tablet_replica.cc:333] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c: stopping tablet replica
I20260709 12:29:57.130792 20917 raft_consensus.cc:2243] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.131228 20917 raft_consensus.cc:2272] T 9dac54b48b274ac395fec06fb7ffc4d1 P cefa45cad0f44b36b7197b221981465c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.156740 20917 tablet_server.cc:196] TabletServer@127.20.109.65:0 shutdown complete.
I20260709 12:29:57.170763 20917 tablet_server.cc:179] TabletServer@127.20.109.66:0 shutting down...
I20260709 12:29:57.191315 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:57.192180 20917 tablet_replica.cc:333] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86: stopping tablet replica
I20260709 12:29:57.192778 20917 raft_consensus.cc:2243] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.193228 20917 raft_consensus.cc:2272] T 48826ba9d24f4cde8a82f7034de20895 P 0d80e18b519947dea51ebcb1b90c0c86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.195822 20917 tablet_replica.cc:333] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86: stopping tablet replica
I20260709 12:29:57.196419 20917 raft_consensus.cc:2243] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.197242 20917 raft_consensus.cc:2272] T 9dac54b48b274ac395fec06fb7ffc4d1 P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.199666 20917 tablet_replica.cc:333] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86: stopping tablet replica
I20260709 12:29:57.200196 20917 raft_consensus.cc:2243] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.200605 20917 raft_consensus.cc:2272] T 44131dda44e84f1e8524c54408928d28 P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.202991 20917 tablet_replica.cc:333] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86: stopping tablet replica
I20260709 12:29:57.203504 20917 raft_consensus.cc:2243] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.203930 20917 raft_consensus.cc:2272] T 129a913411194f3a93fd78c7a808b51a P 0d80e18b519947dea51ebcb1b90c0c86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.218410 20917 tablet_server.cc:196] TabletServer@127.20.109.66:0 shutdown complete.
I20260709 12:29:57.231226 20917 tablet_server.cc:179] TabletServer@127.20.109.67:0 shutting down...
I20260709 12:29:57.247277 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:57.247931 20917 tablet_replica.cc:333] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6: stopping tablet replica
I20260709 12:29:57.248466 20917 raft_consensus.cc:2243] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.248894 20917 raft_consensus.cc:2272] T 48826ba9d24f4cde8a82f7034de20895 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.251189 20917 tablet_replica.cc:333] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6: stopping tablet replica
I20260709 12:29:57.251762 20917 raft_consensus.cc:2243] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.252363 20917 pending_rounds.cc:70] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6: Trying to abort 1 pending ops.
I20260709 12:29:57.252521 20917 pending_rounds.cc:77] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305626406831550464 op_type: NO_OP noop_request { }
I20260709 12:29:57.252816 20917 raft_consensus.cc:2889] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:57.253070 20917 raft_consensus.cc:2272] T 44131dda44e84f1e8524c54408928d28 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.255260 20917 tablet_replica.cc:333] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6: stopping tablet replica
I20260709 12:29:57.255817 20917 raft_consensus.cc:2243] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.256240 20917 raft_consensus.cc:2272] T 129a913411194f3a93fd78c7a808b51a P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.258327 20917 tablet_replica.cc:333] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6: stopping tablet replica
I20260709 12:29:57.258841 20917 raft_consensus.cc:2243] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.259258 20917 raft_consensus.cc:2272] T 9dac54b48b274ac395fec06fb7ffc4d1 P 7c9749c0ee824515b1eafd775c4ea8e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.281421 20917 tablet_server.cc:196] TabletServer@127.20.109.67:0 shutdown complete.
I20260709 12:29:57.293689 20917 master.cc:562] Master@127.20.109.126:44357 shutting down...
I20260709 12:29:57.307248 20917 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.307808 20917 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.308192 20917 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0ddc8036cc7945038055b515cd90e9a7: stopping tablet replica
I20260709 12:29:57.326064 20917 master.cc:584] Master@127.20.109.126:44357 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2046 ms)
[----------] 6 tests from LeaderRebalancerTest (303546 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:29:57.352392 20917 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.109.126:42297
I20260709 12:29:57.353726 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:57.358534 29479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:57.358701 29480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:57.360059 29482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:57.361099 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:57.361827 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:57.362005 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:57.362154 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600197362136 us; error 0 us; skew 500 ppm
I20260709 12:29:57.362716 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:57.364917 20917 webserver.cc:533] Webserver started at http://127.20.109.126:34071/ using document root <none> and password file <none>
I20260709 12:29:57.365381 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:57.365564 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:57.365811 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:57.367153 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/master-0-root/instance:
uuid: "a84e745667094aa484805ca812a8fc96"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-sc4p"
I20260709 12:29:57.371373 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:57.374538 29487 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.375298 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:57.375586 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/master-0-root
uuid: "a84e745667094aa484805ca812a8fc96"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-sc4p"
I20260709 12:29:57.375865 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:57.385372 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:57.386406 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:57.422152 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.126:42297
I20260709 12:29:57.422247 29538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.126:42297 every 8 connection(s)
I20260709 12:29:57.425990 29539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.437067 29539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96: Bootstrap starting.
I20260709 12:29:57.441442 29539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:57.445129 29539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96: No bootstrap required, opened a new log
I20260709 12:29:57.447110 29539 raft_consensus.cc:359] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84e745667094aa484805ca812a8fc96" member_type: VOTER }
I20260709 12:29:57.447496 29539 raft_consensus.cc:385] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:57.447695 29539 raft_consensus.cc:740] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a84e745667094aa484805ca812a8fc96, State: Initialized, Role: FOLLOWER
I20260709 12:29:57.448201 29539 consensus_queue.cc:260] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84e745667094aa484805ca812a8fc96" member_type: VOTER }
I20260709 12:29:57.448669 29539 raft_consensus.cc:399] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:57.448855 29539 raft_consensus.cc:493] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:57.449065 29539 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:57.454044 29539 raft_consensus.cc:515] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84e745667094aa484805ca812a8fc96" member_type: VOTER }
I20260709 12:29:57.454553 29539 leader_election.cc:304] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a84e745667094aa484805ca812a8fc96; no voters: 
I20260709 12:29:57.455684 29539 leader_election.cc:290] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:57.456067 29542 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:57.457312 29542 raft_consensus.cc:697] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 1 LEADER]: Becoming Leader. State: Replica: a84e745667094aa484805ca812a8fc96, State: Running, Role: LEADER
I20260709 12:29:57.457955 29542 consensus_queue.cc:237] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84e745667094aa484805ca812a8fc96" member_type: VOTER }
I20260709 12:29:57.458503 29539 sys_catalog.cc:565] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:57.460695 29544 sys_catalog.cc:455] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a84e745667094aa484805ca812a8fc96. Latest consensus state: current_term: 1 leader_uuid: "a84e745667094aa484805ca812a8fc96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84e745667094aa484805ca812a8fc96" member_type: VOTER } }
I20260709 12:29:57.460695 29543 sys_catalog.cc:455] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a84e745667094aa484805ca812a8fc96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84e745667094aa484805ca812a8fc96" member_type: VOTER } }
I20260709 12:29:57.461418 29544 sys_catalog.cc:458] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:57.461512 29543 sys_catalog.cc:458] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:57.468518 29547 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:57.473459 29547 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:57.476931 20917 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:57.482482 29547 catalog_manager.cc:1383] Generated new cluster ID: e1a98c6cb26c44bf93596282ef919087
I20260709 12:29:57.482836 29547 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:57.504886 29547 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:57.506189 29547 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:57.523406 29547 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96: Generated new TSK 0
I20260709 12:29:57.524000 29547 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:57.544028 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:57.549587 29560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:57.550360 29561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:57.552302 20917 server_base.cc:1061] running on GCE node
W20260709 12:29:57.552809 29563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:57.553681 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:57.553862 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:57.553982 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600197553969 us; error 0 us; skew 500 ppm
I20260709 12:29:57.554452 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:57.556775 20917 webserver.cc:533] Webserver started at http://127.20.109.65:45581/ using document root <none> and password file <none>
I20260709 12:29:57.557220 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:57.557371 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:57.557583 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:57.558636 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-0-root/instance:
uuid: "14afc611141141b18ad748c422bc560b"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-sc4p"
I20260709 12:29:57.563074 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:29:57.566246 29568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.567065 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:29:57.567307 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "14afc611141141b18ad748c422bc560b"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-sc4p"
I20260709 12:29:57.567544 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:57.596321 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:57.597534 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:57.598970 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:57.601364 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:57.601567 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.601814 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:57.601971 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.641830 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:33193
I20260709 12:29:57.641947 29630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:33193 every 8 connection(s)
I20260709 12:29:57.647061 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:57.653403 29635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:57.667040 29636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:57.672075 29631 heartbeater.cc:344] Connected to a master server at 127.20.109.126:42297
I20260709 12:29:57.672601 29631 heartbeater.cc:461] Registering TS with master...
W20260709 12:29:57.672631 29638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:57.673302 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:57.674516 29631 heartbeater.cc:507] Master 127.20.109.126:42297 requested a full tablet report, sending...
I20260709 12:29:57.675208 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:57.675465 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:57.675628 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600197675612 us; error 0 us; skew 500 ppm
I20260709 12:29:57.676190 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:57.676559 29504 ts_manager.cc:194] Registered new tserver with Master: 14afc611141141b18ad748c422bc560b (127.20.109.65:33193)
I20260709 12:29:57.678622 29504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43784
I20260709 12:29:57.679976 20917 webserver.cc:533] Webserver started at http://127.20.109.66:34313/ using document root <none> and password file <none>
I20260709 12:29:57.680663 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:57.680902 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:57.681212 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:57.682226 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-1-root/instance:
uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-sc4p"
I20260709 12:29:57.686368 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:29:57.689391 29643 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.690084 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:57.690369 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-1-root
uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-sc4p"
I20260709 12:29:57.690649 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:57.714938 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:57.716025 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:57.717720 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:57.719960 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:57.720173 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.720397 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:57.720546 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.758441 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.66:45829
I20260709 12:29:57.758533 29705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.66:45829 every 8 connection(s)
I20260709 12:29:57.763089 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:57.769868 29709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:57.770803 29710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:57.772639 29712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:57.774127 20917 server_base.cc:1061] running on GCE node
I20260709 12:29:57.775105 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:29:57.775182 29706 heartbeater.cc:344] Connected to a master server at 127.20.109.126:42297
W20260709 12:29:57.775409 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:57.775655 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600197775634 us; error 0 us; skew 500 ppm
I20260709 12:29:57.775671 29706 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:57.776551 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:57.776733 29706 heartbeater.cc:507] Master 127.20.109.126:42297 requested a full tablet report, sending...
I20260709 12:29:57.779175 29504 ts_manager.cc:194] Registered new tserver with Master: 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:57.779316 20917 webserver.cc:533] Webserver started at http://127.20.109.67:41483/ using document root <none> and password file <none>
I20260709 12:29:57.779922 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:57.780112 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:57.780378 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:57.780659 29504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43786
I20260709 12:29:57.781539 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-2-root/instance:
uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-sc4p"
I20260709 12:29:57.786064 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:29:57.789486 29717 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.790302 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:57.790659 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-2-root
uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-sc4p"
I20260709 12:29:57.790946 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893634731-20917-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:57.804718 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:57.805830 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:57.807276 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:57.809507 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:57.809707 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.809937 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:57.810088 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.847314 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.67:37311
I20260709 12:29:57.847410 29779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.67:37311 every 8 connection(s)
I20260709 12:29:57.860968 29780 heartbeater.cc:344] Connected to a master server at 127.20.109.126:42297
I20260709 12:29:57.861407 29780 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:57.862145 29780 heartbeater.cc:507] Master 127.20.109.126:42297 requested a full tablet report, sending...
I20260709 12:29:57.864243 29504 ts_manager.cc:194] Registered new tserver with Master: e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:57.865173 20917 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014586126s
I20260709 12:29:57.865584 29504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43790
I20260709 12:29:57.889974 29504 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:57.893447 29504 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:57.955749 29745 tablet_service.cc:1511] Processing CreateTablet for tablet 31146eb1df474897a336ad843a92e04b (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:57.957316 29745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31146eb1df474897a336ad843a92e04b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.960978 29744 tablet_service.cc:1511] Processing CreateTablet for tablet 308e90191a5847379ea3e11972042dfb (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:57.963964 29743 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0789f1aa2e436787725effebf323d6 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:57.966046 29744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308e90191a5847379ea3e11972042dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.969326 29743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0789f1aa2e436787725effebf323d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.974368 29595 tablet_service.cc:1511] Processing CreateTablet for tablet 308e90191a5847379ea3e11972042dfb (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:57.976049 29595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308e90191a5847379ea3e11972042dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.978951 29596 tablet_service.cc:1511] Processing CreateTablet for tablet 31146eb1df474897a336ad843a92e04b (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:57.980278 29596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31146eb1df474897a336ad843a92e04b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.983711 29594 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0789f1aa2e436787725effebf323d6 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:57.984115 29593 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce2738d4cf04f27bb159a96551cc878 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:57.985188 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0789f1aa2e436787725effebf323d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.986315 29593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce2738d4cf04f27bb159a96551cc878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.988080 29742 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce2738d4cf04f27bb159a96551cc878 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:57.989440 29742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce2738d4cf04f27bb159a96551cc878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.992501 29592 tablet_service.cc:1511] Processing CreateTablet for tablet 73db145a322c4c099fe1ab23c79649ea (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:57.993815 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73db145a322c4c099fe1ab23c79649ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.999406 29741 tablet_service.cc:1511] Processing CreateTablet for tablet 73db145a322c4c099fe1ab23c79649ea (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:58.000720 29741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73db145a322c4c099fe1ab23c79649ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.015674 29671 tablet_service.cc:1511] Processing CreateTablet for tablet 31146eb1df474897a336ad843a92e04b (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:58.017422 29671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31146eb1df474897a336ad843a92e04b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.023666 29667 tablet_service.cc:1511] Processing CreateTablet for tablet 73db145a322c4c099fe1ab23c79649ea (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:58.024662 29669 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0789f1aa2e436787725effebf323d6 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:58.025231 29667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73db145a322c4c099fe1ab23c79649ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.026104 29669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0789f1aa2e436787725effebf323d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.027913 29668 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce2738d4cf04f27bb159a96551cc878 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:58.023666 29670 tablet_service.cc:1511] Processing CreateTablet for tablet 308e90191a5847379ea3e11972042dfb (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:58.033414 29668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce2738d4cf04f27bb159a96551cc878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.039119 29670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308e90191a5847379ea3e11972042dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.062763 29592 tablet_service.cc:1511] Processing CreateTablet for tablet b2778f68bdf54eec99000be57c33c4ac (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:58.064153 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2778f68bdf54eec99000be57c33c4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.074708 29796 tablet_bootstrap.cc:492] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.079546 29795 tablet_bootstrap.cc:492] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.083654 29796 tablet_bootstrap.cc:654] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.085355 29795 tablet_bootstrap.cc:654] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.089603 29797 tablet_bootstrap.cc:492] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.093650 29667 tablet_service.cc:1511] Processing CreateTablet for tablet b2778f68bdf54eec99000be57c33c4ac (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:58.096356 29795 tablet_bootstrap.cc:492] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.101868 29668 tablet_service.cc:1511] Processing CreateTablet for tablet 9af8893ad5ad41f99053bce068ddfccd (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:58.102459 29795 ts_tablet_manager.cc:1403] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 12:29:58.096063 29742 tablet_service.cc:1511] Processing CreateTablet for tablet b2778f68bdf54eec99000be57c33c4ac (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:58.098330 29797 tablet_bootstrap.cc:654] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.100092 29593 tablet_service.cc:1511] Processing CreateTablet for tablet 9af8893ad5ad41f99053bce068ddfccd (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:58.105634 29593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af8893ad5ad41f99053bce068ddfccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.105465 29795 raft_consensus.cc:359] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.106199 29795 raft_consensus.cc:385] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.106501 29795 raft_consensus.cc:740] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.107352 29795 consensus_queue.cc:260] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.101945 29667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2778f68bdf54eec99000be57c33c4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.109798 29668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af8893ad5ad41f99053bce068ddfccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.115833 29796 tablet_bootstrap.cc:492] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.116413 29795 ts_tablet_manager.cc:1434] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:29:58.117062 29780 heartbeater.cc:499] Master 127.20.109.126:42297 was elected leader, sending a full tablet report...
I20260709 12:29:58.120325 29744 tablet_service.cc:1511] Processing CreateTablet for tablet 9af8893ad5ad41f99053bce068ddfccd (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:58.121554 29592 tablet_service.cc:1511] Processing CreateTablet for tablet f16a7086995e4967b47d2db8d9727c86 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:58.116371 29796 ts_tablet_manager.cc:1403] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.042s	user 0.003s	sys 0.008s
I20260709 12:29:58.122871 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16a7086995e4967b47d2db8d9727c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.125562 29796 raft_consensus.cc:359] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.126351 29796 raft_consensus.cc:385] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.126658 29796 raft_consensus.cc:740] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.127404 29796 consensus_queue.cc:260] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.128410 29744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af8893ad5ad41f99053bce068ddfccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.134632 29796 ts_tablet_manager.cc:1434] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:29:58.139170 29742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2778f68bdf54eec99000be57c33c4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.142654 29667 tablet_service.cc:1511] Processing CreateTablet for tablet f16a7086995e4967b47d2db8d9727c86 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:58.144016 29667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16a7086995e4967b47d2db8d9727c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.144291 29592 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba5d6d6dc304485a0075004f4d9d38f (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:58.145116 29795 tablet_bootstrap.cc:492] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.145500 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba5d6d6dc304485a0075004f4d9d38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.145618 29670 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba5d6d6dc304485a0075004f4d9d38f (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:58.147208 29670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba5d6d6dc304485a0075004f4d9d38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.151631 29741 tablet_service.cc:1511] Processing CreateTablet for tablet f16a7086995e4967b47d2db8d9727c86 (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:58.153021 29741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16a7086995e4967b47d2db8d9727c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.165488 29797 tablet_bootstrap.cc:492] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.166097 29797 ts_tablet_manager.cc:1403] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.000s
I20260709 12:29:58.166249 29745 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba5d6d6dc304485a0075004f4d9d38f (DEFAULT_TABLE table=test-workload [id=8451c5cfa3284884b881604313a87779]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:58.167181 29795 tablet_bootstrap.cc:654] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.167650 29745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba5d6d6dc304485a0075004f4d9d38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.168920 29631 heartbeater.cc:499] Master 127.20.109.126:42297 was elected leader, sending a full tablet report...
I20260709 12:29:58.169354 29796 tablet_bootstrap.cc:492] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.178133 29797 raft_consensus.cc:359] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.179096 29797 raft_consensus.cc:385] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.180929 29796 tablet_bootstrap.cc:654] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.183346 29797 raft_consensus.cc:740] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.185458 29797 consensus_queue.cc:260] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.189956 29795 tablet_bootstrap.cc:492] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.190699 29795 ts_tablet_manager.cc:1403] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.014s
I20260709 12:29:58.196599 29795 raft_consensus.cc:359] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.198700 29795 raft_consensus.cc:385] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.199683 29795 raft_consensus.cc:740] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.200542 29795 consensus_queue.cc:260] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.206807 29796 tablet_bootstrap.cc:492] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.207430 29796 ts_tablet_manager.cc:1403] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.010s
I20260709 12:29:58.210222 29796 raft_consensus.cc:359] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.210779 29796 raft_consensus.cc:385] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.211071 29796 raft_consensus.cc:740] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.211225 29795 ts_tablet_manager.cc:1434] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:29:58.211870 29796 consensus_queue.cc:260] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.213924 29796 ts_tablet_manager.cc:1434] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:29:58.212404 29795 tablet_bootstrap.cc:492] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.217993 29796 tablet_bootstrap.cc:492] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.220328 29795 tablet_bootstrap.cc:654] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.218400 29797 ts_tablet_manager.cc:1434] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.052s	user 0.013s	sys 0.005s
I20260709 12:29:58.223212 29706 heartbeater.cc:499] Master 127.20.109.126:42297 was elected leader, sending a full tablet report...
I20260709 12:29:58.223335 29797 tablet_bootstrap.cc:492] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.225574 29796 tablet_bootstrap.cc:654] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.229815 29797 tablet_bootstrap.cc:654] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.241626 29797 tablet_bootstrap.cc:492] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.242264 29797 ts_tablet_manager.cc:1403] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:29:58.245123 29797 raft_consensus.cc:359] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.245683 29795 tablet_bootstrap.cc:492] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.246264 29795 ts_tablet_manager.cc:1403] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.007s
I20260709 12:29:58.247816 29796 tablet_bootstrap.cc:492] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.248437 29796 ts_tablet_manager.cc:1403] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:29:58.249687 29795 raft_consensus.cc:359] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.250495 29795 raft_consensus.cc:385] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.250823 29795 raft_consensus.cc:740] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.251125 29797 raft_consensus.cc:385] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.251437 29797 raft_consensus.cc:740] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.251678 29796 raft_consensus.cc:359] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.251602 29795 consensus_queue.cc:260] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.252161 29797 consensus_queue.cc:260] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.252614 29796 raft_consensus.cc:385] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.252952 29796 raft_consensus.cc:740] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.253718 29796 consensus_queue.cc:260] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.254458 29795 ts_tablet_manager.cc:1434] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:58.255546 29795 tablet_bootstrap.cc:492] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.256022 29796 ts_tablet_manager.cc:1434] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:29:58.257085 29796 tablet_bootstrap.cc:492] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.260556 29797 ts_tablet_manager.cc:1434] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:29:58.261703 29797 tablet_bootstrap.cc:492] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.261845 29795 tablet_bootstrap.cc:654] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.263027 29796 tablet_bootstrap.cc:654] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.272400 29797 tablet_bootstrap.cc:654] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.279011 29795 tablet_bootstrap.cc:492] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.279657 29795 ts_tablet_manager.cc:1403] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 12:29:58.284462 29797 tablet_bootstrap.cc:492] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.285130 29797 ts_tablet_manager.cc:1403] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 12:29:58.284374 29795 raft_consensus.cc:359] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.286501 29795 raft_consensus.cc:385] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.286847 29795 raft_consensus.cc:740] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.287499 29796 tablet_bootstrap.cc:492] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.288089 29796 ts_tablet_manager.cc:1403] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.016s
I20260709 12:29:58.287817 29795 consensus_queue.cc:260] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.288367 29797 raft_consensus.cc:359] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.289582 29797 raft_consensus.cc:385] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.289893 29797 raft_consensus.cc:740] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.290928 29797 consensus_queue.cc:260] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.291249 29796 raft_consensus.cc:359] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.292076 29796 raft_consensus.cc:385] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.292380 29796 raft_consensus.cc:740] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.292989 29795 ts_tablet_manager.cc:1434] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:29:58.293394 29796 consensus_queue.cc:260] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.294216 29795 tablet_bootstrap.cc:492] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.294986 29800 raft_consensus.cc:493] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.295499 29800 raft_consensus.cc:515] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.298164 29800 leader_election.cc:290] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:58.299598 29797 ts_tablet_manager.cc:1434] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:29:58.300750 29797 tablet_bootstrap.cc:492] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.300868 29802 raft_consensus.cc:493] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.301467 29802 raft_consensus.cc:515] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.302016 29805 raft_consensus.cc:493] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.302618 29805 raft_consensus.cc:515] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.306789 29805 leader_election.cc:290] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.317459 29802 leader_election.cc:290] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:58.333425 29805 raft_consensus.cc:493] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.355378 29805 raft_consensus.cc:515] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.344169 29796 ts_tablet_manager.cc:1434] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.001s
I20260709 12:29:58.360796 29797 tablet_bootstrap.cc:654] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.372705 29800 raft_consensus.cc:493] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.373382 29800 raft_consensus.cc:515] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.375789 29800 leader_election.cc:290] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:58.380538 29796 tablet_bootstrap.cc:492] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.378568 29805 leader_election.cc:290] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311), 14afc611141141b18ad748c422bc560b (127.20.109.65:33193)
I20260709 12:29:58.390247 29795 tablet_bootstrap.cc:654] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.391113 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0789f1aa2e436787725effebf323d6" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.391979 29606 raft_consensus.cc:2468] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:29:58.395172 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.396718 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31146eb1df474897a336ad843a92e04b" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.397500 29604 raft_consensus.cc:2468] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 0.
I20260709 12:29:58.399701 29800 raft_consensus.cc:493] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.400362 29800 raft_consensus.cc:515] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.400743 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.402864 29800 leader_election.cc:290] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
W20260709 12:29:58.403069 29647 leader_election.cc:343] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.404258 29647 leader_election.cc:304] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.404536 29680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.408085 29680 raft_consensus.cc:2468] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:29:58.408281 29805 raft_consensus.cc:2804] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.405668 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.408897 29805 raft_consensus.cc:493] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.409406 29805 raft_consensus.cc:3060] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.411068 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31146eb1df474897a336ad843a92e04b" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.410074 29720 leader_election.cc:304] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
W20260709 12:29:58.412864 29720 leader_election.cc:343] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.413607 29800 raft_consensus.cc:2804] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.414072 29800 raft_consensus.cc:493] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.414433 29800 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.416096 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.417363 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31146eb1df474897a336ad843a92e04b" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.418102 29754 raft_consensus.cc:2468] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 0.
I20260709 12:29:58.406138 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.406704 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0789f1aa2e436787725effebf323d6" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.418993 29681 raft_consensus.cc:2468] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:29:58.419523 29797 tablet_bootstrap.cc:492] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.420044 29797 ts_tablet_manager.cc:1403] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.011s
I20260709 12:29:58.420224 29802 raft_consensus.cc:493] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.420708 29802 raft_consensus.cc:515] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.421491 29606 raft_consensus.cc:2468] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:29:58.422691 29802 leader_election.cc:290] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.423175 29797 raft_consensus.cc:359] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.419941 29805 raft_consensus.cc:515] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.423884 29797 raft_consensus.cc:385] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.424216 29797 raft_consensus.cc:740] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.424582 29679 raft_consensus.cc:2393] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14afc611141141b18ad748c422bc560b in current term 1: Already voted for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in this term.
I20260709 12:29:58.407135 29721 leader_election.cc:304] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:58.425776 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.426364 29823 raft_consensus.cc:2804] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.407565 29796 tablet_bootstrap.cc:654] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.426887 29823 raft_consensus.cc:493] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:58.427399 29571 leader_election.cc:343] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.427388 29823 raft_consensus.cc:3060] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:58.427983 29721 leader_election.cc:343] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.429247 29721 leader_election.cc:304] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:29:58.429813 29805 leader_election.cc:290] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 election: Requested vote from peers e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311), 14afc611141141b18ad748c422bc560b (127.20.109.65:33193)
I20260709 12:29:58.429800 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31146eb1df474897a336ad843a92e04b" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:58.430500 29754 raft_consensus.cc:3060] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.424865 29800 raft_consensus.cc:515] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.433610 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31146eb1df474897a336ad843a92e04b" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:58.434412 29755 raft_consensus.cc:2393] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34c3f3bb47594d96b0ebe07fa8e74680 in current term 1: Already voted for candidate e6a9fc0aa0024566a24d4b56512c13e6 in this term.
I20260709 12:29:58.436650 29644 leader_election.cc:304] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:29:58.437438 29797 consensus_queue.cc:260] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.437934 29805 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.438504 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:58.439780 29606 raft_consensus.cc:3060] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.445269 29796 tablet_bootstrap.cc:492] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.445817 29796 ts_tablet_manager.cc:1403] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.001s
I20260709 12:29:58.443533 29824 raft_consensus.cc:2804] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.446574 29797 ts_tablet_manager.cc:1434] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:29:58.446823 29824 raft_consensus.cc:493] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.447257 29824 raft_consensus.cc:3060] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.452941 29823 raft_consensus.cc:515] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.454169 29797 tablet_bootstrap.cc:492] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.440531 29754 raft_consensus.cc:2468] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 1.
I20260709 12:29:58.456023 29796 raft_consensus.cc:359] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.456442 29644 leader_election.cc:304] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:58.456816 29796 raft_consensus.cc:385] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.457140 29796 raft_consensus.cc:740] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.457340 29814 raft_consensus.cc:2804] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.458024 29796 consensus_queue.cc:260] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.458879 29795 tablet_bootstrap.cc:492] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.439978 29800 leader_election.cc:290] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:58.460944 29824 raft_consensus.cc:515] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
W20260709 12:29:58.472391 29552 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:58.475575 29814 raft_consensus.cc:697] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:29:58.513990 29603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:58.514238 29680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:58.514803 29603 raft_consensus.cc:3060] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.514333 29814 consensus_queue.cc:237] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:58.464917 29797 tablet_bootstrap.cc:654] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:58.515937 29720 leader_election.cc:343] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.472190 29823 leader_election.cc:290] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:58.461105 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:58.518007 29604 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.466391 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0789f1aa2e436787725effebf323d6" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:58.521996 29605 raft_consensus.cc:3060] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.523265 29603 raft_consensus.cc:2468] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:29:58.513067 29824 leader_election.cc:290] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:58.464639 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0789f1aa2e436787725effebf323d6" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:58.524583 29679 raft_consensus.cc:3060] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.525812 29721 leader_election.cc:304] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:29:58.527216 29604 raft_consensus.cc:2468] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:29:58.528416 29721 leader_election.cc:304] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:58.528290 29501 catalog_manager.cc:5697] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:58.529273 29800 raft_consensus.cc:2804] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.529886 29800 raft_consensus.cc:697] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:29:58.529305 29605 raft_consensus.cc:2468] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:29:58.487726 29805 raft_consensus.cc:2749] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:58.464543 29795 ts_tablet_manager.cc:1403] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.171s	user 0.015s	sys 0.012s
I20260709 12:29:58.530874 29800 consensus_queue.cc:237] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.533151 29721 leader_election.cc:304] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:58.533998 29795 raft_consensus.cc:359] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.534852 29795 raft_consensus.cc:385] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.535173 29795 raft_consensus.cc:740] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.533998 29797 tablet_bootstrap.cc:492] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.536437 29797 ts_tablet_manager.cc:1403] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.005s
I20260709 12:29:58.489498 29606 raft_consensus.cc:2468] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 1.
I20260709 12:29:58.462056 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.538832 29681 raft_consensus.cc:2468] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:29:58.462023 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31146eb1df474897a336ad843a92e04b" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.539883 29754 raft_consensus.cc:2393] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14afc611141141b18ad748c422bc560b in current term 1: Already voted for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in this term.
I20260709 12:29:58.481433 29796 ts_tablet_manager.cc:1434] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:29:58.529845 29823 raft_consensus.cc:2804] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.541318 29796 tablet_bootstrap.cc:492] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.543519 29795 consensus_queue.cc:260] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.545887 29797 raft_consensus.cc:359] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.546521 29824 raft_consensus.cc:2804] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.547111 29824 raft_consensus.cc:697] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:29:58.548079 29797 raft_consensus.cc:385] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.548406 29797 raft_consensus.cc:740] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.548552 29796 tablet_bootstrap.cc:654] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.547919 29824 consensus_queue.cc:237] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.550693 29679 raft_consensus.cc:2468] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:29:58.552143 29797 consensus_queue.cc:260] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.558911 29797 ts_tablet_manager.cc:1434] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:29:58.560066 29797 tablet_bootstrap.cc:492] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.567341 29823 raft_consensus.cc:697] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:29:58.568451 29823 consensus_queue.cc:237] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.571058 29802 raft_consensus.cc:493] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.571619 29802 raft_consensus.cc:515] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.573843 29802 leader_election.cc:290] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.573915 29795 ts_tablet_manager.cc:1434] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.002s
I20260709 12:29:58.575321 29795 tablet_bootstrap.cc:492] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.570165 29569 leader_election.cc:304] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14afc611141141b18ad748c422bc560b; no voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:29:58.577183 29802 raft_consensus.cc:2749] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:58.578440 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73db145a322c4c099fe1ab23c79649ea" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.579309 29679 raft_consensus.cc:2468] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:29:58.580693 29571 leader_election.cc:304] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.581677 29802 raft_consensus.cc:2804] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.582338 29802 raft_consensus.cc:493] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.582887 29802 raft_consensus.cc:3060] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.589948 29797 tablet_bootstrap.cc:654] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.591457 29569 leader_election.cc:304] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14afc611141141b18ad748c422bc560b; no voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:29:58.594298 29795 tablet_bootstrap.cc:654] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.596850 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73db145a322c4c099fe1ab23c79649ea" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.597615 29754 raft_consensus.cc:2468] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:29:58.601235 29838 raft_consensus.cc:2749] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:58.606580 29805 raft_consensus.cc:493] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.607309 29805 raft_consensus.cc:515] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.607509 29802 raft_consensus.cc:515] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.610392 29805 leader_election.cc:290] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.611359 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.612442 29604 raft_consensus.cc:2393] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34c3f3bb47594d96b0ebe07fa8e74680 in current term 1: Already voted for candidate e6a9fc0aa0024566a24d4b56512c13e6 in this term.
I20260709 12:29:58.614472 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.615211 29797 tablet_bootstrap.cc:492] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.615955 29797 ts_tablet_manager.cc:1403] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.001s
I20260709 12:29:58.616863 29644 leader_election.cc:304] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:29:58.618384 29805 raft_consensus.cc:3060] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.619864 29797 raft_consensus.cc:359] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.620869 29797 raft_consensus.cc:385] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.621184 29797 raft_consensus.cc:740] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.624554 29795 tablet_bootstrap.cc:492] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.625319 29795 ts_tablet_manager.cc:1403] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.004s
I20260709 12:29:58.628296 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73db145a322c4c099fe1ab23c79649ea" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:58.629110 29679 raft_consensus.cc:3060] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.629844 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73db145a322c4c099fe1ab23c79649ea" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:58.630623 29754 raft_consensus.cc:3060] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.631211 29795 raft_consensus.cc:359] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.632005 29795 raft_consensus.cc:385] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.632298 29795 raft_consensus.cc:740] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.633073 29795 consensus_queue.cc:260] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.635082 29797 consensus_queue.cc:260] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.636001 29814 raft_consensus.cc:493] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.636447 29814 raft_consensus.cc:515] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.637432 29797 ts_tablet_manager.cc:1434] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:29:58.638634 29797 tablet_bootstrap.cc:492] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.640055 29679 raft_consensus.cc:2468] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:29:58.641455 29571 leader_election.cc:304] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.642401 29838 raft_consensus.cc:2804] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.642680 29754 raft_consensus.cc:2468] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:29:58.643739 29504 catalog_manager.cc:5697] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:58.644827 29805 raft_consensus.cc:2749] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:58.645464 29797 tablet_bootstrap.cc:654] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.647199 29796 tablet_bootstrap.cc:492] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.647500 29795 ts_tablet_manager.cc:1434] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:29:58.647738 29796 ts_tablet_manager.cc:1403] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.107s	user 0.042s	sys 0.044s
I20260709 12:29:58.648001 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.648811 29795 tablet_bootstrap.cc:492] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.649356 29824 raft_consensus.cc:493] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.650550 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
W20260709 12:29:58.652206 29644 leader_election.cc:343] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:58.652841 29647 leader_election.cc:343] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.653486 29647 leader_election.cc:304] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:29:58.653596 29796 raft_consensus.cc:359] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.649879 29824 raft_consensus.cc:515] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.637476 29802 leader_election.cc:290] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.656345 29795 tablet_bootstrap.cc:654] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.656468 29824 leader_election.cc:290] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:58.654392 29796 raft_consensus.cc:385] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.657063 29796 raft_consensus.cc:740] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.657874 29796 consensus_queue.cc:260] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.658939 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.659557 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.660179 29796 ts_tablet_manager.cc:1434] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
W20260709 12:29:58.660391 29720 leader_election.cc:343] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.652704 29814 leader_election.cc:290] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
W20260709 12:29:58.661211 29721 leader_election.cc:343] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.661489 29805 raft_consensus.cc:2749] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:58.661671 29721 leader_election.cc:304] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a9fc0aa0024566a24d4b56512c13e6; no voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:29:58.661267 29796 tablet_bootstrap.cc:492] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.663411 29824 raft_consensus.cc:2749] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:58.671907 29838 raft_consensus.cc:697] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:58.674038 29838 consensus_queue.cc:237] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.674899 29796 tablet_bootstrap.cc:654] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.680882 29796 tablet_bootstrap.cc:492] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.681389 29796 ts_tablet_manager.cc:1403] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.004s
I20260709 12:29:58.681342 29797 tablet_bootstrap.cc:492] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.683070 29797 ts_tablet_manager.cc:1403] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.009s
I20260709 12:29:58.683198 29795 tablet_bootstrap.cc:492] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.683816 29795 ts_tablet_manager.cc:1403] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 12:29:58.684619 29796 raft_consensus.cc:359] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.684441 29504 catalog_manager.cc:5697] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 0 to 1, leader changed from <none> to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 1 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:58.686195 29797 raft_consensus.cc:359] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.687002 29797 raft_consensus.cc:385] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.685343 29796 raft_consensus.cc:385] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.686832 29795 raft_consensus.cc:359] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.687539 29796 raft_consensus.cc:740] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.687865 29795 raft_consensus.cc:385] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.688320 29795 raft_consensus.cc:740] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.687402 29797 raft_consensus.cc:740] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.688858 29796 consensus_queue.cc:260] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.689183 29795 consensus_queue.cc:260] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.689611 29797 consensus_queue.cc:260] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.691710 29795 ts_tablet_manager.cc:1434] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:58.691955 29796 ts_tablet_manager.cc:1434] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:29:58.692286 29797 ts_tablet_manager.cc:1434] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:29:58.692891 29795 tablet_bootstrap.cc:492] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.693105 29796 tablet_bootstrap.cc:492] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.699882 29501 catalog_manager.cc:5697] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:58.701865 29795 tablet_bootstrap.cc:654] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.702000 29501 catalog_manager.cc:5697] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:58.703476 29796 tablet_bootstrap.cc:654] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.694696 29797 tablet_bootstrap.cc:492] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.708832 29796 tablet_bootstrap.cc:492] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.709313 29796 ts_tablet_manager.cc:1403] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 12:29:58.712036 29796 raft_consensus.cc:359] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.712724 29796 raft_consensus.cc:385] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.712992 29796 raft_consensus.cc:740] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.713764 29796 consensus_queue.cc:260] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.715572 29797 tablet_bootstrap.cc:654] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.716064 29796 ts_tablet_manager.cc:1434] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:29:58.717095 29796 tablet_bootstrap.cc:492] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:29:58.723241 29796 tablet_bootstrap.cc:654] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.728463 29795 tablet_bootstrap.cc:492] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.729128 29795 ts_tablet_manager.cc:1403] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.013s
I20260709 12:29:58.732153 29795 raft_consensus.cc:359] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.732688 29795 raft_consensus.cc:385] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.732949 29795 raft_consensus.cc:740] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.733093 29796 tablet_bootstrap.cc:492] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:29:58.733592 29796 ts_tablet_manager.cc:1403] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:29:58.733995 29797 tablet_bootstrap.cc:492] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.733767 29795 consensus_queue.cc:260] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.734475 29797 ts_tablet_manager.cc:1403] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.007s
I20260709 12:29:58.735881 29795 ts_tablet_manager.cc:1434] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:58.735996 29796 raft_consensus.cc:359] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.736676 29796 raft_consensus.cc:385] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.736836 29795 tablet_bootstrap.cc:492] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:29:58.736964 29796 raft_consensus.cc:740] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.737167 29797 raft_consensus.cc:359] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.737816 29797 raft_consensus.cc:385] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.737763 29796 consensus_queue.cc:260] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.738190 29797 raft_consensus.cc:740] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.739006 29797 consensus_queue.cc:260] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.739766 29796 ts_tablet_manager.cc:1434] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:58.745507 29797 ts_tablet_manager.cc:1434] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:29:58.746507 29797 tablet_bootstrap.cc:492] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:29:58.747797 29795 tablet_bootstrap.cc:654] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.751538 29838 raft_consensus.cc:493] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.752007 29797 tablet_bootstrap.cc:654] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.752031 29838 raft_consensus.cc:515] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.754733 29838 leader_election.cc:290] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.756485 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16a7086995e4967b47d2db8d9727c86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.757279 29754 raft_consensus.cc:2468] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:29:58.758883 29569 leader_election.cc:304] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:58.757324 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16a7086995e4967b47d2db8d9727c86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
W20260709 12:29:58.761397 29571 leader_election.cc:343] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.762460 29838 raft_consensus.cc:2804] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.762976 29838 raft_consensus.cc:493] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.763320 29838 raft_consensus.cc:3060] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.769666 29795 tablet_bootstrap.cc:492] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:29:58.770151 29795 ts_tablet_manager.cc:1403] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.016s
I20260709 12:29:58.770500 29797 tablet_bootstrap.cc:492] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:29:58.770998 29797 ts_tablet_manager.cc:1403] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.012s
I20260709 12:29:58.772324 29795 raft_consensus.cc:359] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.772856 29795 raft_consensus.cc:385] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.773054 29795 raft_consensus.cc:740] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.773618 29795 consensus_queue.cc:260] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.773592 29797 raft_consensus.cc:359] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.774392 29797 raft_consensus.cc:385] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.774672 29797 raft_consensus.cc:740] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.775615 29795 ts_tablet_manager.cc:1434] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:29:58.775413 29797 consensus_queue.cc:260] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.776460 29838 raft_consensus.cc:515] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.780313 29797 ts_tablet_manager.cc:1434] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:29:58.780838 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16a7086995e4967b47d2db8d9727c86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:58.781402 29679 raft_consensus.cc:3060] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.782326 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16a7086995e4967b47d2db8d9727c86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:58.782912 29838 leader_election.cc:290] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.782936 29754 raft_consensus.cc:3060] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.788174 29679 raft_consensus.cc:2468] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:29:58.789830 29571 leader_election.cc:304] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.790009 29754 raft_consensus.cc:2468] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:29:58.790704 29838 raft_consensus.cc:2804] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.791164 29838 raft_consensus.cc:697] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:58.791930 29838 consensus_queue.cc:237] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.798521 29504 catalog_manager.cc:5697] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 0 to 1, leader changed from <none> to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 1 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:58.855999 29838 raft_consensus.cc:493] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.856660 29838 raft_consensus.cc:515] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.858968 29838 leader_election.cc:290] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.859767 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.860157 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.860558 29679 raft_consensus.cc:2468] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:29:58.860777 29754 raft_consensus.cc:2468] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:29:58.861666 29571 leader_election.cc:304] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.861871 29838 raft_consensus.cc:493] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.862404 29842 raft_consensus.cc:2804] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.862349 29838 raft_consensus.cc:515] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.862871 29842 raft_consensus.cc:493] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.863175 29842 raft_consensus.cc:3060] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.864241 29838 leader_election.cc:290] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.865203 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:29:58.865392 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.865821 29679 raft_consensus.cc:2468] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:29:58.866112 29754 raft_consensus.cc:2468] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:29:58.866876 29571 leader_election.cc:304] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.867652 29838 raft_consensus.cc:2804] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.868009 29838 raft_consensus.cc:493] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.868278 29838 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.870214 29842 raft_consensus.cc:515] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.872151 29842 leader_election.cc:290] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.872999 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:58.873332 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:58.873561 29679 raft_consensus.cc:3060] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.874015 29754 raft_consensus.cc:3060] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.874369 29838 raft_consensus.cc:515] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.876700 29838 leader_election.cc:290] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.877389 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:58.877939 29681 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.880568 29754 raft_consensus.cc:2468] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:29:58.881872 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:58.882162 29569 leader_election.cc:304] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:58.882486 29754 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.883189 29838 raft_consensus.cc:2804] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.883688 29838 raft_consensus.cc:697] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:58.884711 29681 raft_consensus.cc:2468] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:29:58.884582 29838 consensus_queue.cc:237] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.886519 29679 raft_consensus.cc:2468] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:29:58.886068 29571 leader_election.cc:304] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.888012 29842 raft_consensus.cc:2804] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.888538 29842 raft_consensus.cc:697] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:58.889465 29842 consensus_queue.cc:237] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.891464 29754 raft_consensus.cc:2468] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:29:58.898746 29504 catalog_manager.cc:5697] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 0 to 1, leader changed from <none> to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 1 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:58.911293 29504 catalog_manager.cc:5697] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 0 to 1, leader changed from <none> to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 1 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:58.915232 29805 raft_consensus.cc:493] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.915795 29805 raft_consensus.cc:515] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.917822 29805 leader_election.cc:290] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.918678 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba5d6d6dc304485a0075004f4d9d38f" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:29:58.918924 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba5d6d6dc304485a0075004f4d9d38f" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:29:58.919375 29604 raft_consensus.cc:2468] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 0.
I20260709 12:29:58.919516 29754 raft_consensus.cc:2468] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 0.
I20260709 12:29:58.920377 29647 leader_election.cc:304] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.921053 29805 raft_consensus.cc:2804] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.921329 29805 raft_consensus.cc:493] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.921567 29805 raft_consensus.cc:3060] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.926633 29805 raft_consensus.cc:515] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.928308 29805 leader_election.cc:290] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:58.929250 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba5d6d6dc304485a0075004f4d9d38f" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:58.929551 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba5d6d6dc304485a0075004f4d9d38f" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:58.930012 29604 raft_consensus.cc:3060] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.930191 29754 raft_consensus.cc:3060] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.932183 29814 consensus_queue.cc:1048] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:58.936805 29604 raft_consensus.cc:2468] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 1.
I20260709 12:29:58.936968 29754 raft_consensus.cc:2468] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 1.
I20260709 12:29:58.938262 29647 leader_election.cc:304] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:58.939110 29814 raft_consensus.cc:2804] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.939599 29814 raft_consensus.cc:697] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:29:58.940452 29814 consensus_queue.cc:237] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:58.942291 29805 consensus_queue.cc:1048] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:58.964152 29501 catalog_manager.cc:5697] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:58.982914 29824 consensus_queue.cc:1048] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:58.993700 29833 consensus_queue.cc:1048] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:59.043824 29833 consensus_queue.cc:1048] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.054437 29824 consensus_queue.cc:1048] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.057193 29838 consensus_queue.cc:1048] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.058092 29842 consensus_queue.cc:1048] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.077944 29824 consensus_queue.cc:1048] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.094020 29833 consensus_queue.cc:1048] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.183990 29681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31146eb1df474897a336ad843a92e04b"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
mode: GRACEFUL
new_leader_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:47382
I20260709 12:29:59.184512 29681 raft_consensus.cc:606] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Received request to transfer leadership to TS 14afc611141141b18ad748c422bc560b
I20260709 12:29:59.197301 29755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "308e90191a5847379ea3e11972042dfb"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
mode: GRACEFUL
new_leader_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:56192
I20260709 12:29:59.197840 29755 raft_consensus.cc:606] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Received request to transfer leadership to TS 14afc611141141b18ad748c422bc560b
I20260709 12:29:59.203238 29755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f0789f1aa2e436787725effebf323d6"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
mode: GRACEFUL
new_leader_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:56192
I20260709 12:29:59.203763 29755 raft_consensus.cc:606] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Received request to transfer leadership to TS 14afc611141141b18ad748c422bc560b
I20260709 12:29:59.209069 29755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
mode: GRACEFUL
new_leader_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:56192
I20260709 12:29:59.209600 29755 raft_consensus.cc:606] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Received request to transfer leadership to TS 14afc611141141b18ad748c422bc560b
I20260709 12:29:59.216684 29842 consensus_queue.cc:1048] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.225395 29604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73db145a322c4c099fe1ab23c79649ea"
dest_uuid: "14afc611141141b18ad748c422bc560b"
mode: GRACEFUL
new_leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:39854
I20260709 12:29:59.226011 29604 raft_consensus.cc:606] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Received request to transfer leadership to TS 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:29:59.229765 29842 consensus_queue.cc:1048] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.234673 29604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac"
dest_uuid: "14afc611141141b18ad748c422bc560b"
mode: GRACEFUL
new_leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:39854
I20260709 12:29:59.235313 29604 raft_consensus.cc:606] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Received request to transfer leadership to TS 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:29:59.242962 29604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd"
dest_uuid: "14afc611141141b18ad748c422bc560b"
mode: GRACEFUL
new_leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:39854
I20260709 12:29:59.243471 29604 raft_consensus.cc:606] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Received request to transfer leadership to TS 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:29:59.248865 29604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16a7086995e4967b47d2db8d9727c86"
dest_uuid: "14afc611141141b18ad748c422bc560b"
mode: GRACEFUL
new_leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:39854
I20260709 12:29:59.249356 29604 raft_consensus.cc:606] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Received request to transfer leadership to TS 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:29:59.254287 29681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ba5d6d6dc304485a0075004f4d9d38f"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
mode: GRACEFUL
new_leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:47382
I20260709 12:29:59.254835 29681 raft_consensus.cc:606] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Received request to transfer leadership to TS e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:29:59.320294 29842 consensus_queue.cc:1048] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.326879 29802 raft_consensus.cc:993] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b: : Instructing follower 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:29:59.327348 29838 raft_consensus.cc:1081] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Signalling peer 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:29:59.329013 29679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:47370
I20260709 12:29:59.330137 29679 raft_consensus.cc:493] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.330523 29679 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.333127 29802 consensus_queue.cc:1048] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.337852 29679 raft_consensus.cc:515] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.340880 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:59.341496 29604 raft_consensus.cc:3055] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.341822 29604 raft_consensus.cc:740] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:59.342149 29679 leader_election.cc:290] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:59.343708 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:59.343557 29604 consensus_queue.cc:260] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.344532 29755 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.345093 29604 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.352541 29604 raft_consensus.cc:2468] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:29:59.352541 29755 raft_consensus.cc:2468] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:29:59.353953 29644 leader_election.cc:304] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:59.355070 29826 raft_consensus.cc:2804] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.355502 29826 raft_consensus.cc:697] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:29:59.356228 29826 consensus_queue.cc:237] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.363101 29501 catalog_manager.cc:5697] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 1 to 2, leader changed from 14afc611141141b18ad748c422bc560b (127.20.109.65) to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.372514 29826 consensus_queue.cc:1048] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.378835 29814 raft_consensus.cc:993] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680: : Instructing follower e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:29:59.379261 29805 raft_consensus.cc:1081] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Signalling peer e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:29:59.381620 29754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ba5d6d6dc304485a0075004f4d9d38f"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:56178
I20260709 12:29:59.382208 29754 raft_consensus.cc:493] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.382577 29754 raft_consensus.cc:3060] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.384344 29805 consensus_queue.cc:1048] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.389807 29754 raft_consensus.cc:515] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.390827 29755 raft_consensus.cc:1240] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Rejecting Update request from peer 34c3f3bb47594d96b0ebe07fa8e74680 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:59.392746 29754 leader_election.cc:290] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 2 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:59.392956 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba5d6d6dc304485a0075004f4d9d38f" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:59.393675 29679 raft_consensus.cc:3055] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.394029 29679 raft_consensus.cc:740] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:29:59.392622 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba5d6d6dc304485a0075004f4d9d38f" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:59.394039 29814 consensus_queue.cc:1059] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:59.394701 29606 raft_consensus.cc:3060] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.395756 29679 consensus_queue.cc:260] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.396947 29679 raft_consensus.cc:3060] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.401489 29823 raft_consensus.cc:993] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6: : Instructing follower 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:29:59.402011 29823 raft_consensus.cc:1081] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Signalling peer 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:29:59.403628 29606 raft_consensus.cc:2468] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 2.
I20260709 12:29:59.403652 29604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878"
dest_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:39844
I20260709 12:29:59.404388 29604 raft_consensus.cc:493] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.404781 29604 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.404754 29802 consensus_queue.cc:1048] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:59.405350 29679 raft_consensus.cc:2468] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 2.
W20260709 12:29:59.406030 29826 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:29:59.408480 29720 leader_election.cc:304] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:59.409444 29823 raft_consensus.cc:2804] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.409919 29823 raft_consensus.cc:697] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:29:59.410750 29823 consensus_queue.cc:237] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.415721 29802 raft_consensus.cc:993] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b: : Instructing follower 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:29:59.416155 29802 raft_consensus.cc:1081] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Signalling peer 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:29:59.420682 29802 consensus_queue.cc:1048] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.421028 29604 raft_consensus.cc:515] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.422544 29681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:47370
I20260709 12:29:59.423240 29681 raft_consensus.cc:493] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.423382 29604 leader_election.cc:290] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:59.423693 29681 raft_consensus.cc:3060] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.424510 29680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:59.422551 29501 catalog_manager.cc:5697] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 1 to 2, leader changed from 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66) to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 2 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:59.425144 29680 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.427677 29753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:59.428401 29753 raft_consensus.cc:3055] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.428699 29753 raft_consensus.cc:740] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:29:59.429495 29753 consensus_queue.cc:260] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.430850 29753 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.434481 29680 raft_consensus.cc:2468] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:29:59.434345 29681 raft_consensus.cc:515] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.436190 29571 leader_election.cc:304] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:59.437052 29802 raft_consensus.cc:2804] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.437512 29802 raft_consensus.cc:697] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:59.437896 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:59.438450 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af8893ad5ad41f99053bce068ddfccd" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:59.438298 29802 consensus_queue.cc:237] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.439898 29753 raft_consensus.cc:2468] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:29:59.440322 29681 leader_election.cc:290] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:59.441256 29604 raft_consensus.cc:3055] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.441593 29604 raft_consensus.cc:740] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:59.442361 29604 consensus_queue.cc:260] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.443274 29604 raft_consensus.cc:3060] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.443620 29679 raft_consensus.cc:1240] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Rejecting Update request from peer 14afc611141141b18ad748c422bc560b for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:59.447387 29502 catalog_manager.cc:5697] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 1 to 2, leader changed from e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67) to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 2 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.450534 29604 raft_consensus.cc:2468] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:29:59.452134 29647 leader_election.cc:304] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:29:59.452872 29826 raft_consensus.cc:2804] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.453351 29826 raft_consensus.cc:697] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:29:59.454581 29826 consensus_queue.cc:237] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.460971 29833 raft_consensus.cc:993] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6: : Instructing follower 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:29:59.461441 29823 raft_consensus.cc:1081] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Signalling peer 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:29:59.462893 29604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "308e90191a5847379ea3e11972042dfb"
dest_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:39844
I20260709 12:29:59.463358 29604 raft_consensus.cc:493] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.463739 29604 raft_consensus.cc:3060] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.463114 29502 catalog_manager.cc:5697] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 1 to 2, leader changed from 14afc611141141b18ad748c422bc560b (127.20.109.65) to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.469086 29604 raft_consensus.cc:515] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.471180 29604 leader_election.cc:290] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:59.472066 29680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:59.472340 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308e90191a5847379ea3e11972042dfb" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:59.472750 29680 raft_consensus.cc:3060] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.472880 29755 raft_consensus.cc:3055] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.473292 29755 raft_consensus.cc:740] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:29:59.474092 29755 consensus_queue.cc:260] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.475391 29755 raft_consensus.cc:3060] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.480064 29680 raft_consensus.cc:2468] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:29:59.481420 29571 leader_election.cc:304] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:59.482239 29802 raft_consensus.cc:2804] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.482357 29755 raft_consensus.cc:2468] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:29:59.482693 29802 raft_consensus.cc:697] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:59.483567 29802 consensus_queue.cc:237] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.489751 29502 catalog_manager.cc:5697] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 1 to 2, leader changed from e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67) to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 2 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.510818 29805 raft_consensus.cc:993] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680: : Instructing follower 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:29:59.511296 29826 raft_consensus.cc:1081] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Signalling peer 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:29:59.512717 29604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31146eb1df474897a336ad843a92e04b"
dest_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:39852
I20260709 12:29:59.513298 29604 raft_consensus.cc:493] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.513679 29604 raft_consensus.cc:3060] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.519337 29604 raft_consensus.cc:515] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:59.521010 29604 leader_election.cc:290] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Requested vote from peers e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:29:59.522068 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31146eb1df474897a336ad843a92e04b" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:59.522097 29680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31146eb1df474897a336ad843a92e04b" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:59.522977 29755 raft_consensus.cc:3060] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.522987 29680 raft_consensus.cc:3055] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.523557 29680 raft_consensus.cc:740] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:29:59.524273 29680 consensus_queue.cc:260] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:59.525336 29680 raft_consensus.cc:3060] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.530336 29755 raft_consensus.cc:2468] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:29:59.531100 29680 raft_consensus.cc:2468] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:29:59.531545 29569 leader_election.cc:304] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:59.532260 29802 raft_consensus.cc:2804] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.532855 29802 raft_consensus.cc:697] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:59.533509 29802 consensus_queue.cc:237] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } }
I20260709 12:29:59.539930 29502 catalog_manager.cc:5697] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 1 to 2, leader changed from 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66) to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 2 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:59.583186 29802 raft_consensus.cc:993] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b: : Instructing follower 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:29:59.583667 29842 raft_consensus.cc:1081] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Signalling peer 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:29:59.585258 29680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73db145a322c4c099fe1ab23c79649ea"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:47370
I20260709 12:29:59.585789 29680 raft_consensus.cc:493] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.586077 29680 raft_consensus.cc:3060] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.592034 29680 raft_consensus.cc:515] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.593750 29680 leader_election.cc:290] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:59.594558 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73db145a322c4c099fe1ab23c79649ea" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:59.594795 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73db145a322c4c099fe1ab23c79649ea" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:59.595291 29604 raft_consensus.cc:3055] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.595341 29755 raft_consensus.cc:3060] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.595741 29604 raft_consensus.cc:740] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:59.596622 29604 consensus_queue.cc:260] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.597913 29604 raft_consensus.cc:3060] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.603319 29755 raft_consensus.cc:2468] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:29:59.604653 29644 leader_election.cc:304] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:59.604918 29604 raft_consensus.cc:2468] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:29:59.605455 29826 raft_consensus.cc:2804] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.605906 29826 raft_consensus.cc:697] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:29:59.606632 29826 consensus_queue.cc:237] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.612682 29502 catalog_manager.cc:5697] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 1 to 2, leader changed from 14afc611141141b18ad748c422bc560b (127.20.109.65) to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.647748 29833 raft_consensus.cc:993] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6: : Instructing follower 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:29:59.648249 29883 raft_consensus.cc:1081] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Signalling peer 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:29:59.649850 29604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f0789f1aa2e436787725effebf323d6"
dest_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:39844
I20260709 12:29:59.650336 29604 raft_consensus.cc:493] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.650671 29604 raft_consensus.cc:3060] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.656170 29604 raft_consensus.cc:515] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.658258 29604 leader_election.cc:290] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:59.659250 29680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0789f1aa2e436787725effebf323d6" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:29:59.659956 29680 raft_consensus.cc:3060] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.659652 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0789f1aa2e436787725effebf323d6" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:59.660547 29755 raft_consensus.cc:3055] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.660797 29755 raft_consensus.cc:740] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:29:59.661507 29755 consensus_queue.cc:260] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.662467 29755 raft_consensus.cc:3060] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.665723 29680 raft_consensus.cc:2468] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:29:59.666950 29571 leader_election.cc:304] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:29:59.667649 29842 raft_consensus.cc:2804] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.668244 29842 raft_consensus.cc:697] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:59.669376 29755 raft_consensus.cc:2468] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:29:59.669554 29842 consensus_queue.cc:237] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.677493 29502 catalog_manager.cc:5697] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 1 to 2, leader changed from e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67) to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 2 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.697922 29838 raft_consensus.cc:993] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b: : Instructing follower 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:29:59.698408 29842 raft_consensus.cc:1081] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Signalling peer 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:29:59.699824 29680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f16a7086995e4967b47d2db8d9727c86"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:47370
I20260709 12:29:59.700393 29680 raft_consensus.cc:493] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.700760 29680 raft_consensus.cc:3060] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.705952 29680 raft_consensus.cc:515] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.707721 29680 leader_election.cc:290] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:29:59.708601 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16a7086995e4967b47d2db8d9727c86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:29:59.708868 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16a7086995e4967b47d2db8d9727c86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:29:59.709343 29604 raft_consensus.cc:3055] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.709410 29755 raft_consensus.cc:3060] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.709782 29604 raft_consensus.cc:740] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:29:59.710629 29604 consensus_queue.cc:260] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.711910 29604 raft_consensus.cc:3060] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.717446 29755 raft_consensus.cc:2468] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:29:59.718840 29644 leader_election.cc:304] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:29:59.719152 29604 raft_consensus.cc:2468] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:29:59.719569 29826 raft_consensus.cc:2804] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.720068 29826 raft_consensus.cc:697] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:29:59.720799 29826 consensus_queue.cc:237] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:29:59.727180 29502 catalog_manager.cc:5697] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 1 to 2, leader changed from 14afc611141141b18ad748c422bc560b (127.20.109.65) to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.909560 29755 raft_consensus.cc:1275] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.910806 29826 consensus_queue.cc:1048] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.919435 29604 raft_consensus.cc:1275] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.921348 29805 consensus_queue.cc:1048] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.933662 29680 raft_consensus.cc:1275] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.933894 29679 raft_consensus.cc:1275] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.935102 29883 consensus_queue.cc:1048] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.935277 29842 consensus_queue.cc:1048] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.942773 29604 raft_consensus.cc:1275] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.944165 29833 consensus_queue.cc:1048] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.944376 29755 raft_consensus.cc:1275] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.947629 29886 consensus_queue.cc:1048] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.956610 29753 raft_consensus.cc:1275] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.959123 29888 consensus_queue.cc:1048] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.971714 29679 raft_consensus.cc:1275] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.974298 29888 consensus_queue.cc:1048] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.975020 29753 raft_consensus.cc:3060] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.983079 29753 raft_consensus.cc:1275] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.984615 29805 consensus_queue.cc:1048] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:59.993655 29604 raft_consensus.cc:1275] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:59.996068 29826 consensus_queue.cc:1048] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.032035 29753 raft_consensus.cc:1275] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.033420 29826 consensus_queue.cc:1048] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.043629 29604 raft_consensus.cc:1275] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.045292 29805 consensus_queue.cc:1048] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.091104 29753 raft_consensus.cc:1275] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.092710 29888 consensus_queue.cc:1048] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.103860 29679 raft_consensus.cc:1275] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.105579 29888 consensus_queue.cc:1048] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.111083 29753 raft_consensus.cc:1275] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.113349 29888 consensus_queue.cc:1048] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.124845 29679 raft_consensus.cc:1275] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.127511 29842 consensus_queue.cc:1048] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:00.172387 29753 raft_consensus.cc:1275] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.174162 29805 consensus_queue.cc:1048] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.182376 29604 raft_consensus.cc:1275] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.184116 29814 consensus_queue.cc:1048] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:02.412560 29501 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43798:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:02.415540 29501 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:02.474804 29592 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2e91af93e84397aefbce0c8f28af36 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:02.475730 29667 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2e91af93e84397aefbce0c8f28af36 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:02.477944 29667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2e91af93e84397aefbce0c8f28af36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.481230 29745 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2e91af93e84397aefbce0c8f28af36 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:02.476881 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2e91af93e84397aefbce0c8f28af36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.482980 29745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2e91af93e84397aefbce0c8f28af36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.482832 29593 tablet_service.cc:1511] Processing CreateTablet for tablet 226f4948c42d4c7e887e33145ac92d0d (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:02.484772 29593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226f4948c42d4c7e887e33145ac92d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.484890 29670 tablet_service.cc:1511] Processing CreateTablet for tablet 226f4948c42d4c7e887e33145ac92d0d (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:02.492070 29670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226f4948c42d4c7e887e33145ac92d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.498988 29741 tablet_service.cc:1511] Processing CreateTablet for tablet 226f4948c42d4c7e887e33145ac92d0d (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:02.500519 29594 tablet_service.cc:1511] Processing CreateTablet for tablet 36c814c4440a4827ae66538b739a8c86 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:02.502185 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c814c4440a4827ae66538b739a8c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.500643 29741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226f4948c42d4c7e887e33145ac92d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.502068 29668 tablet_service.cc:1511] Processing CreateTablet for tablet 36c814c4440a4827ae66538b739a8c86 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:02.508208 29668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c814c4440a4827ae66538b739a8c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.514333 29742 tablet_service.cc:1511] Processing CreateTablet for tablet 36c814c4440a4827ae66538b739a8c86 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:02.515956 29742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c814c4440a4827ae66538b739a8c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.515782 29596 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce013c7fb09402194bc9928153b7d17 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:02.517201 29596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce013c7fb09402194bc9928153b7d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.520234 29671 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce013c7fb09402194bc9928153b7d17 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:02.521845 29671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce013c7fb09402194bc9928153b7d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.523262 29595 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee011a1cbfd413a8dd23628d9f0a5ce (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:02.524745 29744 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce013c7fb09402194bc9928153b7d17 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:02.526391 29744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce013c7fb09402194bc9928153b7d17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.527962 29669 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee011a1cbfd413a8dd23628d9f0a5ce (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:02.531635 29669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee011a1cbfd413a8dd23628d9f0a5ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.536505 29743 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee011a1cbfd413a8dd23628d9f0a5ce (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:02.537245 29591 tablet_service.cc:1511] Processing CreateTablet for tablet ac8a0c9acac341988c034fc760061cc1 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:02.538983 29743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee011a1cbfd413a8dd23628d9f0a5ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.544006 29666 tablet_service.cc:1511] Processing CreateTablet for tablet ac8a0c9acac341988c034fc760061cc1 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:02.546259 29666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8a0c9acac341988c034fc760061cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.525277 29595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee011a1cbfd413a8dd23628d9f0a5ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.548255 29591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8a0c9acac341988c034fc760061cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.548840 29740 tablet_service.cc:1511] Processing CreateTablet for tablet ac8a0c9acac341988c034fc760061cc1 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:02.551893 29590 tablet_service.cc:1511] Processing CreateTablet for tablet cbeb3de09aa04b69ad441e44b1bb3a86 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:02.553416 29590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbeb3de09aa04b69ad441e44b1bb3a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.554414 29665 tablet_service.cc:1511] Processing CreateTablet for tablet cbeb3de09aa04b69ad441e44b1bb3a86 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:02.555876 29665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbeb3de09aa04b69ad441e44b1bb3a86. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:30:02.556432 29552 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:02.550441 29740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8a0c9acac341988c034fc760061cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.574786 29739 tablet_service.cc:1511] Processing CreateTablet for tablet cbeb3de09aa04b69ad441e44b1bb3a86 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:02.576373 29739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbeb3de09aa04b69ad441e44b1bb3a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.577914 29589 tablet_service.cc:1511] Processing CreateTablet for tablet cee3b43b5e9144329a42dac6c6eaebd5 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:02.583725 29589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee3b43b5e9144329a42dac6c6eaebd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.586803 29664 tablet_service.cc:1511] Processing CreateTablet for tablet cee3b43b5e9144329a42dac6c6eaebd5 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:02.588481 29664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee3b43b5e9144329a42dac6c6eaebd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.633543 29912 tablet_bootstrap.cc:492] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:02.643746 29738 tablet_service.cc:1511] Processing CreateTablet for tablet cee3b43b5e9144329a42dac6c6eaebd5 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:02.645388 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee3b43b5e9144329a42dac6c6eaebd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.664501 29594 tablet_service.cc:1511] Processing CreateTablet for tablet 5cf30fe28983463db2192c753932ec87 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:02.676252 29912 tablet_bootstrap.cc:654] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.681614 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cf30fe28983463db2192c753932ec87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.688082 29665 tablet_service.cc:1511] Processing CreateTablet for tablet 5cf30fe28983463db2192c753932ec87 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:02.689779 29665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cf30fe28983463db2192c753932ec87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.689951 29911 tablet_bootstrap.cc:492] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:30:02.720273 29911 tablet_bootstrap.cc:654] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.720592 29913 tablet_bootstrap.cc:492] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:02.728518 29913 tablet_bootstrap.cc:654] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.720646 29743 tablet_service.cc:1511] Processing CreateTablet for tablet 5cf30fe28983463db2192c753932ec87 (DEFAULT_TABLE table=soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:02.732124 29743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cf30fe28983463db2192c753932ec87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.767414 29913 tablet_bootstrap.cc:492] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:02.767870 29912 tablet_bootstrap.cc:492] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:02.768580 29913 ts_tablet_manager.cc:1403] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.008s
I20260709 12:30:02.768775 29912 ts_tablet_manager.cc:1403] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.136s	user 0.021s	sys 0.021s
I20260709 12:30:02.768939 29911 tablet_bootstrap.cc:492] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:02.769665 29911 ts_tablet_manager.cc:1403] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.009s
I20260709 12:30:02.771937 29913 raft_consensus.cc:359] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.773072 29913 raft_consensus.cc:385] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.773013 29911 raft_consensus.cc:359] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.773664 29913 raft_consensus.cc:740] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.774053 29911 raft_consensus.cc:385] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.773767 29912 raft_consensus.cc:359] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.774531 29911 raft_consensus.cc:740] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.774950 29912 raft_consensus.cc:385] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.774700 29913 consensus_queue.cc:260] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.775347 29912 raft_consensus.cc:740] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.776194 29912 consensus_queue.cc:260] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.777793 29913 ts_tablet_manager.cc:1434] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:30:02.779100 29912 ts_tablet_manager.cc:1434] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:30:02.779116 29913 tablet_bootstrap.cc:492] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:02.780381 29912 tablet_bootstrap.cc:492] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:02.787551 29913 tablet_bootstrap.cc:654] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.788105 29912 tablet_bootstrap.cc:654] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.775511 29911 consensus_queue.cc:260] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.813419 29913 tablet_bootstrap.cc:492] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:02.814209 29913 ts_tablet_manager.cc:1403] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.013s
I20260709 12:30:02.815264 29911 ts_tablet_manager.cc:1434] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 12:30:02.816460 29912 tablet_bootstrap.cc:492] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:02.816504 29911 tablet_bootstrap.cc:492] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:30:02.817225 29912 ts_tablet_manager.cc:1403] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.020s
I20260709 12:30:02.817786 29913 raft_consensus.cc:359] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.819079 29913 raft_consensus.cc:385] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.819535 29913 raft_consensus.cc:740] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.820559 29913 consensus_queue.cc:260] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.821363 29912 raft_consensus.cc:359] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.822259 29912 raft_consensus.cc:385] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.822654 29912 raft_consensus.cc:740] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.823760 29913 ts_tablet_manager.cc:1434] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:30:02.823637 29912 consensus_queue.cc:260] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.825215 29913 tablet_bootstrap.cc:492] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:02.826390 29912 ts_tablet_manager.cc:1434] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:30:02.828069 29912 tablet_bootstrap.cc:492] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:02.834911 29913 tablet_bootstrap.cc:654] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.836282 29912 tablet_bootstrap.cc:654] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.843456 29911 tablet_bootstrap.cc:654] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.846104 29913 tablet_bootstrap.cc:492] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:02.846292 29842 raft_consensus.cc:493] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:02.847350 29913 ts_tablet_manager.cc:1403] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:30:02.847805 29912 tablet_bootstrap.cc:492] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:02.848788 29912 ts_tablet_manager.cc:1403] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:30:02.851722 29913 raft_consensus.cc:359] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.852233 29912 raft_consensus.cc:359] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.852916 29913 raft_consensus.cc:385] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.853320 29913 raft_consensus.cc:740] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.847157 29842 raft_consensus.cc:515] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.854290 29913 consensus_queue.cc:260] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.857293 29913 ts_tablet_manager.cc:1434] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:30:02.858357 29912 raft_consensus.cc:385] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.858647 29913 tablet_bootstrap.cc:492] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:02.858843 29912 raft_consensus.cc:740] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.859943 29912 consensus_queue.cc:260] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.857434 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2e91af93e84397aefbce0c8f28af36" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:02.860391 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2e91af93e84397aefbce0c8f28af36" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:30:02.861207 29679 raft_consensus.cc:2468] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:30:02.862763 29912 ts_tablet_manager.cc:1434] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:30:02.863189 29571 leader_election.cc:304] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:02.864161 29912 tablet_bootstrap.cc:492] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:02.868568 29922 raft_consensus.cc:2804] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:02.869257 29922 raft_consensus.cc:493] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:02.869656 29922 raft_consensus.cc:3060] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:02.871762 29842 leader_election.cc:290] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:02.872712 29912 tablet_bootstrap.cc:654] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.861244 29754 raft_consensus.cc:2468] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:30:02.881758 29913 tablet_bootstrap.cc:654] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.885890 29912 tablet_bootstrap.cc:492] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:02.886626 29912 ts_tablet_manager.cc:1403] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 12:30:02.886543 29922 raft_consensus.cc:515] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.890337 29912 raft_consensus.cc:359] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.891305 29912 raft_consensus.cc:385] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.891427 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2e91af93e84397aefbce0c8f28af36" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:02.891732 29912 raft_consensus.cc:740] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.892117 29754 raft_consensus.cc:3060] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:02.892974 29912 consensus_queue.cc:260] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.895852 29912 ts_tablet_manager.cc:1434] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:30:02.897094 29912 tablet_bootstrap.cc:492] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:02.898895 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2e91af93e84397aefbce0c8f28af36" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:02.899706 29679 raft_consensus.cc:3060] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:02.901063 29754 raft_consensus.cc:2468] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:30:02.902794 29569 leader_election.cc:304] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:02.903749 29842 raft_consensus.cc:2804] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:02.904518 29912 tablet_bootstrap.cc:654] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.904637 29842 raft_consensus.cc:697] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:30:02.905949 29922 leader_election.cc:290] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:02.916435 29842 consensus_queue.cc:237] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.925866 29913 tablet_bootstrap.cc:492] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:02.929378 29913 ts_tablet_manager.cc:1403] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.002s
I20260709 12:30:02.930246 29899 raft_consensus.cc:493] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:02.931798 29899 raft_consensus.cc:515] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.932432 29679 raft_consensus.cc:2468] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:30:02.934791 29913 raft_consensus.cc:359] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.936095 29913 raft_consensus.cc:385] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.936462 29913 raft_consensus.cc:740] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.937390 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
W20260709 12:30:02.939657 29644 leader_election.cc:343] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:02.939936 29911 tablet_bootstrap.cc:492] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:02.940518 29911 ts_tablet_manager.cc:1403] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.027s
I20260709 12:30:02.940448 29899 leader_election.cc:290] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:02.937477 29913 consensus_queue.cc:260] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.943928 29913 ts_tablet_manager.cc:1434] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:30:02.947024 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:02.947654 29911 raft_consensus.cc:359] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.949290 29912 tablet_bootstrap.cc:492] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:02.949508 29911 raft_consensus.cc:385] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.950068 29911 raft_consensus.cc:740] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.950276 29912 ts_tablet_manager.cc:1403] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.010s
I20260709 12:30:02.949649 29913 tablet_bootstrap.cc:492] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:02.951140 29911 consensus_queue.cc:260] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.954299 29911 ts_tablet_manager.cc:1434] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:30:02.954741 29912 raft_consensus.cc:359] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.955572 29912 raft_consensus.cc:385] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.956306 29912 raft_consensus.cc:740] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
W20260709 12:30:02.949994 29647 leader_election.cc:343] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:02.957209 29912 consensus_queue.cc:260] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.957732 29647 leader_election.cc:304] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:02.959124 29899 raft_consensus.cc:2749] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:02.959892 29912 ts_tablet_manager.cc:1434] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:30:02.959635 29502 catalog_manager.cc:5697] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 0 to 1, leader changed from <none> to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 1 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:02.970963 29912 tablet_bootstrap.cc:492] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:02.964481 29842 raft_consensus.cc:493] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:02.974251 29842 raft_consensus.cc:515] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.978490 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:02.979916 29912 tablet_bootstrap.cc:654] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:02.980326 29571 leader_election.cc:343] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:02.983016 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:30:02.984333 29842 leader_election.cc:290] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:02.985250 29911 tablet_bootstrap.cc:492] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
W20260709 12:30:02.986207 29569 leader_election.cc:343] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:02.986801 29569 leader_election.cc:304] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14afc611141141b18ad748c422bc560b; no voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:02.987674 29842 raft_consensus.cc:2749] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:02.987855 29912 tablet_bootstrap.cc:492] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:02.988543 29912 ts_tablet_manager.cc:1403] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 12:30:02.991580 29912 raft_consensus.cc:359] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.992312 29912 raft_consensus.cc:385] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.992620 29912 raft_consensus.cc:740] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.993203 29913 tablet_bootstrap.cc:654] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.993464 29912 consensus_queue.cc:260] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:02.994912 29911 tablet_bootstrap.cc:654] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.996263 29912 ts_tablet_manager.cc:1434] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:30:03.003851 29912 tablet_bootstrap.cc:492] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:03.012564 29912 tablet_bootstrap.cc:654] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.012755 29911 tablet_bootstrap.cc:492] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:03.013465 29911 ts_tablet_manager.cc:1403] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.008s
I20260709 12:30:03.018381 29913 tablet_bootstrap.cc:492] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:03.019225 29913 ts_tablet_manager.cc:1403] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.017s
I20260709 12:30:03.022583 29911 raft_consensus.cc:359] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.023536 29911 raft_consensus.cc:385] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.023113 29913 raft_consensus.cc:359] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.023892 29911 raft_consensus.cc:740] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.024051 29913 raft_consensus.cc:385] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.024502 29913 raft_consensus.cc:740] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.024813 29911 consensus_queue.cc:260] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.025620 29913 consensus_queue.cc:260] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.027793 29911 ts_tablet_manager.cc:1434] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:30:03.028991 29913 ts_tablet_manager.cc:1434] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:30:03.029068 29911 tablet_bootstrap.cc:492] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:30:03.030392 29913 tablet_bootstrap.cc:492] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:03.032855 29912 tablet_bootstrap.cc:492] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:03.033501 29912 ts_tablet_manager.cc:1403] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.010s
I20260709 12:30:03.038048 29912 raft_consensus.cc:359] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.038807 29913 tablet_bootstrap.cc:654] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.039105 29912 raft_consensus.cc:385] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.039525 29912 raft_consensus.cc:740] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.040449 29912 consensus_queue.cc:260] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.043311 29912 ts_tablet_manager.cc:1434] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.008s
I20260709 12:30:03.038815 29911 tablet_bootstrap.cc:654] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.044576 29912 tablet_bootstrap.cc:492] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:03.053829 29912 tablet_bootstrap.cc:654] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.055922 29913 tablet_bootstrap.cc:492] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:03.056735 29913 ts_tablet_manager.cc:1403] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.017s
I20260709 12:30:03.061151 29913 raft_consensus.cc:359] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.061969 29913 raft_consensus.cc:385] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.062263 29913 raft_consensus.cc:740] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.063208 29913 consensus_queue.cc:260] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.064385 29912 tablet_bootstrap.cc:492] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:03.065100 29912 ts_tablet_manager.cc:1403] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:30:03.065743 29913 ts_tablet_manager.cc:1434] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:30:03.067625 29913 tablet_bootstrap.cc:492] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:03.068778 29912 raft_consensus.cc:359] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.069569 29912 raft_consensus.cc:385] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.069800 29912 raft_consensus.cc:740] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.070560 29912 consensus_queue.cc:260] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.072301 29911 tablet_bootstrap.cc:492] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:03.073247 29911 ts_tablet_manager.cc:1403] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.007s
I20260709 12:30:03.073295 29912 ts_tablet_manager.cc:1434] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:30:03.074083 29883 raft_consensus.cc:493] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.074950 29912 tablet_bootstrap.cc:492] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680: Bootstrap starting.
I20260709 12:30:03.074875 29883 raft_consensus.cc:515] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.078294 29913 tablet_bootstrap.cc:654] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.078204 29911 raft_consensus.cc:359] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.079234 29911 raft_consensus.cc:385] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.079818 29911 raft_consensus.cc:740] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.080868 29911 consensus_queue.cc:260] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.083621 29911 ts_tablet_manager.cc:1434] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:30:03.085608 29911 tablet_bootstrap.cc:492] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:30:03.089740 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226f4948c42d4c7e887e33145ac92d0d" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.090752 29679 raft_consensus.cc:2468] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:30:03.092514 29720 leader_election.cc:304] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:03.096138 29883 leader_election.cc:290] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.096385 29943 raft_consensus.cc:493] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.096437 29911 tablet_bootstrap.cc:654] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.097018 29883 raft_consensus.cc:493] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.097568 29883 raft_consensus.cc:515] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.099969 29943 raft_consensus.cc:515] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.105849 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.107115 29679 raft_consensus.cc:2468] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:30:03.109869 29720 leader_election.cc:304] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:03.115154 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.117342 29883 leader_election.cc:290] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.118193 29883 raft_consensus.cc:2804] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.119937 29883 raft_consensus.cc:493] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.120232 29912 tablet_bootstrap.cc:654] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:03.121198 29720 leader_election.cc:343] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.120323 29883 raft_consensus.cc:3060] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.124681 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226f4948c42d4c7e887e33145ac92d0d" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:03.127679 29842 raft_consensus.cc:493] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.128526 29943 leader_election.cc:290] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.128403 29842 raft_consensus.cc:515] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.132526 29842 leader_election.cc:290] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.133601 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:03.134186 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.134948 29679 raft_consensus.cc:2468] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 0.
I20260709 12:30:03.135211 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:03.135991 29606 raft_consensus.cc:2468] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:30:03.136653 29571 leader_election.cc:304] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:03.122889 29942 raft_consensus.cc:2804] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.138127 29942 raft_consensus.cc:493] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.140988 29883 raft_consensus.cc:515] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.141587 29911 tablet_bootstrap.cc:492] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:03.142253 29911 ts_tablet_manager.cc:1403] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.024s
I20260709 12:30:03.143216 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:30:03.140525 29842 raft_consensus.cc:2804] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.144801 29842 raft_consensus.cc:493] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.145195 29842 raft_consensus.cc:3060] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.148418 29911 raft_consensus.cc:359] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.148871 29927 raft_consensus.cc:493] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.151017 29911 raft_consensus.cc:385] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.151212 29927 raft_consensus.cc:515] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
W20260709 12:30:03.152842 29569 leader_election.cc:343] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:03.155733 29721 leader_election.cc:343] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.156495 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cf30fe28983463db2192c753932ec87" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
W20260709 12:30:03.157143 29721 leader_election.cc:343] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.158006 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cf30fe28983463db2192c753932ec87" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
W20260709 12:30:03.160130 29644 leader_election.cc:343] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.152834 29883 leader_election.cc:290] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.155815 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226f4948c42d4c7e887e33145ac92d0d" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:03.161933 29679 raft_consensus.cc:3060] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:03.162030 29647 leader_election.cc:343] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.162635 29647 leader_election.cc:304] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:03.163851 29913 tablet_bootstrap.cc:492] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:03.164778 29913 ts_tablet_manager.cc:1403] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.017s
I20260709 12:30:03.163771 29899 raft_consensus.cc:2749] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.167568 29927 leader_election.cc:290] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.169708 29913 raft_consensus.cc:359] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.171096 29913 raft_consensus.cc:385] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.138507 29942 raft_consensus.cc:3060] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.171423 29913 raft_consensus.cc:740] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.172052 29927 raft_consensus.cc:493] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.171815 29911 raft_consensus.cc:740] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.172660 29927 raft_consensus.cc:515] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.175679 29679 raft_consensus.cc:2468] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:30:03.176505 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:03.177299 29606 raft_consensus.cc:2468] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 0.
I20260709 12:30:03.177325 29720 leader_election.cc:304] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:03.176662 29911 consensus_queue.cc:260] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.158586 29721 leader_election.cc:304] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:30:03.178367 29883 raft_consensus.cc:2804] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.179368 29647 leader_election.cc:304] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:03.184335 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226f4948c42d4c7e887e33145ac92d0d" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
W20260709 12:30:03.186054 29721 leader_election.cc:343] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.172510 29913 consensus_queue.cc:260] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.180764 29912 tablet_bootstrap.cc:492] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680: No bootstrap required, opened a new log
I20260709 12:30:03.186210 29946 raft_consensus.cc:2804] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.188364 29912 ts_tablet_manager.cc:1403] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent bootstrapping tablet: real 0.114s	user 0.023s	sys 0.025s
I20260709 12:30:03.189085 29913 ts_tablet_manager.cc:1434] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:30:03.182212 29883 raft_consensus.cc:697] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:03.182365 29943 raft_consensus.cc:2804] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.191062 29943 raft_consensus.cc:493] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.191475 29943 raft_consensus.cc:3060] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.191529 29883 consensus_queue.cc:237] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.196553 29946 raft_consensus.cc:493] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.190220 29940 raft_consensus.cc:493] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.199355 29940 raft_consensus.cc:515] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.198450 29912 raft_consensus.cc:359] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.202020 29912 raft_consensus.cc:385] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.202286 29912 raft_consensus.cc:740] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.203078 29913 tablet_bootstrap.cc:492] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:03.203018 29912 consensus_queue.cc:260] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.204864 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.204759 29943 raft_consensus.cc:515] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.206010 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:30:03.208176 29940 leader_election.cc:290] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.208896 29940 raft_consensus.cc:493] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.209450 29940 raft_consensus.cc:515] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.210170 29754 raft_consensus.cc:2468] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 0.
I20260709 12:30:03.181059 29842 raft_consensus.cc:515] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.211823 29940 leader_election.cc:290] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.212546 29946 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.184515 29911 ts_tablet_manager.cc:1434] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.004s
I20260709 12:30:03.197615 29942 raft_consensus.cc:515] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.210019 29680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:03.213987 29680 raft_consensus.cc:3060] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.214867 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.215636 29681 raft_consensus.cc:2468] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:30:03.216895 29678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:03.217537 29678 raft_consensus.cc:3060] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.217972 29911 tablet_bootstrap.cc:492] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:30:03.219408 29720 leader_election.cc:304] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:03.222977 29680 raft_consensus.cc:2468] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:30:03.230675 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:03.232473 29720 leader_election.cc:304] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:03.223743 29842 leader_election.cc:290] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.233646 29940 raft_consensus.cc:2804] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.234297 29942 leader_election.cc:290] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.198153 29927 leader_election.cc:290] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.238754 29913 tablet_bootstrap.cc:654] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.226527 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:03.239419 29681 raft_consensus.cc:3060] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.240047 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:03.240857 29754 raft_consensus.cc:3060] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.227430 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:03.246975 29606 raft_consensus.cc:2468] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
W20260709 12:30:03.247061 29721 leader_election.cc:343] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.228389 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:03.228499 29678 raft_consensus.cc:2468] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:30:03.248237 29604 raft_consensus.cc:3060] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.249240 29571 leader_election.cc:304] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:03.230216 29943 leader_election.cc:290] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.238458 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:03.250767 29842 raft_consensus.cc:2804] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:30:03.252070 29627 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb700 after lost signal to thread 20920
I20260709 12:30:03.253381 29842 raft_consensus.cc:697] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
W20260709 12:30:03.254962 29627 debug-util.cc:398] Leaking SignalData structure 0x7b080017d2a0 after lost signal to thread 29630
I20260709 12:30:03.225705 29948 raft_consensus.cc:2804] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.257284 29948 raft_consensus.cc:493] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.257694 29948 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:03.258164 29627 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1d20 after lost signal to thread 29705
I20260709 12:30:03.260175 29721 leader_election.cc:304] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
W20260709 12:30:03.260584 29627 debug-util.cc:398] Leaking SignalData structure 0x7b080026ec80 after lost signal to thread 29779
I20260709 12:30:03.254498 29842 consensus_queue.cc:237] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.270153 29913 tablet_bootstrap.cc:492] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:03.250708 29754 raft_consensus.cc:2468] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 1.
I20260709 12:30:03.270877 29913 ts_tablet_manager.cc:1403] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.000s
I20260709 12:30:03.262009 29681 raft_consensus.cc:2468] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:30:03.262373 29940 raft_consensus.cc:697] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:03.272390 29940 consensus_queue.cc:237] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.273615 29912 ts_tablet_manager.cc:1434] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.017s
I20260709 12:30:03.274236 29883 raft_consensus.cc:2804] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.274875 29883 raft_consensus.cc:493] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.275311 29883 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.283022 29913 raft_consensus.cc:359] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
W20260709 12:30:03.279390 29721 leader_election.cc:343] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.265380 29946 raft_consensus.cc:515] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.266414 29604 raft_consensus.cc:2468] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:30:03.266763 29911 tablet_bootstrap.cc:654] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.287053 29679 raft_consensus.cc:2393] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a9fc0aa0024566a24d4b56512c13e6 in current term 1: Already voted for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in this term.
I20260709 12:30:03.289485 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:03.287225 29720 leader_election.cc:304] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 14afc611141141b18ad748c422bc560b
I20260709 12:30:03.291285 29950 raft_consensus.cc:2804] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.289383 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:03.294186 29604 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.284065 29948 raft_consensus.cc:515] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.292160 29950 raft_consensus.cc:697] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:03.297015 29948 leader_election.cc:290] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.297186 29950 consensus_queue.cc:237] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.297961 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:03.298708 29679 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.290630 29913 raft_consensus.cc:385] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.292049 29502 catalog_manager.cc:5697] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 0 to 1, leader changed from <none> to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 1 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.301878 29913 raft_consensus.cc:740] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.294881 29946 leader_election.cc:290] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.270530 29503 catalog_manager.cc:5697] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:03.303040 29913 consensus_queue.cc:260] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.305554 29946 raft_consensus.cc:493] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.309193 29913 ts_tablet_manager.cc:1434] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:30:03.306074 29946 raft_consensus.cc:515] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.321933 29604 raft_consensus.cc:2468] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 1.
I20260709 12:30:03.323861 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:03.329530 29679 raft_consensus.cc:2468] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:30:03.333941 29946 leader_election.cc:290] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.335706 29753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee3b43b5e9144329a42dac6c6eaebd5" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:30:03.336484 29753 raft_consensus.cc:2468] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 0.
W20260709 12:30:03.337451 29721 leader_election.cc:343] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.334050 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee3b43b5e9144329a42dac6c6eaebd5" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:03.338388 29605 raft_consensus.cc:2468] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 0.
I20260709 12:30:03.339907 29644 leader_election.cc:304] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:03.340066 29883 raft_consensus.cc:515] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.341253 29754 raft_consensus.cc:2393] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34c3f3bb47594d96b0ebe07fa8e74680 in current term 1: Already voted for candidate e6a9fc0aa0024566a24d4b56512c13e6 in this term.
I20260709 12:30:03.341686 29946 raft_consensus.cc:2804] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.342181 29946 raft_consensus.cc:493] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.342581 29946 raft_consensus.cc:3060] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.345814 29720 leader_election.cc:304] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 14afc611141141b18ad748c422bc560b
I20260709 12:30:03.346325 29913 tablet_bootstrap.cc:492] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6: Bootstrap starting.
I20260709 12:30:03.346509 29647 leader_election.cc:304] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:03.347170 29940 raft_consensus.cc:2804] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.347551 29949 raft_consensus.cc:2804] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.347714 29940 raft_consensus.cc:697] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:03.348181 29949 raft_consensus.cc:697] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:30:03.348707 29940 consensus_queue.cc:237] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.349120 29949 consensus_queue.cc:237] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.361359 29911 tablet_bootstrap.cc:492] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:03.362409 29911 ts_tablet_manager.cc:1403] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.145s	user 0.030s	sys 0.035s
I20260709 12:30:03.365572 29503 catalog_manager.cc:5697] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:03.368039 29503 catalog_manager.cc:5697] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:03.377401 29911 raft_consensus.cc:359] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.388441 29911 raft_consensus.cc:385] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.388880 29911 raft_consensus.cc:740] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.390019 29911 consensus_queue.cc:260] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.393404 29911 ts_tablet_manager.cc:1434] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:30:03.395151 29911 tablet_bootstrap.cc:492] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:30:03.414772 29883 leader_election.cc:290] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.415659 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:03.417121 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:03.415969 29911 tablet_bootstrap.cc:654] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.425258 29504 catalog_manager.cc:5697] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.428721 29842 consensus_queue.cc:1048] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.431169 29946 raft_consensus.cc:515] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.427340 29604 raft_consensus.cc:2393] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a9fc0aa0024566a24d4b56512c13e6 in current term 1: Already voted for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in this term.
I20260709 12:30:03.443120 29721 leader_election.cc:304] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a9fc0aa0024566a24d4b56512c13e6; no voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:30:03.444380 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee3b43b5e9144329a42dac6c6eaebd5" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:03.444511 29883 raft_consensus.cc:2749] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.445168 29605 raft_consensus.cc:3060] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.422492 29502 catalog_manager.cc:5697] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:03.454468 29605 raft_consensus.cc:2468] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 1.
I20260709 12:30:03.456952 29647 leader_election.cc:304] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:03.455734 29913 tablet_bootstrap.cc:654] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.457839 29949 raft_consensus.cc:2804] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.459728 29949 raft_consensus.cc:697] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:30:03.461090 29949 consensus_queue.cc:237] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.462392 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee3b43b5e9144329a42dac6c6eaebd5" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:03.463372 29754 raft_consensus.cc:3060] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.474772 29946 leader_election.cc:290] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.476712 29754 raft_consensus.cc:2468] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 1.
I20260709 12:30:03.483726 29504 catalog_manager.cc:5697] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 1 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.494939 29923 consensus_queue.cc:1048] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.498968 29913 tablet_bootstrap.cc:492] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6: No bootstrap required, opened a new log
I20260709 12:30:03.499558 29913 ts_tablet_manager.cc:1403] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent bootstrapping tablet: real 0.154s	user 0.008s	sys 0.007s
I20260709 12:30:03.513094 29911 tablet_bootstrap.cc:492] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:03.514144 29911 ts_tablet_manager.cc:1403] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.120s	user 0.041s	sys 0.041s
I20260709 12:30:03.516582 29913 raft_consensus.cc:359] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.517431 29913 raft_consensus.cc:385] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.517872 29913 raft_consensus.cc:740] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.518940 29911 raft_consensus.cc:359] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.519220 29913 consensus_queue.cc:260] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.519995 29911 raft_consensus.cc:385] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.520367 29911 raft_consensus.cc:740] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.521570 29913 ts_tablet_manager.cc:1434] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:30:03.521562 29911 consensus_queue.cc:260] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.524060 29911 ts_tablet_manager.cc:1434] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:30:03.525132 29911 tablet_bootstrap.cc:492] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:30:03.533006 29911 tablet_bootstrap.cc:654] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.540656 29911 tablet_bootstrap.cc:492] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:03.541100 29911 ts_tablet_manager.cc:1403] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:30:03.543285 29911 raft_consensus.cc:359] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.543853 29911 raft_consensus.cc:385] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.544054 29911 raft_consensus.cc:740] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.544615 29911 consensus_queue.cc:260] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.546281 29911 ts_tablet_manager.cc:1434] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:03.547542 29911 tablet_bootstrap.cc:492] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b: Bootstrap starting.
I20260709 12:30:03.554209 29911 tablet_bootstrap.cc:654] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.567428 29911 tablet_bootstrap.cc:492] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b: No bootstrap required, opened a new log
I20260709 12:30:03.568254 29911 ts_tablet_manager.cc:1403] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
W20260709 12:30:03.570149 29552 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:03.571993 29911 raft_consensus.cc:359] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.572996 29911 raft_consensus.cc:385] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.573279 29911 raft_consensus.cc:740] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.574343 29911 consensus_queue.cc:260] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.577499 29911 ts_tablet_manager.cc:1434] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:30:03.621685 29605 raft_consensus.cc:3060] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.632320 29883 consensus_queue.cc:1048] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.649436 29943 consensus_queue.cc:1048] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.671278 29842 consensus_queue.cc:1048] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.685480 29923 consensus_queue.cc:1048] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.689787 29923 raft_consensus.cc:493] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.690157 29943 consensus_queue.cc:1048] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.695138 29923 raft_consensus.cc:515] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.699471 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.700644 29681 raft_consensus.cc:2393] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14afc611141141b18ad748c422bc560b in current term 1: Already voted for candidate e6a9fc0aa0024566a24d4b56512c13e6 in this term.
I20260709 12:30:03.705443 29753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:30:03.708706 29569 leader_election.cc:304] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14afc611141141b18ad748c422bc560b; no voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:03.710520 29926 raft_consensus.cc:3060] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.718959 29923 leader_election.cc:290] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.741487 29926 raft_consensus.cc:2749] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.759472 29923 raft_consensus.cc:493] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.760049 29923 raft_consensus.cc:515] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.761962 29605 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.766259 29943 consensus_queue.cc:1048] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.771279 29679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.772284 29679 raft_consensus.cc:2393] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14afc611141141b18ad748c422bc560b in current term 1: Already voted for candidate e6a9fc0aa0024566a24d4b56512c13e6 in this term.
I20260709 12:30:03.776633 29943 consensus_queue.cc:1048] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.782276 29923 leader_election.cc:290] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:03.783078 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" is_pre_election: true
I20260709 12:30:03.784708 29569 leader_election.cc:304] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14afc611141141b18ad748c422bc560b; no voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:03.792141 29946 consensus_queue.cc:1048] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.798136 29923 raft_consensus.cc:2749] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.803301 29943 consensus_queue.cc:1048] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.819172 29943 consensus_queue.cc:1048] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.834096 29949 consensus_queue.cc:1048] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.847399 29943 consensus_queue.cc:1048] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.854826 29948 raft_consensus.cc:493] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.855729 29948 raft_consensus.cc:515] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.859444 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cf30fe28983463db2192c753932ec87" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b" is_pre_election: true
I20260709 12:30:03.860337 29606 raft_consensus.cc:2468] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:30:03.861963 29721 leader_election.cc:304] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:03.863013 29943 raft_consensus.cc:2804] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.863412 29943 raft_consensus.cc:493] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.863771 29943 raft_consensus.cc:3060] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.858439 29948 leader_election.cc:290] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.868396 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cf30fe28983463db2192c753932ec87" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" is_pre_election: true
I20260709 12:30:03.869236 29681 raft_consensus.cc:2468] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 0.
I20260709 12:30:03.895238 29949 consensus_queue.cc:1048] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:30:03.910811 29975 log.cc:927] Time spent T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:30:03.922009 29943 raft_consensus.cc:515] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.925868 29603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cf30fe28983463db2192c753932ec87" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:03.927102 29603 raft_consensus.cc:3060] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.933651 29943 leader_election.cc:290] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:03.935226 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cf30fe28983463db2192c753932ec87" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:03.935989 29681 raft_consensus.cc:3060] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.952436 29899 consensus_queue.cc:1048] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.973335 29603 raft_consensus.cc:2468] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:30:03.974710 29721 leader_election.cc:304] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:03.975092 29681 raft_consensus.cc:2468] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 1.
I20260709 12:30:03.975965 29943 raft_consensus.cc:2804] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.976954 29943 raft_consensus.cc:697] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:03.977881 29943 consensus_queue.cc:237] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:03.999279 29503 catalog_manager.cc:5697] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:04.267654 29753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "226f4948c42d4c7e887e33145ac92d0d"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
mode: GRACEFUL
new_leader_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:56192
I20260709 12:30:04.268559 29753 raft_consensus.cc:606] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Received request to transfer leadership to TS 14afc611141141b18ad748c422bc560b
I20260709 12:30:04.276964 29681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
mode: GRACEFUL
new_leader_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:47382
I20260709 12:30:04.277588 29681 raft_consensus.cc:606] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Received request to transfer leadership to TS 14afc611141141b18ad748c422bc560b
I20260709 12:30:04.284300 29753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
mode: GRACEFUL
new_leader_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:56192
I20260709 12:30:04.285137 29753 raft_consensus.cc:606] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Received request to transfer leadership to TS 14afc611141141b18ad748c422bc560b
I20260709 12:30:04.292807 29753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
mode: GRACEFUL
new_leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:56192
I20260709 12:30:04.293833 29753 raft_consensus.cc:606] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Received request to transfer leadership to TS 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:30:04.300269 29753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
mode: GRACEFUL
new_leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:56192
I20260709 12:30:04.300997 29753 raft_consensus.cc:606] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Received request to transfer leadership to TS 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:30:04.308013 29603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86"
dest_uuid: "14afc611141141b18ad748c422bc560b"
mode: GRACEFUL
new_leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:39854
I20260709 12:30:04.308723 29603 raft_consensus.cc:606] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Received request to transfer leadership to TS 34c3f3bb47594d96b0ebe07fa8e74680
I20260709 12:30:04.355274 29950 raft_consensus.cc:993] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: : Instructing follower 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:30:04.355815 29943 raft_consensus.cc:1081] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Signalling peer 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:30:04.358014 29681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:47356
I20260709 12:30:04.359229 29681 raft_consensus.cc:493] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:04.359673 29681 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.369014 29681 raft_consensus.cc:515] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.371577 29681 leader_election.cc:290] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:04.373070 29603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:04.373159 29753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:04.374043 29753 raft_consensus.cc:3055] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:04.374046 29603 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.374481 29753 raft_consensus.cc:740] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:04.375419 29753 consensus_queue.cc:260] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.376662 29753 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.383096 29753 raft_consensus.cc:2468] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:30:04.383101 29603 raft_consensus.cc:2468] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:30:04.384788 29647 leader_election.cc:304] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:04.385751 29982 raft_consensus.cc:2804] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:04.386180 29982 raft_consensus.cc:697] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:30:04.387015 29982 consensus_queue.cc:237] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.398906 29503 catalog_manager.cc:5697] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 1 to 2, leader changed from e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67) to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.462646 29950 raft_consensus.cc:993] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: : Instructing follower 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:30:04.463201 29943 raft_consensus.cc:1081] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Signalling peer 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:30:04.465425 29603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "226f4948c42d4c7e887e33145ac92d0d"
dest_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:39844
I20260709 12:30:04.466085 29603 raft_consensus.cc:493] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:04.466441 29603 raft_consensus.cc:3060] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.475360 29950 raft_consensus.cc:993] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6: : Instructing follower 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:30:04.476241 29950 raft_consensus.cc:1081] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Signalling peer 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:30:04.477185 29603 raft_consensus.cc:515] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.479642 29604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17"
dest_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:39844
I20260709 12:30:04.480244 29603 leader_election.cc:290] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:04.480460 29604 raft_consensus.cc:493] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:04.480916 29604 raft_consensus.cc:3060] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.483409 29678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226f4948c42d4c7e887e33145ac92d0d" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:04.484208 29678 raft_consensus.cc:3060] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.493083 29604 raft_consensus.cc:515] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.495937 29753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226f4948c42d4c7e887e33145ac92d0d" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:04.496838 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:04.496881 29753 raft_consensus.cc:3055] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:04.497421 29678 raft_consensus.cc:2468] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:30:04.497522 29753 raft_consensus.cc:740] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:04.499183 29681 raft_consensus.cc:3060] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.499665 29571 leader_election.cc:304] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:04.500702 29923 raft_consensus.cc:2804] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:04.501226 29923 raft_consensus.cc:697] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:30:04.502082 29923 consensus_queue.cc:237] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.502686 29943 consensus_queue.cc:1048] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:04.498689 29753 consensus_queue.cc:260] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.508231 29681 raft_consensus.cc:2468] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:30:04.510540 29571 leader_election.cc:304] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:04.511801 29926 raft_consensus.cc:2804] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:04.512307 29926 raft_consensus.cc:697] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:30:04.513140 29926 consensus_queue.cc:237] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.508893 29753 raft_consensus.cc:3060] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.517910 29503 catalog_manager.cc:5697] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 1 to 2, leader changed from e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67) to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 2 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.509330 29604 leader_election.cc:290] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:04.528422 29946 raft_consensus.cc:993] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680: : Instructing follower 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:30:04.528944 29946 raft_consensus.cc:1081] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Signalling peer 14afc611141141b18ad748c422bc560b to start an election
I20260709 12:30:04.531147 29604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86"
dest_uuid: "14afc611141141b18ad748c422bc560b"
 from {username='slave'} at 127.0.0.1:39852
I20260709 12:30:04.530347 29753 raft_consensus.cc:2468] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:30:04.531937 29604 raft_consensus.cc:493] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:04.532549 29604 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.531862 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce013c7fb09402194bc9928153b7d17" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:04.534353 29754 raft_consensus.cc:3055] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:04.534716 29754 raft_consensus.cc:740] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:04.535522 29754 consensus_queue.cc:260] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.537299 29754 raft_consensus.cc:3060] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.544723 29604 raft_consensus.cc:515] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.550521 29754 raft_consensus.cc:2468] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:30:04.551993 29681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:04.552701 29604 leader_election.cc:290] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Requested vote from peers 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:04.552908 29681 raft_consensus.cc:3055] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:04.553429 29681 raft_consensus.cc:740] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:30:04.557196 29754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "14afc611141141b18ad748c422bc560b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:04.557957 29754 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.559660 29943 consensus_queue.cc:1048] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:04.563328 29503 catalog_manager.cc:5697] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 1 to 2, leader changed from e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67) to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 2 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.566049 29754 raft_consensus.cc:2468] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:30:04.565261 29681 consensus_queue.cc:260] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.567476 29569 leader_election.cc:304] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:04.570453 29923 raft_consensus.cc:2804] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:04.568919 29681 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.577205 29923 raft_consensus.cc:697] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Leader. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:30:04.580281 29923 consensus_queue.cc:237] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.604713 29681 raft_consensus.cc:2468] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14afc611141141b18ad748c422bc560b in term 2.
I20260709 12:30:04.612169 29842 raft_consensus.cc:993] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b: : Instructing follower 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:30:04.612818 29842 raft_consensus.cc:1081] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Signalling peer 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:30:04.620995 29678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:47370
I20260709 12:30:04.621587 29678 raft_consensus.cc:493] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:04.621985 29678 raft_consensus.cc:3060] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.622412 29502 catalog_manager.cc:5697] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b reported cstate change: term changed from 1 to 2, leader changed from 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66) to 14afc611141141b18ad748c422bc560b (127.20.109.65). New cstate: current_term: 2 leader_uuid: "14afc611141141b18ad748c422bc560b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.642513 29678 raft_consensus.cc:515] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.645823 29603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:04.645915 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeb3de09aa04b69ad441e44b1bb3a86" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:04.646678 29755 raft_consensus.cc:3060] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.646690 29603 raft_consensus.cc:3055] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:04.648814 29603 raft_consensus.cc:740] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:30:04.649758 29603 consensus_queue.cc:260] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.651577 29603 raft_consensus.cc:3060] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.654984 29678 leader_election.cc:290] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:04.657966 29755 raft_consensus.cc:2468] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:30:04.659530 29644 leader_election.cc:304] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:04.660526 29982 raft_consensus.cc:2804] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:04.660669 29603 raft_consensus.cc:2468] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:30:04.661165 29982 raft_consensus.cc:697] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:30:04.662099 29982 consensus_queue.cc:237] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.671743 29503 catalog_manager.cc:5697] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 1 to 2, leader changed from 14afc611141141b18ad748c422bc560b (127.20.109.65) to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.772253 29755 raft_consensus.cc:1275] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.774040 29982 consensus_queue.cc:1048] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.785029 29603 raft_consensus.cc:1275] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.786785 29899 consensus_queue.cc:1048] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:04.847019 29950 raft_consensus.cc:993] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6: : Instructing follower 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:30:04.847623 29943 raft_consensus.cc:1081] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Signalling peer 34c3f3bb47594d96b0ebe07fa8e74680 to start an election
I20260709 12:30:04.849838 29678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
 from {username='slave'} at 127.0.0.1:47356
I20260709 12:30:04.851083 29678 raft_consensus.cc:493] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:04.851651 29678 raft_consensus.cc:3060] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.865705 29678 raft_consensus.cc:515] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.868561 29678 leader_election.cc:290] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67:37311)
I20260709 12:30:04.869628 29603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:04.869779 29755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8a0c9acac341988c034fc760061cc1" candidate_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
I20260709 12:30:04.870652 29755 raft_consensus.cc:3055] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:04.870548 29603 raft_consensus.cc:3060] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.871398 29755 raft_consensus.cc:740] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:04.872711 29755 consensus_queue.cc:260] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.874362 29755 raft_consensus.cc:3060] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.879561 29603 raft_consensus.cc:2468] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:30:04.881032 29647 leader_election.cc:304] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, 34c3f3bb47594d96b0ebe07fa8e74680; no voters: 
I20260709 12:30:04.881958 29949 raft_consensus.cc:2804] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:04.882422 29949 raft_consensus.cc:697] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Leader. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:30:04.883307 29949 consensus_queue.cc:237] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:04.883752 29755 raft_consensus.cc:2468] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c3f3bb47594d96b0ebe07fa8e74680 in term 2.
I20260709 12:30:04.894142 29502 catalog_manager.cc:5697] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 reported cstate change: term changed from 1 to 2, leader changed from e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67) to 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66). New cstate: current_term: 2 leader_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.963547 29678 raft_consensus.cc:1275] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.965406 29991 consensus_queue.cc:1048] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.980950 29755 raft_consensus.cc:1275] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.983669 29991 consensus_queue.cc:1048] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.009903 29755 raft_consensus.cc:1275] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.011722 29991 consensus_queue.cc:1048] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.023628 29679 raft_consensus.cc:1275] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.027299 29926 consensus_queue.cc:1048] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:05.190140 29679 raft_consensus.cc:1275] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.192191 29926 consensus_queue.cc:1048] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:05.208875 29754 raft_consensus.cc:1275] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 14afc611141141b18ad748c422bc560b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.210664 29991 consensus_queue.cc:1048] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.271169 29603 raft_consensus.cc:1275] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.271621 29754 raft_consensus.cc:1275] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.272796 29949 consensus_queue.cc:1048] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:05.273640 29982 consensus_queue.cc:1048] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.410125 29754 raft_consensus.cc:1275] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.412518 29982 consensus_queue.cc:1048] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:05.423756 29603 raft_consensus.cc:1275] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Refusing update from remote peer 34c3f3bb47594d96b0ebe07fa8e74680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.425788 29899 consensus_queue.cc:1048] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.320763 29503 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43798:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:30:07.346163 29503 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43798:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:30:07.391969 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:30:07.691642 30032 log.cc:927] Time spent T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:30:07.714344 30055 tablet.cc:1724] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.729914 30054 tablet.cc:1724] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:07.756243 29632 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:36c814c4440a4827ae66538b739a8c86)
W20260709 12:30:07.756959 30047 log.cc:927] Time spent T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:30:07.749364 29644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.67:37311, user_credentials={real_user=slave}} blocked reactor thread for 54472.1us
W20260709 12:30:07.811558 29571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.66:45829, user_credentials={real_user=slave}} blocked reactor thread for 48340.4us
I20260709 12:30:07.814739 30065 tablet.cc:1724] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.739941 30060 tablet.cc:1724] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.819159 30066 tablet.cc:1724] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.844159 30068 tablet.cc:1724] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:07.853649 29707 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:ac8a0c9acac341988c034fc760061cc1)
W20260709 12:30:07.842551 29781 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:36c814c4440a4827ae66538b739a8c86)
W20260709 12:30:07.895542 30056 log.cc:927] Time spent T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b: Append to log took a long time: real 0.151s	user 0.003s	sys 0.001s
W20260709 12:30:07.897804 30062 log.cc:927] Time spent T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:30:07.912034 30049 log.cc:927] Time spent T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 12:30:07.911767 29606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86"
dest_uuid: "14afc611141141b18ad748c422bc560b"
mode: GRACEFUL
new_leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:49332
I20260709 12:30:07.912669 29606 raft_consensus.cc:606] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Received request to transfer leadership to TS e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:07.925539 30070 tablet.cc:1724] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.937983 30055 tablet.cc:1724] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:07.986455 30061 log.cc:927] Time spent T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b: Append to log took a long time: real 0.244s	user 0.004s	sys 0.000s
I20260709 12:30:07.995158 30072 tablet.cc:1724] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.997977 30070 tablet.cc:1724] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.927652 30066 tablet.cc:1724] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.924971 30069 tablet.cc:1724] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.036235 30078 tablet.cc:1724] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.040719 29503 catalog_manager.cc:5789] TS 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829) does not have the latest schema for tablet cee3b43b5e9144329a42dac6c6eaebd5 (table soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]). Expected version 1 got 0
I20260709 12:30:08.043553 29503 catalog_manager.cc:5789] TS 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829) does not have the latest schema for tablet cbeb3de09aa04b69ad441e44b1bb3a86 (table soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]). Expected version 1 got 0
I20260709 12:30:08.045059 29503 catalog_manager.cc:5789] TS 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829) does not have the latest schema for tablet 9ee011a1cbfd413a8dd23628d9f0a5ce (table soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]). Expected version 1 got 0
I20260709 12:30:08.011036 30054 tablet.cc:1724] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.053619 30073 tablet.cc:1724] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.058880 30065 tablet.cc:1724] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.067373 30072 tablet.cc:1724] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.070801 30060 tablet.cc:1724] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.067724 29504 catalog_manager.cc:5789] TS 14afc611141141b18ad748c422bc560b (127.20.109.65:33193) does not have the latest schema for tablet 226f4948c42d4c7e887e33145ac92d0d (table soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857]). Expected version 1 got 0
I20260709 12:30:08.075692 29675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
mode: GRACEFUL
new_leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:36106
I20260709 12:30:08.076634 29675 raft_consensus.cc:606] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Received request to transfer leadership to TS e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:08.051738 30080 tablet.cc:1724] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.083949 30072 tablet.cc:1724] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.088973 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:30:08.090031 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:08.075637 30055 tablet.cc:1724] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.102144 30066 tablet.cc:1724] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.103361 30068 tablet.cc:1724] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.101823 30069 tablet.cc:1724] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.119606 30078 tablet.cc:1724] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.119974 30070 tablet.cc:1724] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.133086 29602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878"
dest_uuid: "14afc611141141b18ad748c422bc560b"
mode: GRACEFUL
new_leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:49332
I20260709 12:30:08.134002 29602 raft_consensus.cc:606] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Received request to transfer leadership to TS e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:08.144728 30054 tablet.cc:1724] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:08.148516 29675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac"
dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
mode: GRACEFUL
new_leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:36106
I20260709 12:30:08.149583 29675 raft_consensus.cc:606] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Received request to transfer leadership to TS e6a9fc0aa0024566a24d4b56512c13e6
I20260709 12:30:08.158198 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:30:08.159128 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:08.191656 29503 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96: soft_deleted_table [id=a6ffc2cadbf44796a3a7dc2e1965b857] alter complete (version 1)
I20260709 12:30:08.253822 30023 raft_consensus.cc:993] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: : Instructing follower e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:30:08.254464 30025 raft_consensus.cc:1081] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Signalling peer e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:30:08.256127 29754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:56176
I20260709 12:30:08.256600 29754 raft_consensus.cc:493] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:08.256860 29754 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.263096 29754 raft_consensus.cc:515] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.265228 29754 leader_election.cc:290] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 3 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:08.265619 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:08.265805 29675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c814c4440a4827ae66538b739a8c86" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:08.266407 29602 raft_consensus.cc:3055] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:08.266449 29675 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.266928 29602 raft_consensus.cc:740] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:30:08.267978 30023 raft_consensus.cc:993] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b: : Instructing follower e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:30:08.267845 29602 consensus_queue.cc:260] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.268524 30025 raft_consensus.cc:1081] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Signalling peer e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:30:08.269080 29602 raft_consensus.cc:3060] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.270473 29747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:56176
I20260709 12:30:08.271142 29747 raft_consensus.cc:493] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:08.271507 29747 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.274883 29675 raft_consensus.cc:2468] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 3.
I20260709 12:30:08.275144 29602 raft_consensus.cc:2468] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 3.
I20260709 12:30:08.276372 29720 leader_election.cc:304] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:08.277257 29943 raft_consensus.cc:2804] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:08.277691 29943 raft_consensus.cc:697] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:08.278438 29943 consensus_queue.cc:237] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.279031 29747 raft_consensus.cc:515] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.280835 29747 leader_election.cc:290] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 3 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:08.282037 29675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:08.282438 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce2738d4cf04f27bb159a96551cc878" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:08.282739 29675 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.283149 29602 raft_consensus.cc:3055] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:08.283522 29602 raft_consensus.cc:740] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 14afc611141141b18ad748c422bc560b, State: Running, Role: LEADER
I20260709 12:30:08.284399 29602 consensus_queue.cc:260] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.285816 29602 raft_consensus.cc:3060] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.289592 29675 raft_consensus.cc:2468] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 3.
I20260709 12:30:08.289235 29504 catalog_manager.cc:5697] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 2 to 3, leader changed from 14afc611141141b18ad748c422bc560b (127.20.109.65) to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 3 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:08.291257 29720 leader_election.cc:304] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3f3bb47594d96b0ebe07fa8e74680, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:08.292209 29943 raft_consensus.cc:2804] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:08.292683 29943 raft_consensus.cc:697] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:08.293720 29943 consensus_queue.cc:237] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.294157 29602 raft_consensus.cc:2468] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 3.
I20260709 12:30:08.306016 29504 catalog_manager.cc:5697] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 2 to 3, leader changed from 14afc611141141b18ad748c422bc560b (127.20.109.65) to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 3 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:08.398667 30076 raft_consensus.cc:993] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680: : Instructing follower e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:30:08.399457 30074 raft_consensus.cc:1081] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Signalling peer e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:30:08.401445 29747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:56178
I20260709 12:30:08.402081 29747 raft_consensus.cc:493] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:08.402422 29747 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.412386 29747 raft_consensus.cc:515] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.413211 30074 raft_consensus.cc:993] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680: : Instructing follower e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:30:08.413921 30076 raft_consensus.cc:1081] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Signalling peer e6a9fc0aa0024566a24d4b56512c13e6 to start an election
I20260709 12:30:08.414556 29747 leader_election.cc:290] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 3 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:08.416426 29675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:08.416752 29747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac"
dest_uuid: "e6a9fc0aa0024566a24d4b56512c13e6"
 from {username='slave'} at 127.0.0.1:56178
I20260709 12:30:08.417030 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee011a1cbfd413a8dd23628d9f0a5ce" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:08.417351 29675 raft_consensus.cc:3055] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:08.417523 29747 raft_consensus.cc:493] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:08.417794 29675 raft_consensus.cc:740] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:30:08.418000 29747 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.419050 29602 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.418813 29675 consensus_queue.cc:260] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.420228 29675 raft_consensus.cc:3060] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.425618 29747 raft_consensus.cc:515] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.428227 29602 raft_consensus.cc:2468] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 3.
I20260709 12:30:08.428989 29747 leader_election.cc:290] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 3 election: Requested vote from peers 14afc611141141b18ad748c422bc560b (127.20.109.65:33193), 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829)
I20260709 12:30:08.430848 29680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34c3f3bb47594d96b0ebe07fa8e74680"
I20260709 12:30:08.431711 29680 raft_consensus.cc:3055] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:08.429191 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2778f68bdf54eec99000be57c33c4ac" candidate_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "14afc611141141b18ad748c422bc560b"
I20260709 12:30:08.431985 29675 raft_consensus.cc:2468] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 3.
I20260709 12:30:08.431994 29721 leader_election.cc:304] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:08.432849 29606 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.432090 29680 raft_consensus.cc:740] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34c3f3bb47594d96b0ebe07fa8e74680, State: Running, Role: LEADER
I20260709 12:30:08.433552 29943 raft_consensus.cc:2804] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:08.434685 29943 raft_consensus.cc:697] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:08.434486 29680 consensus_queue.cc:260] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.436009 29943 consensus_queue.cc:237] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.436753 29680 raft_consensus.cc:3060] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:08.442744 29606 raft_consensus.cc:2468] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 3.
I20260709 12:30:08.444442 29721 leader_election.cc:304] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14afc611141141b18ad748c422bc560b, e6a9fc0aa0024566a24d4b56512c13e6; no voters: 
I20260709 12:30:08.444761 29680 raft_consensus.cc:2468] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a9fc0aa0024566a24d4b56512c13e6 in term 3.
I20260709 12:30:08.444465 29504 catalog_manager.cc:5697] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 2 to 3, leader changed from 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66) to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 3 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:08.445529 29943 raft_consensus.cc:2804] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:08.446162 29943 raft_consensus.cc:697] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 LEADER]: Becoming Leader. State: Replica: e6a9fc0aa0024566a24d4b56512c13e6, State: Running, Role: LEADER
I20260709 12:30:08.447079 29943 consensus_queue.cc:237] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } }
I20260709 12:30:08.460911 29504 catalog_manager.cc:5697] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 reported cstate change: term changed from 2 to 3, leader changed from 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66) to e6a9fc0aa0024566a24d4b56512c13e6 (127.20.109.67). New cstate: current_term: 3 leader_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a9fc0aa0024566a24d4b56512c13e6" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:08.708002 29680 raft_consensus.cc:1275] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:08.709515 29943 consensus_queue.cc:1048] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:08.722406 29602 raft_consensus.cc:1275] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:08.724169 30088 consensus_queue.cc:1048] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:08.742759 29680 raft_consensus.cc:1275] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:30:08.744082 30064 consensus_queue.cc:1048] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:08.753126 29602 raft_consensus.cc:1275] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:30:08.761713 30088 consensus_queue.cc:1048] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:08.875449 29606 raft_consensus.cc:1275] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:08.877139 30088 consensus_queue.cc:1048] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:08.890403 29680 raft_consensus.cc:1275] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:08.891888 30064 consensus_queue.cc:1048] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:08.945946 29606 raft_consensus.cc:1275] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:30:08.947402 30064 consensus_queue.cc:1048] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14afc611141141b18ad748c422bc560b" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:08.955080 29680 raft_consensus.cc:1275] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Refusing update from remote peer e6a9fc0aa0024566a24d4b56512c13e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:30:08.956759 30088 consensus_queue.cc:1048] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3f3bb47594d96b0ebe07fa8e74680" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:30:09.165011 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:09.171463 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:09.172106 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:09.180255 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:09.181005 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:10.182196 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:10.189409 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:10.189965 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:10.195170 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:10.195624 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:11.196780 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:11.204165 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:11.204738 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:11.210183 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:11.210690 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:12.211882 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:12.217083 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:12.217489 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:12.222383 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:12.222765 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:13.223708 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:13.230293 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:13.230865 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:13.236006 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:13.236377 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:14.237309 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:14.243520 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:14.243986 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:14.248697 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:14.249091 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:15.250083 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:15.255585 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:15.255965 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:15.260710 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:15.261060 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:16.262075 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:16.268214 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:16.268770 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:16.274482 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:16.274845 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:17.275761 20917 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:17.280944 20917 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:17.281333 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:17.289224 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:17.289824 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:18.351225 20917 tablet_server.cc:179] TabletServer@127.20.109.65:0 shutting down...
W20260709 12:30:18.377913 29647 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:30:18.383674 29647 consensus_peers.cc:597] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 -> Peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Couldn't send request to peer 14afc611141141b18ad748c422bc560b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.392154 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:18.393101 20917 tablet_replica.cc:333] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.394184 20917 raft_consensus.cc:2243] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.395021 20917 raft_consensus.cc:2272] T cee3b43b5e9144329a42dac6c6eaebd5 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.397552 20917 tablet_replica.cc:333] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.398111 20917 raft_consensus.cc:2243] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.398778 20917 raft_consensus.cc:2272] T cbeb3de09aa04b69ad441e44b1bb3a86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.401082 20917 tablet_replica.cc:333] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.401662 20917 raft_consensus.cc:2243] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.402102 20917 raft_consensus.cc:2272] T 36c814c4440a4827ae66538b739a8c86 P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.404314 20917 tablet_replica.cc:333] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.404847 20917 raft_consensus.cc:2243] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.405376 20917 raft_consensus.cc:2272] T ac8a0c9acac341988c034fc760061cc1 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.408049 20917 tablet_replica.cc:333] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.408901 20917 raft_consensus.cc:2243] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.409534 20917 raft_consensus.cc:2272] T 1ba5d6d6dc304485a0075004f4d9d38f P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.412267 20917 tablet_replica.cc:333] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.412864 20917 raft_consensus.cc:2243] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.413419 20917 raft_consensus.cc:2272] T 5cf30fe28983463db2192c753932ec87 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.415807 20917 tablet_replica.cc:333] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.416432 20917 raft_consensus.cc:2243] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.417270 20917 raft_consensus.cc:2272] T 7ce013c7fb09402194bc9928153b7d17 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.419756 20917 tablet_replica.cc:333] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.420306 20917 raft_consensus.cc:2243] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.420784 20917 raft_consensus.cc:2272] T f16a7086995e4967b47d2db8d9727c86 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.423266 20917 tablet_replica.cc:333] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.423873 20917 raft_consensus.cc:2243] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.424826 20917 raft_consensus.cc:2272] T 0b2e91af93e84397aefbce0c8f28af36 P 14afc611141141b18ad748c422bc560b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.427397 20917 tablet_replica.cc:333] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.427989 20917 raft_consensus.cc:2243] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.428486 20917 raft_consensus.cc:2272] T 9af8893ad5ad41f99053bce068ddfccd P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.430862 20917 tablet_replica.cc:333] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.431416 20917 raft_consensus.cc:2243] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.432359 20917 raft_consensus.cc:2272] T 4f0789f1aa2e436787725effebf323d6 P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.435065 20917 tablet_replica.cc:333] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.435873 20917 raft_consensus.cc:2243] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.436951 20917 raft_consensus.cc:2272] T 226f4948c42d4c7e887e33145ac92d0d P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.439704 20917 tablet_replica.cc:333] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.440297 20917 raft_consensus.cc:2243] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.440881 20917 raft_consensus.cc:2272] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.443125 20917 tablet_replica.cc:333] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.443681 20917 raft_consensus.cc:2243] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.444597 20917 raft_consensus.cc:2272] T 31146eb1df474897a336ad843a92e04b P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.447078 20917 tablet_replica.cc:333] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.447614 20917 raft_consensus.cc:2243] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.448107 20917 raft_consensus.cc:2272] T 73db145a322c4c099fe1ab23c79649ea P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.450397 20917 tablet_replica.cc:333] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.451028 20917 raft_consensus.cc:2243] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.451550 20917 raft_consensus.cc:2272] T b2778f68bdf54eec99000be57c33c4ac P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.453866 20917 tablet_replica.cc:333] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.454346 20917 raft_consensus.cc:2243] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.454849 20917 raft_consensus.cc:2272] T 4ce2738d4cf04f27bb159a96551cc878 P 14afc611141141b18ad748c422bc560b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.457579 20917 tablet_replica.cc:333] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b: stopping tablet replica
I20260709 12:30:18.458359 20917 raft_consensus.cc:2243] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.460387 20917 raft_consensus.cc:2272] T 308e90191a5847379ea3e11972042dfb P 14afc611141141b18ad748c422bc560b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.461334 29721 consensus_peers.cc:597] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Couldn't send request to peer 14afc611141141b18ad748c422bc560b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.503149 29647 consensus_peers.cc:597] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 -> Peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Couldn't send request to peer 14afc611141141b18ad748c422bc560b. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:33193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.523697 20917 tablet_server.cc:196] TabletServer@127.20.109.65:0 shutdown complete.
I20260709 12:30:18.569553 20917 tablet_server.cc:179] TabletServer@127.20.109.66:0 shutting down...
W20260709 12:30:18.587314 29721 consensus_peers.cc:597] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Couldn't send request to peer 14afc611141141b18ad748c422bc560b. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:33193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.590075 29720 consensus_peers.cc:597] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Couldn't send request to peer 34c3f3bb47594d96b0ebe07fa8e74680. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.591674 29720 consensus_peers.cc:597] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Couldn't send request to peer 34c3f3bb47594d96b0ebe07fa8e74680. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.595896 29720 consensus_peers.cc:597] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Couldn't send request to peer 34c3f3bb47594d96b0ebe07fa8e74680. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.609478 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:18.610215 20917 tablet_replica.cc:333] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.611065 20917 raft_consensus.cc:2243] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.611986 20917 raft_consensus.cc:2272] T ac8a0c9acac341988c034fc760061cc1 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.614147 20917 tablet_replica.cc:333] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.614760 20917 raft_consensus.cc:2243] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.615624 20917 raft_consensus.cc:2272] T cee3b43b5e9144329a42dac6c6eaebd5 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.617715 20917 tablet_replica.cc:333] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.618273 20917 raft_consensus.cc:2243] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.618830 20917 raft_consensus.cc:2272] T 36c814c4440a4827ae66538b739a8c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.620944 20917 tablet_replica.cc:333] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.621508 20917 raft_consensus.cc:2243] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.621994 20917 raft_consensus.cc:2272] T 0b2e91af93e84397aefbce0c8f28af36 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.624096 20917 tablet_replica.cc:333] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.624684 20917 raft_consensus.cc:2243] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.625157 20917 raft_consensus.cc:2272] T 5cf30fe28983463db2192c753932ec87 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.627234 20917 tablet_replica.cc:333] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.627771 20917 raft_consensus.cc:2243] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.628288 20917 raft_consensus.cc:2272] T 7ce013c7fb09402194bc9928153b7d17 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.630511 20917 tablet_replica.cc:333] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.631172 20917 raft_consensus.cc:2243] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.632083 20917 raft_consensus.cc:2272] T f16a7086995e4967b47d2db8d9727c86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.634397 20917 tablet_replica.cc:333] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.635075 20917 raft_consensus.cc:2243] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.635954 20917 raft_consensus.cc:2272] T 9af8893ad5ad41f99053bce068ddfccd P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.638547 20917 tablet_replica.cc:333] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.639171 20917 raft_consensus.cc:2243] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.639824 20917 raft_consensus.cc:2272] T 1ba5d6d6dc304485a0075004f4d9d38f P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.642987 20917 tablet_replica.cc:333] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.643719 20917 raft_consensus.cc:2243] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.644646 20917 raft_consensus.cc:2272] T cbeb3de09aa04b69ad441e44b1bb3a86 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.644985 29721 consensus_peers.cc:597] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Couldn't send request to peer 14afc611141141b18ad748c422bc560b. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:33193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.647017 20917 tablet_replica.cc:333] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.647706 20917 raft_consensus.cc:2243] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.648226 20917 raft_consensus.cc:2272] T 308e90191a5847379ea3e11972042dfb P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.650488 20917 tablet_replica.cc:333] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.651083 20917 raft_consensus.cc:2243] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.651566 20917 raft_consensus.cc:2272] T 9ee011a1cbfd413a8dd23628d9f0a5ce P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.653789 20917 tablet_replica.cc:333] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.654322 20917 raft_consensus.cc:2243] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.654826 20917 raft_consensus.cc:2272] T 31146eb1df474897a336ad843a92e04b P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.657083 20917 tablet_replica.cc:333] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.657655 20917 raft_consensus.cc:2243] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.658149 20917 raft_consensus.cc:2272] T 226f4948c42d4c7e887e33145ac92d0d P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.660248 20917 tablet_replica.cc:333] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.660830 20917 raft_consensus.cc:2243] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.661257 20917 raft_consensus.cc:2272] T b2778f68bdf54eec99000be57c33c4ac P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.663590 20917 tablet_replica.cc:333] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.664116 20917 raft_consensus.cc:2243] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.665046 20917 raft_consensus.cc:2272] T 73db145a322c4c099fe1ab23c79649ea P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.667246 20917 tablet_replica.cc:333] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.667714 20917 raft_consensus.cc:2243] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.668177 20917 raft_consensus.cc:2272] T 4ce2738d4cf04f27bb159a96551cc878 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.670312 20917 tablet_replica.cc:333] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680: stopping tablet replica
I20260709 12:30:18.670872 20917 raft_consensus.cc:2243] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.671344 20917 raft_consensus.cc:2272] T 4f0789f1aa2e436787725effebf323d6 P 34c3f3bb47594d96b0ebe07fa8e74680 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.680902 29721 consensus_peers.cc:597] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Couldn't send request to peer 14afc611141141b18ad748c422bc560b. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:33193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.713299 20917 tablet_server.cc:196] TabletServer@127.20.109.66:0 shutdown complete.
W20260709 12:30:18.714833 29720 consensus_peers.cc:597] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 34c3f3bb47594d96b0ebe07fa8e74680 (127.20.109.66:45829): Couldn't send request to peer 34c3f3bb47594d96b0ebe07fa8e74680. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:45829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.747083 29721 consensus_peers.cc:597] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 -> Peer 14afc611141141b18ad748c422bc560b (127.20.109.65:33193): Couldn't send request to peer 14afc611141141b18ad748c422bc560b. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:33193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.754019 20917 tablet_server.cc:179] TabletServer@127.20.109.67:0 shutting down...
I20260709 12:30:18.783275 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:18.784180 20917 tablet_replica.cc:333] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.785094 20917 raft_consensus.cc:2243] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.785760 20917 raft_consensus.cc:2272] T cee3b43b5e9144329a42dac6c6eaebd5 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.788040 20917 tablet_replica.cc:333] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.788635 20917 raft_consensus.cc:2243] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.789078 20917 raft_consensus.cc:2272] T cbeb3de09aa04b69ad441e44b1bb3a86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.791289 20917 tablet_replica.cc:333] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.791862 20917 raft_consensus.cc:2243] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.792663 20917 raft_consensus.cc:2272] T 36c814c4440a4827ae66538b739a8c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.794807 20917 tablet_replica.cc:333] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.795331 20917 raft_consensus.cc:2243] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.795796 20917 raft_consensus.cc:2272] T ac8a0c9acac341988c034fc760061cc1 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.797843 20917 tablet_replica.cc:333] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.798381 20917 raft_consensus.cc:2243] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.798877 20917 raft_consensus.cc:2272] T 0b2e91af93e84397aefbce0c8f28af36 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.801584 20917 tablet_replica.cc:333] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.802078 20917 raft_consensus.cc:2243] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.802507 20917 raft_consensus.cc:2272] T 226f4948c42d4c7e887e33145ac92d0d P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.804639 20917 tablet_replica.cc:333] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.805167 20917 raft_consensus.cc:2243] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.805578 20917 raft_consensus.cc:2272] T 31146eb1df474897a336ad843a92e04b P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.807497 20917 tablet_replica.cc:333] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.807982 20917 raft_consensus.cc:2243] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.808714 20917 raft_consensus.cc:2272] T 9ee011a1cbfd413a8dd23628d9f0a5ce P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.810549 20917 tablet_replica.cc:333] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.811064 20917 raft_consensus.cc:2243] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.811859 20917 raft_consensus.cc:2272] T 5cf30fe28983463db2192c753932ec87 P e6a9fc0aa0024566a24d4b56512c13e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.813872 20917 tablet_replica.cc:333] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.814390 20917 raft_consensus.cc:2243] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.814810 20917 raft_consensus.cc:2272] T f16a7086995e4967b47d2db8d9727c86 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.816763 20917 tablet_replica.cc:333] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.817485 20917 raft_consensus.cc:2243] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.817936 20917 raft_consensus.cc:2272] T 7ce013c7fb09402194bc9928153b7d17 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.820451 20917 tablet_replica.cc:333] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.820950 20917 raft_consensus.cc:2243] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.821794 20917 raft_consensus.cc:2272] T 1ba5d6d6dc304485a0075004f4d9d38f P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.824000 20917 tablet_replica.cc:333] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.824507 20917 raft_consensus.cc:2243] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.824954 20917 raft_consensus.cc:2272] T 9af8893ad5ad41f99053bce068ddfccd P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.827121 20917 tablet_replica.cc:333] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.827596 20917 raft_consensus.cc:2243] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.828394 20917 raft_consensus.cc:2272] T b2778f68bdf54eec99000be57c33c4ac P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.830406 20917 tablet_replica.cc:333] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.830919 20917 raft_consensus.cc:2243] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.831331 20917 raft_consensus.cc:2272] T 73db145a322c4c099fe1ab23c79649ea P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.833258 20917 tablet_replica.cc:333] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.833700 20917 raft_consensus.cc:2243] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.834453 20917 raft_consensus.cc:2272] T 4ce2738d4cf04f27bb159a96551cc878 P e6a9fc0aa0024566a24d4b56512c13e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.836455 20917 tablet_replica.cc:333] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.836889 20917 raft_consensus.cc:2243] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.837294 20917 raft_consensus.cc:2272] T 308e90191a5847379ea3e11972042dfb P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.839223 20917 tablet_replica.cc:333] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6: stopping tablet replica
I20260709 12:30:18.839607 20917 raft_consensus.cc:2243] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.839988 20917 raft_consensus.cc:2272] T 4f0789f1aa2e436787725effebf323d6 P e6a9fc0aa0024566a24d4b56512c13e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.879987 20917 tablet_server.cc:196] TabletServer@127.20.109.67:0 shutdown complete.
I20260709 12:30:18.914548 20917 master.cc:562] Master@127.20.109.126:42297 shutting down...
I20260709 12:30:18.935101 20917 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.935685 20917 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.936023 20917 tablet_replica.cc:333] T 00000000000000000000000000000000 P a84e745667094aa484805ca812a8fc96: stopping tablet replica
I20260709 12:30:18.956988 20917 master.cc:584] Master@127.20.109.126:42297 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21655 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:30:19.008330 20917 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.109.126:35217
I20260709 12:30:19.009508 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:19.014663 30117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:19.014689 30118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:19.017287 30120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:19.017464 20917 server_base.cc:1061] running on GCE node
I20260709 12:30:19.018462 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:19.018687 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:19.018851 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600219018831 us; error 0 us; skew 500 ppm
I20260709 12:30:19.019371 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:19.021773 20917 webserver.cc:533] Webserver started at http://127.20.109.126:42853/ using document root <none> and password file <none>
I20260709 12:30:19.022250 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:19.022418 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:19.022694 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:19.023794 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/master-0-root/instance:
uuid: "cf2eeaef052c4704ba4d564aebe9651f"
format_stamp: "Formatted at 2026-07-09 12:30:19 on dist-test-slave-sc4p"
I20260709 12:30:19.028048 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:30:19.031456 30125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.032130 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:19.032393 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/master-0-root
uuid: "cf2eeaef052c4704ba4d564aebe9651f"
format_stamp: "Formatted at 2026-07-09 12:30:19 on dist-test-slave-sc4p"
I20260709 12:30:19.032657 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:19.043677 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:19.044920 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:19.082003 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.126:35217
I20260709 12:30:19.082105 30176 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.126:35217 every 8 connection(s)
I20260709 12:30:19.086117 30177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.098234 30177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f: Bootstrap starting.
I20260709 12:30:19.103443 30177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:19.107968 30177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f: No bootstrap required, opened a new log
I20260709 12:30:19.110376 30177 raft_consensus.cc:359] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf2eeaef052c4704ba4d564aebe9651f" member_type: VOTER }
I20260709 12:30:19.110888 30177 raft_consensus.cc:385] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:19.111124 30177 raft_consensus.cc:740] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2eeaef052c4704ba4d564aebe9651f, State: Initialized, Role: FOLLOWER
I20260709 12:30:19.111702 30177 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf2eeaef052c4704ba4d564aebe9651f" member_type: VOTER }
I20260709 12:30:19.112171 30177 raft_consensus.cc:399] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:30:19.112377 30177 raft_consensus.cc:493] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:30:19.112654 30177 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:19.117650 30177 raft_consensus.cc:515] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf2eeaef052c4704ba4d564aebe9651f" member_type: VOTER }
I20260709 12:30:19.118202 30177 leader_election.cc:304] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf2eeaef052c4704ba4d564aebe9651f; no voters: 
I20260709 12:30:19.119427 30177 leader_election.cc:290] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:30:19.119841 30180 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:19.121467 30180 raft_consensus.cc:697] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 1 LEADER]: Becoming Leader. State: Replica: cf2eeaef052c4704ba4d564aebe9651f, State: Running, Role: LEADER
I20260709 12:30:19.122185 30180 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf2eeaef052c4704ba4d564aebe9651f" member_type: VOTER }
I20260709 12:30:19.122970 30177 sys_catalog.cc:565] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:30:19.126322 30181 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf2eeaef052c4704ba4d564aebe9651f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf2eeaef052c4704ba4d564aebe9651f" member_type: VOTER } }
I20260709 12:30:19.126422 30182 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf2eeaef052c4704ba4d564aebe9651f. Latest consensus state: current_term: 1 leader_uuid: "cf2eeaef052c4704ba4d564aebe9651f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf2eeaef052c4704ba4d564aebe9651f" member_type: VOTER } }
I20260709 12:30:19.127126 30181 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:19.127349 30182 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:19.136173 30186 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:30:19.141026 30186 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:30:19.142019 20917 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:30:19.150031 30186 catalog_manager.cc:1383] Generated new cluster ID: f762e2d2b0054e2e9af200c91c29756c
I20260709 12:30:19.150302 30186 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:30:19.188890 30186 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:30:19.190131 30186 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:30:19.206332 30186 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f: Generated new TSK 0
I20260709 12:30:19.206982 30186 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:30:19.273453 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:19.279173 30198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:19.280342 30199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:19.281822 20917 server_base.cc:1061] running on GCE node
W20260709 12:30:19.281725 30201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:19.283193 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:19.283396 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:19.283521 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600219283509 us; error 0 us; skew 500 ppm
I20260709 12:30:19.283993 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:19.286495 20917 webserver.cc:533] Webserver started at http://127.20.109.65:44581/ using document root <none> and password file <none>
I20260709 12:30:19.287039 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:19.287230 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:19.287482 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:19.288709 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-0-root/instance:
uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
format_stamp: "Formatted at 2026-07-09 12:30:19 on dist-test-slave-sc4p"
I20260709 12:30:19.293579 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:30:19.296911 30206 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.297632 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:30:19.297916 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-0-root
uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
format_stamp: "Formatted at 2026-07-09 12:30:19 on dist-test-slave-sc4p"
I20260709 12:30:19.298187 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:19.319993 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:19.321311 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:19.322793 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:19.325052 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:19.325240 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.325455 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:19.325625 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.364990 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.65:45627
I20260709 12:30:19.365092 30268 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.65:45627 every 8 connection(s)
I20260709 12:30:19.369747 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:19.376969 30273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:19.377550 30274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:19.381199 20917 server_base.cc:1061] running on GCE node
I20260709 12:30:19.382452 30269 heartbeater.cc:344] Connected to a master server at 127.20.109.126:35217
W20260709 12:30:19.382513 30277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:19.382920 30269 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:19.383672 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:30:19.383859 30269 heartbeater.cc:507] Master 127.20.109.126:35217 requested a full tablet report, sending...
W20260709 12:30:19.384023 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:19.384341 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600219384268 us; error 0 us; skew 500 ppm
I20260709 12:30:19.385142 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:19.386406 30142 ts_manager.cc:194] Registered new tserver with Master: d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627)
I20260709 12:30:19.388088 20917 webserver.cc:533] Webserver started at http://127.20.109.66:45033/ using document root <none> and password file <none>
I20260709 12:30:19.388353 30142 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49706
I20260709 12:30:19.388756 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:19.389051 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:19.389317 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:19.390985 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-1-root/instance:
uuid: "502bbfe1b6b44eda9b4569507a55d46a"
format_stamp: "Formatted at 2026-07-09 12:30:19 on dist-test-slave-sc4p"
I20260709 12:30:19.395700 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:30:19.399693 30281 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.400544 20917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:30:19.400863 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-1-root
uuid: "502bbfe1b6b44eda9b4569507a55d46a"
format_stamp: "Formatted at 2026-07-09 12:30:19 on dist-test-slave-sc4p"
I20260709 12:30:19.401203 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:19.420657 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:19.421846 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:19.423307 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:19.425539 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:19.425736 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.425953 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:19.426097 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.463189 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.66:33059
I20260709 12:30:19.463300 30343 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.66:33059 every 8 connection(s)
I20260709 12:30:19.467757 20917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:19.474758 30347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:19.476357 30348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:19.479530 20917 server_base.cc:1061] running on GCE node
W20260709 12:30:19.479596 30350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:19.480047 30344 heartbeater.cc:344] Connected to a master server at 127.20.109.126:35217
I20260709 12:30:19.480500 30344 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:19.480870 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:19.481146 20917 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:19.481241 30344 heartbeater.cc:507] Master 127.20.109.126:35217 requested a full tablet report, sending...
I20260709 12:30:19.481308 20917 hybrid_clock.cc:648] HybridClock initialized: now 1783600219481292 us; error 0 us; skew 500 ppm
I20260709 12:30:19.482105 20917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:19.483529 30142 ts_manager.cc:194] Registered new tserver with Master: 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:19.484614 20917 webserver.cc:533] Webserver started at http://127.20.109.67:45609/ using document root <none> and password file <none>
I20260709 12:30:19.485028 30142 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49718
I20260709 12:30:19.485188 20917 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:19.485478 20917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:19.485724 20917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:19.486909 20917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-2-root/instance:
uuid: "811ff3960ee34275a8343e9a0ed11ae5"
format_stamp: "Formatted at 2026-07-09 12:30:19 on dist-test-slave-sc4p"
I20260709 12:30:19.491266 20917 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:30:19.494549 30355 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.495360 20917 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:30:19.495678 20917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-2-root
uuid: "811ff3960ee34275a8343e9a0ed11ae5"
format_stamp: "Formatted at 2026-07-09 12:30:19 on dist-test-slave-sc4p"
I20260709 12:30:19.495954 20917 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9hWWWb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893634731-20917-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:19.511193 20917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:19.512362 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:19.513773 20917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:19.515955 20917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:19.516149 20917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.516368 20917 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:19.516517 20917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:19.556876 20917 rpc_server.cc:307] RPC server started. Bound to: 127.20.109.67:38687
I20260709 12:30:19.557039 30417 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.109.67:38687 every 8 connection(s)
I20260709 12:30:19.570495 30418 heartbeater.cc:344] Connected to a master server at 127.20.109.126:35217
I20260709 12:30:19.570953 30418 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:19.571656 30418 heartbeater.cc:507] Master 127.20.109.126:35217 requested a full tablet report, sending...
I20260709 12:30:19.573493 30142 ts_manager.cc:194] Registered new tserver with Master: 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:19.574653 20917 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014738251s
I20260709 12:30:19.574841 30142 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49722
I20260709 12:30:19.602111 30142 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49736:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:19.604926 30142 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:19.673327 30308 tablet_service.cc:1511] Processing CreateTablet for tablet ef3aaadaad0b4777ad44e4fe3399cebd (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:19.674995 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3aaadaad0b4777ad44e4fe3399cebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.675659 30309 tablet_service.cc:1511] Processing CreateTablet for tablet 200d711c63b54d5ba14bcd5d09642d60 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:19.677091 30309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200d711c63b54d5ba14bcd5d09642d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.680647 30307 tablet_service.cc:1511] Processing CreateTablet for tablet bd04beb8b3814ca0bac81760e3fabcc0 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:19.682112 30307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd04beb8b3814ca0bac81760e3fabcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.688210 30306 tablet_service.cc:1511] Processing CreateTablet for tablet 21363ae62c4c48b299c33fc5b2b9c810 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:19.689721 30306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21363ae62c4c48b299c33fc5b2b9c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.692409 30305 tablet_service.cc:1511] Processing CreateTablet for tablet ae79d8ed87d640aa846b221492024674 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:19.695322 30304 tablet_service.cc:1511] Processing CreateTablet for tablet d87548997099485f80226ece2937951f (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:19.699007 30304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87548997099485f80226ece2937951f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.700321 30305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae79d8ed87d640aa846b221492024674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.704536 30303 tablet_service.cc:1511] Processing CreateTablet for tablet 2462c1993c4249b5aa38ccf9d9c247fc (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:19.706210 30303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2462c1993c4249b5aa38ccf9d9c247fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.708608 30302 tablet_service.cc:1511] Processing CreateTablet for tablet a6df216c755843fbb47dd91756df4ae5 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:19.710348 30302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6df216c755843fbb47dd91756df4ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.715045 30382 tablet_service.cc:1511] Processing CreateTablet for tablet ef3aaadaad0b4777ad44e4fe3399cebd (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:19.715770 30380 tablet_service.cc:1511] Processing CreateTablet for tablet 21363ae62c4c48b299c33fc5b2b9c810 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:19.716534 30382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3aaadaad0b4777ad44e4fe3399cebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.717979 30381 tablet_service.cc:1511] Processing CreateTablet for tablet bd04beb8b3814ca0bac81760e3fabcc0 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:19.718436 30378 tablet_service.cc:1511] Processing CreateTablet for tablet d87548997099485f80226ece2937951f (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:19.719551 30383 tablet_service.cc:1511] Processing CreateTablet for tablet 200d711c63b54d5ba14bcd5d09642d60 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:19.721014 30381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd04beb8b3814ca0bac81760e3fabcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.721590 30378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87548997099485f80226ece2937951f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.722287 30380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21363ae62c4c48b299c33fc5b2b9c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.723199 30383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200d711c63b54d5ba14bcd5d09642d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.719954 30379 tablet_service.cc:1511] Processing CreateTablet for tablet ae79d8ed87d640aa846b221492024674 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:19.732751 30301 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb4db1d0c394e57bb66954b2104e730 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:19.733980 30379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae79d8ed87d640aa846b221492024674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.734124 30301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb4db1d0c394e57bb66954b2104e730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.752580 30377 tablet_service.cc:1511] Processing CreateTablet for tablet 2462c1993c4249b5aa38ccf9d9c247fc (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:19.754443 30377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2462c1993c4249b5aa38ccf9d9c247fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.760883 30376 tablet_service.cc:1511] Processing CreateTablet for tablet a6df216c755843fbb47dd91756df4ae5 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:19.762332 30376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6df216c755843fbb47dd91756df4ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.772164 30375 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb4db1d0c394e57bb66954b2104e730 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:19.773496 30375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb4db1d0c394e57bb66954b2104e730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.773830 30230 tablet_service.cc:1511] Processing CreateTablet for tablet ae79d8ed87d640aa846b221492024674 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:19.775113 30230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae79d8ed87d640aa846b221492024674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.775703 30234 tablet_service.cc:1511] Processing CreateTablet for tablet 200d711c63b54d5ba14bcd5d09642d60 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:19.776896 30234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200d711c63b54d5ba14bcd5d09642d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.777222 30229 tablet_service.cc:1511] Processing CreateTablet for tablet d87548997099485f80226ece2937951f (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:19.778425 30229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87548997099485f80226ece2937951f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.779374 30233 tablet_service.cc:1511] Processing CreateTablet for tablet ef3aaadaad0b4777ad44e4fe3399cebd (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:19.780014 30232 tablet_service.cc:1511] Processing CreateTablet for tablet bd04beb8b3814ca0bac81760e3fabcc0 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:19.780623 30233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3aaadaad0b4777ad44e4fe3399cebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.781239 30232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd04beb8b3814ca0bac81760e3fabcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.781324 30228 tablet_service.cc:1511] Processing CreateTablet for tablet 2462c1993c4249b5aa38ccf9d9c247fc (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:19.782528 30231 tablet_service.cc:1511] Processing CreateTablet for tablet 21363ae62c4c48b299c33fc5b2b9c810 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:19.783082 30227 tablet_service.cc:1511] Processing CreateTablet for tablet a6df216c755843fbb47dd91756df4ae5 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:19.787034 30227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6df216c755843fbb47dd91756df4ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.787740 30231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21363ae62c4c48b299c33fc5b2b9c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.789716 30228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2462c1993c4249b5aa38ccf9d9c247fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.804414 30226 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb4db1d0c394e57bb66954b2104e730 (DEFAULT_TABLE table=test-workload [id=38f53bb0fb5a4670ba6524c9c45f1823]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:19.805812 30226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb4db1d0c394e57bb66954b2104e730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:19.822762 30433 tablet_bootstrap.cc:492] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:19.836601 30434 tablet_bootstrap.cc:492] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:19.865778 30434 tablet_bootstrap.cc:654] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:19.870280 30434 tablet_bootstrap.cc:492] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:19.870731 30434 ts_tablet_manager.cc:1403] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:30:19.872845 30434 raft_consensus.cc:359] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:19.873364 30434 raft_consensus.cc:385] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:19.873687 30434 raft_consensus.cc:740] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:19.874055 30433 tablet_bootstrap.cc:654] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:19.874720 30434 consensus_queue.cc:260] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:19.880329 30435 tablet_bootstrap.cc:492] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:19.892735 30435 tablet_bootstrap.cc:654] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:19.896023 30433 tablet_bootstrap.cc:492] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:19.897730 30433 ts_tablet_manager.cc:1403] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.012s
I20260709 12:30:19.897795 30418 heartbeater.cc:499] Master 127.20.109.126:35217 was elected leader, sending a full tablet report...
I20260709 12:30:19.898227 30434 ts_tablet_manager.cc:1434] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.008s
I20260709 12:30:19.899639 30434 tablet_bootstrap.cc:492] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:19.901131 30433 raft_consensus.cc:359] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:19.902169 30433 raft_consensus.cc:385] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:19.902410 30433 raft_consensus.cc:740] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:19.903456 30433 consensus_queue.cc:260] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:19.901162 30435 tablet_bootstrap.cc:492] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:19.905133 30435 ts_tablet_manager.cc:1403] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.009s
I20260709 12:30:19.905783 30344 heartbeater.cc:499] Master 127.20.109.126:35217 was elected leader, sending a full tablet report...
I20260709 12:30:19.906927 30434 tablet_bootstrap.cc:654] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:19.908175 30435 raft_consensus.cc:359] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:19.908969 30435 raft_consensus.cc:385] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:19.909237 30435 raft_consensus.cc:740] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:19.909998 30435 consensus_queue.cc:260] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:19.912612 30433 ts_tablet_manager.cc:1434] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:30:19.913666 30433 tablet_bootstrap.cc:492] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:19.913777 30269 heartbeater.cc:499] Master 127.20.109.126:35217 was elected leader, sending a full tablet report...
I20260709 12:30:19.916019 30435 ts_tablet_manager.cc:1434] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:30:19.917294 30435 tablet_bootstrap.cc:492] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:19.920429 30433 tablet_bootstrap.cc:654] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:19.924021 30435 tablet_bootstrap.cc:654] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:19.932258 30433 tablet_bootstrap.cc:492] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:19.932857 30433 ts_tablet_manager.cc:1403] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:30:19.936003 30433 raft_consensus.cc:359] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:19.936895 30433 raft_consensus.cc:385] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:19.937240 30433 raft_consensus.cc:740] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:19.938169 30433 consensus_queue.cc:260] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:19.940544 30433 ts_tablet_manager.cc:1434] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:19.941569 30433 tablet_bootstrap.cc:492] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:19.947772 30433 tablet_bootstrap.cc:654] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:19.959571 30433 tablet_bootstrap.cc:492] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:19.960214 30433 ts_tablet_manager.cc:1403] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:30:19.963195 30433 raft_consensus.cc:359] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:19.963972 30433 raft_consensus.cc:385] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:19.964327 30433 raft_consensus.cc:740] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:19.965205 30433 consensus_queue.cc:260] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:19.969355 30433 ts_tablet_manager.cc:1434] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 12:30:19.970687 30345 tablet.cc:2406] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:30:19.972584 30433 tablet_bootstrap.cc:492] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:19.979630 30433 tablet_bootstrap.cc:654] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.001663 30434 tablet_bootstrap.cc:492] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:20.002259 30434 ts_tablet_manager.cc:1403] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.103s	user 0.041s	sys 0.059s
I20260709 12:30:20.003077 30435 tablet_bootstrap.cc:492] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:20.003708 30433 tablet_bootstrap.cc:492] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:20.003721 30435 ts_tablet_manager.cc:1403] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.087s	user 0.041s	sys 0.043s
I20260709 12:30:20.004251 30433 ts_tablet_manager.cc:1403] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.014s
I20260709 12:30:20.005255 30434 raft_consensus.cc:359] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:20.006009 30434 raft_consensus.cc:385] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.006289 30434 raft_consensus.cc:740] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.006474 30433 raft_consensus.cc:359] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.006896 30435 raft_consensus.cc:359] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.007639 30435 raft_consensus.cc:385] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.007076 30434 consensus_queue.cc:260] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:20.007948 30435 raft_consensus.cc:740] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.007170 30433 raft_consensus.cc:385] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.008548 30433 raft_consensus.cc:740] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.008777 30435 consensus_queue.cc:260] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.009480 30434 ts_tablet_manager.cc:1434] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:20.009470 30433 consensus_queue.cc:260] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.010685 30434 tablet_bootstrap.cc:492] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:20.011270 30435 ts_tablet_manager.cc:1434] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:30:20.012283 30435 tablet_bootstrap.cc:492] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:20.013684 30433 ts_tablet_manager.cc:1434] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:30:20.014789 30433 tablet_bootstrap.cc:492] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:20.017789 30434 tablet_bootstrap.cc:654] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.018522 30435 tablet_bootstrap.cc:654] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.021025 30433 tablet_bootstrap.cc:654] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.029652 30434 tablet_bootstrap.cc:492] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:20.029973 30435 tablet_bootstrap.cc:492] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:20.030304 30434 ts_tablet_manager.cc:1403] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:30:20.030577 30435 ts_tablet_manager.cc:1403] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:30:20.033788 30434 raft_consensus.cc:359] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.034580 30434 raft_consensus.cc:385] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.034235 30435 raft_consensus.cc:359] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.035079 30434 raft_consensus.cc:740] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.035241 30435 raft_consensus.cc:385] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.035646 30435 raft_consensus.cc:740] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.036110 30434 consensus_queue.cc:260] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.036540 30435 consensus_queue.cc:260] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.038710 30434 ts_tablet_manager.cc:1434] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:30:20.038949 30435 ts_tablet_manager.cc:1434] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:30:20.039798 30434 tablet_bootstrap.cc:492] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:20.039950 30435 tablet_bootstrap.cc:492] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:20.046891 30434 tablet_bootstrap.cc:654] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.046891 30435 tablet_bootstrap.cc:654] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.048144 30437 raft_consensus.cc:493] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.048745 30437 raft_consensus.cc:515] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.051842 30437 leader_election.cc:290] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:20.066847 30433 tablet_bootstrap.cc:492] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:20.067379 30433 ts_tablet_manager.cc:1403] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.023s
I20260709 12:30:20.069628 30433 raft_consensus.cc:359] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.070087 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.070406 30433 raft_consensus.cc:385] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.070770 30433 raft_consensus.cc:740] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.071677 30433 consensus_queue.cc:260] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
W20260709 12:30:20.072062 30359 leader_election.cc:343] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.074271 30442 raft_consensus.cc:493] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.074836 30442 raft_consensus.cc:515] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.075970 30440 raft_consensus.cc:493] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.076452 30440 raft_consensus.cc:515] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.077500 30442 leader_election.cc:290] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.078909 30440 leader_election.cc:290] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.085321 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.074251 30433 ts_tablet_manager.cc:1434] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:30:20.088666 30433 tablet_bootstrap.cc:492] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
W20260709 12:30:20.091137 30358 leader_election.cc:343] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.091769 30358 leader_election.cc:304] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5; no voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.092635 30437 raft_consensus.cc:2749] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:20.096128 30434 tablet_bootstrap.cc:492] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:20.096531 30433 tablet_bootstrap.cc:654] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.096767 30434 ts_tablet_manager.cc:1403] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.021s
I20260709 12:30:20.100046 30434 raft_consensus.cc:359] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.100889 30434 raft_consensus.cc:385] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.101109 30435 tablet_bootstrap.cc:492] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:20.101269 30434 raft_consensus.cc:740] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.101688 30435 ts_tablet_manager.cc:1403] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.006s
I20260709 12:30:20.102401 30434 consensus_queue.cc:260] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.104707 30435 raft_consensus.cc:359] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.105407 30435 raft_consensus.cc:385] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.109440 30435 raft_consensus.cc:740] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.110422 30435 consensus_queue.cc:260] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.110486 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
W20260709 12:30:20.113207 30209 leader_election.cc:343] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.107623 30434 ts_tablet_manager.cc:1434] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:30:20.113289 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.114108 30319 raft_consensus.cc:2468] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:20.115504 30210 leader_election.cc:304] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:20.116884 30442 raft_consensus.cc:2804] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.117238 30442 raft_consensus.cc:493] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.117561 30442 raft_consensus.cc:3060] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.118180 30434 tablet_bootstrap.cc:492] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:20.119938 30435 ts_tablet_manager.cc:1434] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:30:20.121016 30435 tablet_bootstrap.cc:492] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:20.125352 30434 tablet_bootstrap.cc:654] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.125355 30442 raft_consensus.cc:515] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.126964 30435 tablet_bootstrap.cc:654] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.129073 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:20.129693 30319 raft_consensus.cc:3060] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:20.134483 30190 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:20.137140 30319 raft_consensus.cc:2468] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:20.139844 30210 leader_election.cc:304] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:20.140990 30435 tablet_bootstrap.cc:492] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:20.141717 30435 ts_tablet_manager.cc:1403] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:30:20.145033 30435 raft_consensus.cc:359] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.146001 30435 raft_consensus.cc:385] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.146368 30435 raft_consensus.cc:740] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.147382 30435 consensus_queue.cc:260] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.151461 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:20.151489 30442 leader_election.cc:290] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
W20260709 12:30:20.153033 30209 leader_election.cc:343] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.153764 30442 raft_consensus.cc:2804] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:20.154281 30442 raft_consensus.cc:697] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:20.155421 30461 raft_consensus.cc:493] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.156569 30461 raft_consensus.cc:515] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.157846 30435 ts_tablet_manager.cc:1434] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:30:20.159519 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.160243 30440 raft_consensus.cc:493] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.160737 30440 raft_consensus.cc:515] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
W20260709 12:30:20.160983 30210 leader_election.cc:343] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.161351 30435 tablet_bootstrap.cc:492] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:20.166568 30433 tablet_bootstrap.cc:492] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:20.167162 30433 ts_tablet_manager.cc:1403] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.009s
I20260709 12:30:20.167675 30440 leader_election.cc:290] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.169030 30435 tablet_bootstrap.cc:654] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.168949 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.172269 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd04beb8b3814ca0bac81760e3fabcc0" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
W20260709 12:30:20.172821 30209 leader_election.cc:343] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.173352 30209 leader_election.cc:304] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:20.173487 30437 raft_consensus.cc:493] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.174042 30437 raft_consensus.cc:515] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.174921 30461 leader_election.cc:290] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.155210 30442 consensus_queue.cc:237] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.175279 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.171676 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.176972 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd04beb8b3814ca0bac81760e3fabcc0" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.177911 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.177153 30392 raft_consensus.cc:2468] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 0.
W20260709 12:30:20.178303 30284 leader_election.cc:343] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.179587 30461 raft_consensus.cc:2749] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:30:20.179731 30284 leader_election.cc:343] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.172783 30433 raft_consensus.cc:359] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.179849 30437 leader_election.cc:290] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:20.181331 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
W20260709 12:30:20.182678 30358 leader_election.cc:343] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.183053 30319 raft_consensus.cc:2468] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
W20260709 12:30:20.183840 30284 leader_election.cc:343] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.184402 30284 leader_election.cc:304] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a; no voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.184440 30359 leader_election.cc:304] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.185828 30433 raft_consensus.cc:385] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.185881 30440 raft_consensus.cc:2749] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:20.185956 30437 raft_consensus.cc:2804] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.186780 30437 raft_consensus.cc:493] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.187351 30437 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.186173 30433 raft_consensus.cc:740] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.187613 30284 leader_election.cc:304] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.188334 30433 consensus_queue.cc:260] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.188887 30440 raft_consensus.cc:2804] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.189347 30140 catalog_manager.cc:5697] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 0 to 1, leader changed from <none> to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:20.189347 30440 raft_consensus.cc:493] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.192410 30440 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.200380 30437 raft_consensus.cc:515] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.201500 30434 tablet_bootstrap.cc:492] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:20.202140 30434 ts_tablet_manager.cc:1403] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.084s	user 0.025s	sys 0.021s
I20260709 12:30:20.204293 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
W20260709 12:30:20.206035 30358 leader_election.cc:343] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.212637 30437 leader_election.cc:290] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:20.213640 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:20.205896 30434 raft_consensus.cc:359] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.214776 30434 raft_consensus.cc:385] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.215090 30434 raft_consensus.cc:740] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.216522 30433 ts_tablet_manager.cc:1434] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.047s	user 0.014s	sys 0.012s
I20260709 12:30:20.216373 30434 consensus_queue.cc:260] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.217739 30433 tablet_bootstrap.cc:492] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:20.218712 30434 ts_tablet_manager.cc:1434] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:30:20.219712 30434 tablet_bootstrap.cc:492] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:20.222026 30466 raft_consensus.cc:493] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.222607 30466 raft_consensus.cc:515] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:20.225291 30433 tablet_bootstrap.cc:654] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.226699 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200d711c63b54d5ba14bcd5d09642d60" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.227365 30392 raft_consensus.cc:2468] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 0.
I20260709 12:30:20.226372 30437 raft_consensus.cc:493] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.228826 30437 raft_consensus.cc:515] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.229189 30284 leader_election.cc:304] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:20.230849 30468 raft_consensus.cc:2804] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.231256 30468 raft_consensus.cc:493] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.231585 30468 raft_consensus.cc:3060] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.232744 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79d8ed87d640aa846b221492024674" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.237042 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200d711c63b54d5ba14bcd5d09642d60" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.237691 30466 leader_election.cc:290] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687), d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627)
I20260709 12:30:20.237385 30435 tablet_bootstrap.cc:492] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:20.231015 30437 leader_election.cc:290] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:20.239135 30435 ts_tablet_manager.cc:1403] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.012s
W20260709 12:30:20.239392 30284 leader_election.cc:343] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:20.239689 30359 leader_election.cc:343] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.242760 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79d8ed87d640aa846b221492024674" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.243479 30243 raft_consensus.cc:2468] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
I20260709 12:30:20.244750 30358 leader_election.cc:304] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:20.246021 30468 raft_consensus.cc:515] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:20.245911 30435 raft_consensus.cc:359] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:20.246919 30440 raft_consensus.cc:515] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.245904 30437 raft_consensus.cc:2804] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.247773 30437 raft_consensus.cc:493] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.248124 30437 raft_consensus.cc:3060] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.249010 30434 tablet_bootstrap.cc:654] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.250241 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200d711c63b54d5ba14bcd5d09642d60" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:20.247462 30435 raft_consensus.cc:385] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.250859 30392 raft_consensus.cc:3060] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.250876 30435 raft_consensus.cc:740] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.253872 30435 consensus_queue.cc:260] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:20.255810 30319 raft_consensus.cc:2393] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 811ff3960ee34275a8343e9a0ed11ae5 in current term 1: Already voted for candidate 502bbfe1b6b44eda9b4569507a55d46a in this term.
I20260709 12:30:20.256919 30435 ts_tablet_manager.cc:1434] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:30:20.258548 30435 tablet_bootstrap.cc:492] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:20.259251 30392 raft_consensus.cc:2468] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:20.259548 30359 leader_election.cc:304] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5; no voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.260602 30284 leader_election.cc:304] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:20.260829 30470 raft_consensus.cc:2749] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:20.261530 30466 raft_consensus.cc:2804] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:20.263607 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:20.264197 30440 leader_election.cc:290] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.264432 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
W20260709 12:30:20.265578 30284 leader_election.cc:343] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.266137 30391 raft_consensus.cc:2393] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 502bbfe1b6b44eda9b4569507a55d46a in current term 1: Already voted for candidate 811ff3960ee34275a8343e9a0ed11ae5 in this term.
I20260709 12:30:20.266819 30434 tablet_bootstrap.cc:492] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:20.267290 30284 leader_election.cc:304] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a; no voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.268529 30440 raft_consensus.cc:2749] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:20.265167 30437 raft_consensus.cc:515] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.270277 30435 tablet_bootstrap.cc:654] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.267395 30434 ts_tablet_manager.cc:1403] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 12:30:20.271919 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79d8ed87d640aa846b221492024674" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:20.272557 30243 raft_consensus.cc:3060] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.273591 30434 raft_consensus.cc:359] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.274331 30434 raft_consensus.cc:385] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.274631 30434 raft_consensus.cc:740] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.274726 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79d8ed87d640aa846b221492024674" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:20.275393 30434 consensus_queue.cc:260] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
W20260709 12:30:20.276146 30359 leader_election.cc:343] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.277576 30434 ts_tablet_manager.cc:1434] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:30:20.278705 30437 leader_election.cc:290] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:20.280954 30434 tablet_bootstrap.cc:492] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:20.283993 30243 raft_consensus.cc:2468] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 1.
I20260709 12:30:20.286335 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200d711c63b54d5ba14bcd5d09642d60" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:20.288163 30433 tablet_bootstrap.cc:492] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:20.288849 30468 leader_election.cc:290] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Requested vote from peers 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687), d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627)
I20260709 12:30:20.289531 30244 raft_consensus.cc:3060] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.289113 30434 tablet_bootstrap.cc:654] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.289726 30433 ts_tablet_manager.cc:1403] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.006s
I20260709 12:30:20.289462 30466 raft_consensus.cc:697] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:20.292018 30466 consensus_queue.cc:237] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:20.292568 30437 raft_consensus.cc:493] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.293073 30437 raft_consensus.cc:515] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.295241 30437 leader_election.cc:290] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:20.297161 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.297633 30244 raft_consensus.cc:2468] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
W20260709 12:30:20.298717 30359 leader_election.cc:343] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.299747 30358 leader_election.cc:304] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:20.300485 30435 tablet_bootstrap.cc:492] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:20.300688 30437 raft_consensus.cc:2804] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:20.301061 30435 ts_tablet_manager.cc:1403] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260709 12:30:20.301374 30437 raft_consensus.cc:697] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:20.303135 30433 raft_consensus.cc:359] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.303989 30433 raft_consensus.cc:385] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.303653 30437 consensus_queue.cc:237] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.304360 30433 raft_consensus.cc:740] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.304445 30435 raft_consensus.cc:359] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.305228 30435 raft_consensus.cc:385] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.305532 30435 raft_consensus.cc:740] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.306555 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.307440 30244 raft_consensus.cc:2468] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
I20260709 12:30:20.308620 30434 tablet_bootstrap.cc:492] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:20.308830 30358 leader_election.cc:304] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:20.310417 30470 raft_consensus.cc:2804] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.310884 30470 raft_consensus.cc:493] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.311311 30470 raft_consensus.cc:3060] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.309358 30434 ts_tablet_manager.cc:1403] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 12:30:20.317022 30142 catalog_manager.cc:5697] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 0 to 1, leader changed from <none> to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 1 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:20.318737 30434 raft_consensus.cc:359] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.319509 30434 raft_consensus.cc:385] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.319810 30434 raft_consensus.cc:740] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.320657 30434 consensus_queue.cc:260] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.320904 30470 raft_consensus.cc:515] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.306682 30433 consensus_queue.cc:260] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.325768 30466 raft_consensus.cc:493] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.326361 30466 raft_consensus.cc:515] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.327147 30434 ts_tablet_manager.cc:1434] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 12:30:20.327486 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:20.328130 30244 raft_consensus.cc:3060] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.328238 30434 tablet_bootstrap.cc:492] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:20.328598 30466 leader_election.cc:290] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.328742 30435 consensus_queue.cc:260] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.331565 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79d8ed87d640aa846b221492024674" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.332523 30243 raft_consensus.cc:2393] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 502bbfe1b6b44eda9b4569507a55d46a in current term 1: Already voted for candidate 811ff3960ee34275a8343e9a0ed11ae5 in this term.
I20260709 12:30:20.333561 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79d8ed87d640aa846b221492024674" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.331632 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:20.335633 30434 tablet_bootstrap.cc:654] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.337044 30284 leader_election.cc:304] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a; no voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.331725 30470 leader_election.cc:290] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
W20260709 12:30:20.339108 30359 leader_election.cc:343] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:20.325438 30433 ts_tablet_manager.cc:1434] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:30:20.341779 30433 tablet_bootstrap.cc:492] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:20.339102 30466 raft_consensus.cc:3060] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.349408 30433 tablet_bootstrap.cc:654] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.351904 30435 ts_tablet_manager.cc:1434] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 12:30:20.368043 30435 tablet_bootstrap.cc:492] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:20.374435 30142 catalog_manager.cc:5697] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:20.375396 30466 raft_consensus.cc:2749] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:20.386583 30442 raft_consensus.cc:493] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.387218 30442 raft_consensus.cc:515] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.389305 30442 leader_election.cc:290] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.394261 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87548997099485f80226ece2937951f" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.395064 30319 raft_consensus.cc:2468] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:20.396212 30210 leader_election.cc:304] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:20.396888 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87548997099485f80226ece2937951f" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.397473 30392 raft_consensus.cc:2468] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:20.402405 30442 raft_consensus.cc:2804] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.403048 30442 raft_consensus.cc:493] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.403527 30442 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.358507 30244 raft_consensus.cc:2468] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 1.
I20260709 12:30:20.411598 30435 tablet_bootstrap.cc:654] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.411896 30358 leader_election.cc:304] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:20.413143 30437 raft_consensus.cc:2804] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:20.413668 30437 raft_consensus.cc:697] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:20.414529 30437 consensus_queue.cc:237] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.417513 30433 tablet_bootstrap.cc:492] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:20.417392 30442 raft_consensus.cc:515] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.418007 30434 tablet_bootstrap.cc:492] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:20.418097 30433 ts_tablet_manager.cc:1403] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.042s
I20260709 12:30:20.419994 30435 tablet_bootstrap.cc:492] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:20.420467 30435 ts_tablet_manager.cc:1403] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.004s
I20260709 12:30:20.420624 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87548997099485f80226ece2937951f" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:20.420846 30442 leader_election.cc:290] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.421244 30319 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.421106 30433 raft_consensus.cc:359] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.422314 30479 raft_consensus.cc:493] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.422820 30479 raft_consensus.cc:515] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.423115 30435 raft_consensus.cc:359] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.423738 30435 raft_consensus.cc:385] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.424010 30435 raft_consensus.cc:740] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.424698 30435 consensus_queue.cc:260] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.424890 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87548997099485f80226ece2937951f" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:20.425594 30392 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.425729 30434 ts_tablet_manager.cc:1403] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.098s	user 0.038s	sys 0.048s
I20260709 12:30:20.426553 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.427366 30318 raft_consensus.cc:2393] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 811ff3960ee34275a8343e9a0ed11ae5 in current term 1: Already voted for candidate d79a00eaf95a47d4b3116e6bb0956efc in this term.
I20260709 12:30:20.427973 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.425031 30479 leader_election.cc:290] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:20.428581 30434 raft_consensus.cc:359] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.421865 30433 raft_consensus.cc:385] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.429302 30434 raft_consensus.cc:385] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.429375 30433 raft_consensus.cc:740] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.429912 30434 raft_consensus.cc:740] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.430331 30433 consensus_queue.cc:260] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.430639 30434 consensus_queue.cc:260] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.432768 30434 ts_tablet_manager.cc:1434] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:30:20.432996 30433 ts_tablet_manager.cc:1434] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:30:20.433657 30434 tablet_bootstrap.cc:492] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:20.434348 30433 tablet_bootstrap.cc:492] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:20.429939 30358 leader_election.cc:304] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5; no voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.437644 30435 ts_tablet_manager.cc:1434] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:30:20.438544 30435 tablet_bootstrap.cc:492] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:20.438832 30479 raft_consensus.cc:3060] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.440330 30433 tablet_bootstrap.cc:654] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.446460 30435 tablet_bootstrap.cc:654] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.450815 30142 catalog_manager.cc:5697] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:20.452689 30434 tablet_bootstrap.cc:654] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:20.457638 30435 tablet_bootstrap.cc:492] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:20.458140 30435 ts_tablet_manager.cc:1403] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:30:20.460878 30435 raft_consensus.cc:359] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.461583 30435 raft_consensus.cc:385] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.461858 30435 raft_consensus.cc:740] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.465243 30435 consensus_queue.cc:260] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.467453 30435 ts_tablet_manager.cc:1434] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:30:20.476625 30319 raft_consensus.cc:2468] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:20.480997 30479 raft_consensus.cc:2749] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:20.475054 30392 raft_consensus.cc:2468] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:20.484324 30434 tablet_bootstrap.cc:492] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:20.484423 30433 tablet_bootstrap.cc:492] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:20.484934 30434 ts_tablet_manager.cc:1403] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.020s
I20260709 12:30:20.485044 30433 ts_tablet_manager.cc:1403] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.020s
I20260709 12:30:20.484457 30209 leader_election.cc:304] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:20.485864 30442 raft_consensus.cc:2804] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:20.486318 30442 raft_consensus.cc:697] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:20.487128 30442 consensus_queue.cc:237] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.487771 30434 raft_consensus.cc:359] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.488030 30433 raft_consensus.cc:359] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.488428 30434 raft_consensus.cc:385] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.488627 30433 raft_consensus.cc:385] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:20.488792 30434 raft_consensus.cc:740] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.488942 30433 raft_consensus.cc:740] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:20.489528 30434 consensus_queue.cc:260] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.489661 30433 consensus_queue.cc:260] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.491717 30433 ts_tablet_manager.cc:1434] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:30:20.491888 30434 ts_tablet_manager.cc:1434] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:30:20.495167 30142 catalog_manager.cc:5697] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 0 to 1, leader changed from <none> to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:20.514940 30442 raft_consensus.cc:493] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.515429 30442 raft_consensus.cc:515] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.517141 30442 leader_election.cc:290] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.518075 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.518164 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.518967 30319 raft_consensus.cc:2393] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d79a00eaf95a47d4b3116e6bb0956efc in current term 1: Already voted for candidate 502bbfe1b6b44eda9b4569507a55d46a in this term.
I20260709 12:30:20.519006 30392 raft_consensus.cc:2393] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d79a00eaf95a47d4b3116e6bb0956efc in current term 1: Already voted for candidate 811ff3960ee34275a8343e9a0ed11ae5 in this term.
I20260709 12:30:20.520220 30210 leader_election.cc:304] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:20.520833 30442 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.526058 30442 raft_consensus.cc:2749] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:20.529505 30442 raft_consensus.cc:493] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.529877 30442 raft_consensus.cc:515] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.531482 30442 leader_election.cc:290] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.532274 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd04beb8b3814ca0bac81760e3fabcc0" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:20.532366 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd04beb8b3814ca0bac81760e3fabcc0" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.532883 30319 raft_consensus.cc:2468] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:20.533011 30392 raft_consensus.cc:2468] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:20.533967 30210 leader_election.cc:304] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:20.534708 30442 raft_consensus.cc:2804] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.535035 30442 raft_consensus.cc:493] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.535291 30442 raft_consensus.cc:3060] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.539959 30442 raft_consensus.cc:515] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.541368 30442 leader_election.cc:290] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.542095 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd04beb8b3814ca0bac81760e3fabcc0" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:20.542232 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd04beb8b3814ca0bac81760e3fabcc0" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:20.542625 30319 raft_consensus.cc:3060] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.542773 30392 raft_consensus.cc:3060] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.547504 30319 raft_consensus.cc:2468] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:20.547572 30392 raft_consensus.cc:2468] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:20.548511 30210 leader_election.cc:304] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:20.549172 30442 raft_consensus.cc:2804] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:20.549603 30442 raft_consensus.cc:697] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:20.550334 30442 consensus_queue.cc:237] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.557096 30142 catalog_manager.cc:5697] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 0 to 1, leader changed from <none> to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:20.592089 30466 raft_consensus.cc:493] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.592643 30466 raft_consensus.cc:515] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.594313 30466 leader_election.cc:290] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.595448 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.595683 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.596081 30244 raft_consensus.cc:2468] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 0.
I20260709 12:30:20.596364 30392 raft_consensus.cc:2468] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 0.
I20260709 12:30:20.597141 30466 raft_consensus.cc:493] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.597071 30284 leader_election.cc:304] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:20.598058 30468 raft_consensus.cc:2804] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.597790 30466 raft_consensus.cc:515] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.598392 30468 raft_consensus.cc:493] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.598709 30468 raft_consensus.cc:3060] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.599830 30466 leader_election.cc:290] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.600517 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.600929 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.601315 30244 raft_consensus.cc:2393] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 502bbfe1b6b44eda9b4569507a55d46a in current term 1: Already voted for candidate 811ff3960ee34275a8343e9a0ed11ae5 in this term.
I20260709 12:30:20.602525 30284 leader_election.cc:304] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a; no voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:20.603971 30466 raft_consensus.cc:3060] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.604908 30468 raft_consensus.cc:515] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.606793 30468 leader_election.cc:290] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.607477 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:20.607738 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:20.608110 30244 raft_consensus.cc:3060] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.608286 30392 raft_consensus.cc:3060] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.610986 30466 raft_consensus.cc:2749] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:20.615458 30392 raft_consensus.cc:2468] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:20.615510 30244 raft_consensus.cc:2468] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:20.616874 30284 leader_election.cc:304] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:20.617516 30466 raft_consensus.cc:2804] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:20.617919 30466 raft_consensus.cc:697] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:20.618716 30466 consensus_queue.cc:237] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.625947 30142 catalog_manager.cc:5697] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 0 to 1, leader changed from <none> to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 1 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:20.728590 30466 consensus_queue.cc:1048] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:20.730471 30479 consensus_queue.cc:1048] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:20.747090 30474 consensus_queue.cc:1048] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:20.751082 30437 consensus_queue.cc:1048] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:20.800205 30440 raft_consensus.cc:493] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:20.801946 30440 raft_consensus.cc:515] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.808645 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:20.810205 30244 raft_consensus.cc:2468] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 0.
I20260709 12:30:20.813773 30442 consensus_queue.cc:1048] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:20.815608 30440 leader_election.cc:290] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.817955 30284 leader_election.cc:304] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:20.821105 30442 consensus_queue.cc:1048] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:20.825634 30466 raft_consensus.cc:2804] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:20.826143 30466 raft_consensus.cc:493] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:20.826728 30466 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.827564 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:20.828522 30391 raft_consensus.cc:2468] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 0.
I20260709 12:30:20.831445 30479 consensus_queue.cc:1048] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:20.848807 30466 raft_consensus.cc:515] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.852746 30466 leader_election.cc:290] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:20.855059 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:20.855724 30243 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.860333 30479 consensus_queue.cc:1048] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:20.854288 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:20.866384 30392 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:20.872462 30442 consensus_queue.cc:1048] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:20.888859 30392 raft_consensus.cc:2468] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:20.889734 30243 raft_consensus.cc:2468] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:20.890232 30284 leader_election.cc:304] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:20.892308 30466 raft_consensus.cc:2804] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:20.893086 30466 raft_consensus.cc:697] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:20.894317 30466 consensus_queue.cc:237] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:20.899906 30442 consensus_queue.cc:1048] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:20.914000 30141 catalog_manager.cc:5697] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 0 to 1, leader changed from <none> to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 1 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:20.947260 30462 consensus_queue.cc:1048] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:20.958995 30504 consensus_queue.cc:1048] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:21.016673 30466 consensus_queue.cc:1048] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:21.028473 30466 consensus_queue.cc:1048] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:30:21.143411 30190 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:21.315903 30466 consensus_queue.cc:1048] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:21.327234 30474 consensus_queue.cc:1048] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:21.930742 30474 raft_consensus.cc:493] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:21.931282 30474 raft_consensus.cc:515] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:21.933063 30474 leader_election.cc:290] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:21.934302 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:21.934409 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:21.935133 30243 raft_consensus.cc:2468] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:21.935196 30391 raft_consensus.cc:2468] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:21.936386 30284 leader_election.cc:304] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:21.937109 30474 raft_consensus.cc:2804] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:21.937418 30474 raft_consensus.cc:493] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:21.937670 30474 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:21.944746 30474 raft_consensus.cc:515] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:21.946940 30474 leader_election.cc:290] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:21.947885 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:21.947997 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:21.948529 30243 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:21.948602 30391 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:21.954558 30243 raft_consensus.cc:2468] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:21.955080 30391 raft_consensus.cc:2468] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:21.955958 30284 leader_election.cc:304] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:21.956869 30474 raft_consensus.cc:2804] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:21.957289 30474 raft_consensus.cc:697] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:21.958232 30474 consensus_queue.cc:237] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:21.966212 30142 catalog_manager.cc:5697] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 0 to 2, leader changed from <none> to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:22.359045 30317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "200d711c63b54d5ba14bcd5d09642d60"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
mode: GRACEFUL
new_leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:60206
I20260709 12:30:22.359620 30317 raft_consensus.cc:606] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Received request to transfer leadership to TS d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:22.364277 30317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
mode: GRACEFUL
new_leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:60206
I20260709 12:30:22.364750 30317 raft_consensus.cc:606] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Received request to transfer leadership to TS d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:22.371919 30317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
mode: GRACEFUL
new_leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:60206
I20260709 12:30:22.372524 30317 raft_consensus.cc:606] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Received request to transfer leadership to TS d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:22.385715 30391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae79d8ed87d640aa846b221492024674"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
mode: GRACEFUL
new_leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60590
I20260709 12:30:22.386229 30391 raft_consensus.cc:606] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Received request to transfer leadership to TS 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:22.389408 30243 raft_consensus.cc:1275] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:30:22.390813 30474 consensus_queue.cc:1048] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:22.402419 30391 raft_consensus.cc:1275] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:30:22.409369 30474 consensus_queue.cc:1048] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:22.414868 30244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87548997099485f80226ece2937951f"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
mode: GRACEFUL
new_leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:30:22.415596 30244 raft_consensus.cc:606] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Received request to transfer leadership to TS 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:22.423097 30392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
mode: GRACEFUL
new_leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60590
I20260709 12:30:22.423673 30392 raft_consensus.cc:606] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Received request to transfer leadership to TS 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:22.429430 30244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
mode: GRACEFUL
new_leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:30:22.429937 30244 raft_consensus.cc:606] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Received request to transfer leadership to TS 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:22.435253 30317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
mode: GRACEFUL
new_leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
 from {username='slave'} at 127.0.0.1:60206
I20260709 12:30:22.435926 30317 raft_consensus.cc:606] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Received request to transfer leadership to TS 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:22.545682 30524 raft_consensus.cc:993] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a: : Instructing follower d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:22.546154 30474 raft_consensus.cc:1081] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Signalling peer d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:22.547734 30244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "200d711c63b54d5ba14bcd5d09642d60"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:30:22.548311 30244 raft_consensus.cc:493] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.548609 30244 raft_consensus.cc:3060] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.555158 30244 raft_consensus.cc:515] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:22.557199 30244 leader_election.cc:290] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:22.558142 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200d711c63b54d5ba14bcd5d09642d60" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:22.558399 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200d711c63b54d5ba14bcd5d09642d60" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:22.558916 30317 raft_consensus.cc:3055] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:22.558984 30393 raft_consensus.cc:3060] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.559352 30317 raft_consensus.cc:740] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:22.560318 30317 consensus_queue.cc:260] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:22.561770 30317 raft_consensus.cc:3060] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.567581 30393 raft_consensus.cc:2468] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:22.569288 30209 leader_election.cc:304] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:22.570097 30526 raft_consensus.cc:2804] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:22.570631 30526 raft_consensus.cc:697] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:22.570952 30317 raft_consensus.cc:2468] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:22.571797 30526 consensus_queue.cc:237] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } }
I20260709 12:30:22.580086 30141 catalog_manager.cc:5697] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 1 to 2, leader changed from 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66) to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:22.635993 30479 raft_consensus.cc:993] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5: : Instructing follower 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:22.636564 30533 raft_consensus.cc:1081] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Signalling peer 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:22.638195 30317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae79d8ed87d640aa846b221492024674"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60186
I20260709 12:30:22.638720 30317 raft_consensus.cc:493] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.639017 30317 raft_consensus.cc:3060] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.647454 30317 raft_consensus.cc:515] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.648890 30524 raft_consensus.cc:993] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a: : Instructing follower d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:22.649389 30474 raft_consensus.cc:1081] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Signalling peer d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:22.649485 30317 leader_election.cc:290] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:22.650166 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79d8ed87d640aa846b221492024674" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:22.650509 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79d8ed87d640aa846b221492024674" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:22.650838 30244 raft_consensus.cc:3060] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.651170 30393 raft_consensus.cc:3055] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:22.651528 30393 raft_consensus.cc:740] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:22.651540 30243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:30:22.652215 30243 raft_consensus.cc:493] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.652642 30243 raft_consensus.cc:3060] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.652405 30393 consensus_queue.cc:260] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.653769 30393 raft_consensus.cc:3060] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.658989 30244 raft_consensus.cc:2468] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:22.658984 30393 raft_consensus.cc:2468] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:22.660074 30243 raft_consensus.cc:515] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.660496 30284 leader_election.cc:304] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:22.661245 30474 raft_consensus.cc:2804] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:22.662428 30474 raft_consensus.cc:697] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:22.662582 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:22.662775 30243 leader_election.cc:290] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:22.663275 30317 raft_consensus.cc:3055] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:22.663652 30317 raft_consensus.cc:740] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:22.663412 30474 consensus_queue.cc:237] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.664570 30317 consensus_queue.cc:260] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.665624 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3aaadaad0b4777ad44e4fe3399cebd" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:22.665930 30317 raft_consensus.cc:3060] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.666203 30393 raft_consensus.cc:3060] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.672595 30393 raft_consensus.cc:2468] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:22.673574 30209 leader_election.cc:304] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:22.673806 30317 raft_consensus.cc:2468] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:22.674402 30526 raft_consensus.cc:2804] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:22.674918 30526 raft_consensus.cc:697] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:22.674901 30141 catalog_manager.cc:5697] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 1 to 2, leader changed from 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67) to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:22.676365 30526 consensus_queue.cc:237] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.684787 30142 catalog_manager.cc:5697] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 1 to 2, leader changed from 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66) to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:22.695192 30504 raft_consensus.cc:993] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc: : Instructing follower 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:22.695629 30526 raft_consensus.cc:1081] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Signalling peer 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:22.697048 30317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87548997099485f80226ece2937951f"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60192
I20260709 12:30:22.697567 30317 raft_consensus.cc:493] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.697873 30317 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.703763 30317 raft_consensus.cc:515] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.705351 30317 leader_election.cc:290] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:22.706197 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87548997099485f80226ece2937951f" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:22.706385 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87548997099485f80226ece2937951f" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:22.706892 30243 raft_consensus.cc:3055] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:22.706951 30393 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.707324 30243 raft_consensus.cc:740] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:22.708213 30243 consensus_queue.cc:260] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.709452 30243 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.714300 30393 raft_consensus.cc:2468] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:22.715622 30284 leader_election.cc:304] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:22.716420 30474 raft_consensus.cc:2804] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:22.716467 30243 raft_consensus.cc:2468] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:22.716922 30474 raft_consensus.cc:697] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:22.717856 30474 consensus_queue.cc:237] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.727649 30142 catalog_manager.cc:5697] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 1 to 2, leader changed from d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65) to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:22.780468 30504 raft_consensus.cc:993] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc: : Instructing follower 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:22.780886 30526 raft_consensus.cc:1081] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Signalling peer 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:22.782248 30317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60192
I20260709 12:30:22.782717 30317 raft_consensus.cc:493] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.782984 30317 raft_consensus.cc:3060] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.787914 30317 raft_consensus.cc:515] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.789433 30317 leader_election.cc:290] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:22.790305 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:22.790512 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6df216c755843fbb47dd91756df4ae5" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:22.791028 30243 raft_consensus.cc:3055] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:22.791074 30393 raft_consensus.cc:3060] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.791497 30243 raft_consensus.cc:740] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:22.792431 30243 consensus_queue.cc:260] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.793661 30243 raft_consensus.cc:3060] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.798303 30393 raft_consensus.cc:2468] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:22.799461 30284 leader_election.cc:304] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:22.800285 30474 raft_consensus.cc:2804] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:22.800411 30243 raft_consensus.cc:2468] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:22.800688 30474 raft_consensus.cc:697] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:22.801977 30474 consensus_queue.cc:237] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.808554 30142 catalog_manager.cc:5697] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 1 to 2, leader changed from d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65) to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:22.876057 30524 raft_consensus.cc:993] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a: : Instructing follower d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:22.876461 30474 raft_consensus.cc:1081] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Signalling peer d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:22.878360 30243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:30:22.878895 30243 raft_consensus.cc:493] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.879305 30243 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.887074 30243 raft_consensus.cc:515] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.888870 30243 leader_election.cc:290] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:22.889906 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:22.889906 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:22.890901 30317 raft_consensus.cc:3055] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:22.890681 30393 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.891237 30317 raft_consensus.cc:740] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:22.892359 30317 consensus_queue.cc:260] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.893733 30317 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.894323 30533 raft_consensus.cc:993] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5: : Instructing follower 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:22.894938 30479 raft_consensus.cc:1081] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Signalling peer 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:22.896759 30318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60186
I20260709 12:30:22.897377 30318 raft_consensus.cc:493] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.897732 30318 raft_consensus.cc:3060] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.898272 30393 raft_consensus.cc:2468] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:22.899345 30209 leader_election.cc:304] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:22.900077 30526 raft_consensus.cc:2804] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:22.900743 30526 raft_consensus.cc:697] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:22.901451 30317 raft_consensus.cc:2468] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:22.902016 30526 consensus_queue.cc:237] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.905799 30318 raft_consensus.cc:515] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.908277 30318 leader_election.cc:290] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:22.908931 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:22.909209 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2462c1993c4249b5aa38ccf9d9c247fc" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:22.909600 30243 raft_consensus.cc:3060] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.909785 30393 raft_consensus.cc:3055] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:22.910203 30393 raft_consensus.cc:740] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:22.911154 30393 consensus_queue.cc:260] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.911509 30142 catalog_manager.cc:5697] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 1 to 2, leader changed from 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66) to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:22.912432 30393 raft_consensus.cc:3060] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:22.917318 30243 raft_consensus.cc:2468] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:22.918884 30284 leader_election.cc:304] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:22.919735 30393 raft_consensus.cc:2468] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:22.919749 30474 raft_consensus.cc:2804] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:22.920485 30474 raft_consensus.cc:697] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:22.921461 30474 consensus_queue.cc:237] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:22.928303 30142 catalog_manager.cc:5697] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 1 to 2, leader changed from 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67) to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:22.976806 30393 raft_consensus.cc:1275] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:22.978047 30526 consensus_queue.cc:1048] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:22.988709 30474 raft_consensus.cc:993] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a: : Instructing follower 811ff3960ee34275a8343e9a0ed11ae5 to start an election
I20260709 12:30:22.989333 30524 raft_consensus.cc:1081] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Signalling peer 811ff3960ee34275a8343e9a0ed11ae5 to start an election
I20260709 12:30:22.991113 30392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
 from {username='slave'} at 127.0.0.1:60580
I20260709 12:30:22.991668 30392 raft_consensus.cc:493] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.992043 30392 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:22.994397 30318 raft_consensus.cc:1275] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:22.996155 30526 consensus_queue.cc:1048] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:22.999878 30392 raft_consensus.cc:515] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:23.003278 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:23.003883 30243 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:23.006693 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb4db1d0c394e57bb66954b2104e730" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:23.007342 30318 raft_consensus.cc:3055] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:23.007714 30318 raft_consensus.cc:740] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:23.006088 30392 leader_election.cc:290] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 3 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:23.008579 30318 consensus_queue.cc:260] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:23.010974 30318 raft_consensus.cc:3060] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:23.012416 30243 raft_consensus.cc:2468] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 3.
I20260709 12:30:23.013808 30358 leader_election.cc:304] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:23.014739 30479 raft_consensus.cc:2804] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:23.015256 30479 raft_consensus.cc:697] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:23.016162 30479 consensus_queue.cc:237] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:23.018646 30318 raft_consensus.cc:2468] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 3.
I20260709 12:30:23.024161 30142 catalog_manager.cc:5697] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 2 to 3, leader changed from 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66) to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 3 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:23.058913 30392 raft_consensus.cc:1275] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.060700 30524 consensus_queue.cc:1048] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.070636 30243 raft_consensus.cc:1275] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.073029 30541 consensus_queue.cc:1048] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.145298 30392 raft_consensus.cc:1275] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.146476 30541 consensus_queue.cc:1048] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.155326 30243 raft_consensus.cc:1275] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.158527 30549 consensus_queue.cc:1048] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:23.247829 30318 raft_consensus.cc:1275] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.249377 30526 consensus_queue.cc:1048] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.260660 30392 raft_consensus.cc:1275] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.262567 30552 consensus_queue.cc:1048] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:23.292550 30392 raft_consensus.cc:1275] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.293867 30549 consensus_queue.cc:1048] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.301066 30243 raft_consensus.cc:1275] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.302356 30541 consensus_queue.cc:1048] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.327605 30392 raft_consensus.cc:1275] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.328764 30541 consensus_queue.cc:1048] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.338678 30318 raft_consensus.cc:1275] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.340603 30552 consensus_queue.cc:1048] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:23.342325 30243 raft_consensus.cc:1275] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.344271 30474 consensus_queue.cc:1048] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.353214 30392 raft_consensus.cc:1275] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.355041 30504 consensus_queue.cc:1048] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:23.464176 30318 raft_consensus.cc:1275] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Refusing update from remote peer 811ff3960ee34275a8343e9a0ed11ae5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:23.465374 30479 consensus_queue.cc:1048] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.474174 30243 raft_consensus.cc:1275] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Refusing update from remote peer 811ff3960ee34275a8343e9a0ed11ae5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:23.476713 30561 consensus_queue.cc:1048] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:25.464008 30140 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51260:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:25.466298 30140 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:25.513342 30233 tablet_service.cc:1511] Processing CreateTablet for tablet b69dae2e99fd4ebdb4cba00cc63b48d9 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:25.515101 30233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69dae2e99fd4ebdb4cba00cc63b48d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.515442 30303 tablet_service.cc:1511] Processing CreateTablet for tablet b69dae2e99fd4ebdb4cba00cc63b48d9 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:25.516119 30381 tablet_service.cc:1511] Processing CreateTablet for tablet b69dae2e99fd4ebdb4cba00cc63b48d9 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:25.516836 30303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69dae2e99fd4ebdb4cba00cc63b48d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.517554 30381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69dae2e99fd4ebdb4cba00cc63b48d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.521481 30306 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec1f4dd8c304f46ba184c7f53010ba0 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:25.522939 30306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec1f4dd8c304f46ba184c7f53010ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.523221 30380 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec1f4dd8c304f46ba184c7f53010ba0 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:25.525447 30230 tablet_service.cc:1511] Processing CreateTablet for tablet 67fcd78b4ab24fc7b7a28aa5cac92afd (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:25.525655 30305 tablet_service.cc:1511] Processing CreateTablet for tablet 67fcd78b4ab24fc7b7a28aa5cac92afd (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:25.526866 30230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fcd78b4ab24fc7b7a28aa5cac92afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.527062 30305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fcd78b4ab24fc7b7a28aa5cac92afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.527925 30379 tablet_service.cc:1511] Processing CreateTablet for tablet 67fcd78b4ab24fc7b7a28aa5cac92afd (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:25.530977 30380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec1f4dd8c304f46ba184c7f53010ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.525460 30226 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec1f4dd8c304f46ba184c7f53010ba0 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:25.532037 30226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec1f4dd8c304f46ba184c7f53010ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.532779 30379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fcd78b4ab24fc7b7a28aa5cac92afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.553990 30232 tablet_service.cc:1511] Processing CreateTablet for tablet f008a41416394983b5a8d83b47081598 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:25.555537 30232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f008a41416394983b5a8d83b47081598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.566229 30308 tablet_service.cc:1511] Processing CreateTablet for tablet f008a41416394983b5a8d83b47081598 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:25.567730 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f008a41416394983b5a8d83b47081598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.578263 30577 tablet_bootstrap.cc:492] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:25.579133 30376 tablet_service.cc:1511] Processing CreateTablet for tablet f008a41416394983b5a8d83b47081598 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:25.580479 30376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f008a41416394983b5a8d83b47081598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.584017 30578 tablet_bootstrap.cc:492] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:25.587203 30577 tablet_bootstrap.cc:654] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.590809 30578 tablet_bootstrap.cc:654] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.598001 30230 tablet_service.cc:1511] Processing CreateTablet for tablet b6bec8c26e2042dc9297cfa76fee3a80 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:25.599516 30230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bec8c26e2042dc9297cfa76fee3a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.604862 30304 tablet_service.cc:1511] Processing CreateTablet for tablet b6bec8c26e2042dc9297cfa76fee3a80 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:25.606284 30304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bec8c26e2042dc9297cfa76fee3a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.606657 30381 tablet_service.cc:1511] Processing CreateTablet for tablet b6bec8c26e2042dc9297cfa76fee3a80 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:25.607867 30381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bec8c26e2042dc9297cfa76fee3a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.614813 30226 tablet_service.cc:1511] Processing CreateTablet for tablet a31b3a4c53674af5b3b00793bafc9f59 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:25.616163 30226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31b3a4c53674af5b3b00793bafc9f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.622152 30377 tablet_service.cc:1511] Processing CreateTablet for tablet a31b3a4c53674af5b3b00793bafc9f59 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:25.624228 30377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31b3a4c53674af5b3b00793bafc9f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.640053 30306 tablet_service.cc:1511] Processing CreateTablet for tablet a31b3a4c53674af5b3b00793bafc9f59 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:25.642385 30306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31b3a4c53674af5b3b00793bafc9f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.659458 30581 tablet_bootstrap.cc:492] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:25.666523 30578 tablet_bootstrap.cc:492] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:25.667191 30578 ts_tablet_manager.cc:1403] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.009s
I20260709 12:30:25.670182 30232 tablet_service.cc:1511] Processing CreateTablet for tablet f760603a1a0e4ab2a7c8d8e4cadec9a6 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:25.670373 30578 raft_consensus.cc:359] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.675850 30578 raft_consensus.cc:385] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.676319 30232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f760603a1a0e4ab2a7c8d8e4cadec9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.671921 30305 tablet_service.cc:1511] Processing CreateTablet for tablet f760603a1a0e4ab2a7c8d8e4cadec9a6 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:25.674239 30226 tablet_service.cc:1511] Processing CreateTablet for tablet 90a02241adea4299bc5c3b7a12452833 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:25.675398 30308 tablet_service.cc:1511] Processing CreateTablet for tablet 90a02241adea4299bc5c3b7a12452833 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:25.677560 30226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90a02241adea4299bc5c3b7a12452833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.675269 30577 tablet_bootstrap.cc:492] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:25.677875 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90a02241adea4299bc5c3b7a12452833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.678335 30577 ts_tablet_manager.cc:1403] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.100s	user 0.029s	sys 0.024s
I20260709 12:30:25.676609 30379 tablet_service.cc:1511] Processing CreateTablet for tablet f760603a1a0e4ab2a7c8d8e4cadec9a6 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:25.680861 30577 raft_consensus.cc:359] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.671005 30581 tablet_bootstrap.cc:654] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.681368 30577 raft_consensus.cc:385] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.681651 30577 raft_consensus.cc:740] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.676278 30578 raft_consensus.cc:740] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.682247 30577 consensus_queue.cc:260] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.681284 30379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f760603a1a0e4ab2a7c8d8e4cadec9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.685846 30380 tablet_service.cc:1511] Processing CreateTablet for tablet 90a02241adea4299bc5c3b7a12452833 (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:25.687155 30380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90a02241adea4299bc5c3b7a12452833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.688390 30578 consensus_queue.cc:260] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.692306 30561 raft_consensus.cc:493] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:25.692842 30561 raft_consensus.cc:515] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.697367 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69dae2e99fd4ebdb4cba00cc63b48d9" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:25.697860 30561 leader_election.cc:290] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:25.697688 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69dae2e99fd4ebdb4cba00cc63b48d9" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
W20260709 12:30:25.699853 30358 leader_election.cc:343] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:25.701402 30577 ts_tablet_manager.cc:1434] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
W20260709 12:30:25.701655 30359 leader_election.cc:343] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:25.702142 30359 leader_election.cc:304] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5; no voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:25.702672 30577 tablet_bootstrap.cc:492] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:25.703318 30561 raft_consensus.cc:2749] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:25.706806 30306 tablet_service.cc:1511] Processing CreateTablet for tablet 10d4af1baf6d44de9eb54a824b23920e (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:25.710796 30578 ts_tablet_manager.cc:1434] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:30:25.682504 30305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f760603a1a0e4ab2a7c8d8e4cadec9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.713933 30578 tablet_bootstrap.cc:492] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:25.714327 30306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d4af1baf6d44de9eb54a824b23920e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.712188 30232 tablet_service.cc:1511] Processing CreateTablet for tablet 10d4af1baf6d44de9eb54a824b23920e (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:25.715458 30232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d4af1baf6d44de9eb54a824b23920e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.710829 30577 tablet_bootstrap.cc:654] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.720993 30581 tablet_bootstrap.cc:492] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:25.721823 30581 ts_tablet_manager.cc:1403] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.063s	user 0.000s	sys 0.012s
I20260709 12:30:25.727752 30377 tablet_service.cc:1511] Processing CreateTablet for tablet 10d4af1baf6d44de9eb54a824b23920e (DEFAULT_TABLE table=soft_deleted_table [id=687b6941493f4d07b71675994d24651c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:25.729200 30377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d4af1baf6d44de9eb54a824b23920e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:25.738410 30578 tablet_bootstrap.cc:654] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.741636 30581 raft_consensus.cc:359] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.742466 30581 raft_consensus.cc:385] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.742789 30581 raft_consensus.cc:740] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.743640 30581 consensus_queue.cc:260] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.749004 30581 ts_tablet_manager.cc:1434] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.005s
I20260709 12:30:25.750023 30581 tablet_bootstrap.cc:492] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:25.760040 30577 tablet_bootstrap.cc:492] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:25.760759 30577 ts_tablet_manager.cc:1403] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.010s
I20260709 12:30:25.763878 30577 raft_consensus.cc:359] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.764665 30577 raft_consensus.cc:385] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.765095 30577 raft_consensus.cc:740] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.765973 30577 consensus_queue.cc:260] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.766736 30581 tablet_bootstrap.cc:654] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.770557 30578 tablet_bootstrap.cc:492] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:25.771129 30578 ts_tablet_manager.cc:1403] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.002s
I20260709 12:30:25.774096 30578 raft_consensus.cc:359] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.774860 30578 raft_consensus.cc:385] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.775146 30578 raft_consensus.cc:740] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.776443 30578 consensus_queue.cc:260] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.778920 30578 ts_tablet_manager.cc:1434] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:30:25.780020 30577 ts_tablet_manager.cc:1434] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:30:25.782474 30578 tablet_bootstrap.cc:492] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:25.788635 30577 tablet_bootstrap.cc:492] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:25.791527 30578 tablet_bootstrap.cc:654] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.800720 30577 tablet_bootstrap.cc:654] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.802240 30581 tablet_bootstrap.cc:492] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:25.802837 30581 ts_tablet_manager.cc:1403] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.020s
I20260709 12:30:25.803599 30578 tablet_bootstrap.cc:492] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:25.804035 30578 ts_tablet_manager.cc:1403] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:30:25.806344 30578 raft_consensus.cc:359] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.806227 30581 raft_consensus.cc:359] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.807143 30578 raft_consensus.cc:385] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.807253 30581 raft_consensus.cc:385] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.807468 30578 raft_consensus.cc:740] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.807693 30581 raft_consensus.cc:740] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.808252 30578 consensus_queue.cc:260] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.808550 30581 consensus_queue.cc:260] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.810657 30578 ts_tablet_manager.cc:1434] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:30:25.811518 30581 ts_tablet_manager.cc:1434] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:30:25.812765 30578 tablet_bootstrap.cc:492] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:25.813773 30581 tablet_bootstrap.cc:492] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:25.818050 30577 tablet_bootstrap.cc:492] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:25.818691 30577 ts_tablet_manager.cc:1403] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 12:30:25.820011 30578 tablet_bootstrap.cc:654] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.820822 30581 tablet_bootstrap.cc:654] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.821973 30577 raft_consensus.cc:359] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.822796 30577 raft_consensus.cc:385] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.823077 30577 raft_consensus.cc:740] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.824097 30577 consensus_queue.cc:260] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.826851 30577 ts_tablet_manager.cc:1434] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:30:25.828097 30577 tablet_bootstrap.cc:492] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:25.836229 30577 tablet_bootstrap.cc:654] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.837037 30581 tablet_bootstrap.cc:492] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:25.837638 30581 ts_tablet_manager.cc:1403] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 12:30:25.841890 30578 tablet_bootstrap.cc:492] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:25.842463 30578 ts_tablet_manager.cc:1403] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.000s
I20260709 12:30:25.844367 30563 raft_consensus.cc:493] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:25.845439 30563 raft_consensus.cc:515] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.846378 30578 raft_consensus.cc:359] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.847131 30578 raft_consensus.cc:385] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.847394 30578 raft_consensus.cc:740] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.848100 30578 consensus_queue.cc:260] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.848397 30581 raft_consensus.cc:359] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.849246 30581 raft_consensus.cc:385] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.849550 30581 raft_consensus.cc:740] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.850306 30581 consensus_queue.cc:260] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.853024 30581 ts_tablet_manager.cc:1434] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:30:25.853950 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:25.854115 30581 tablet_bootstrap.cc:492] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:25.855114 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
W20260709 12:30:25.856616 30209 leader_election.cc:343] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:25.858337 30210 leader_election.cc:343] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:25.858757 30210 leader_election.cc:304] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:25.859910 30563 leader_election.cc:290] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:25.861353 30563 raft_consensus.cc:2749] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:25.865067 30581 tablet_bootstrap.cc:654] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.865501 30577 tablet_bootstrap.cc:492] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:25.866019 30577 ts_tablet_manager.cc:1403] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.021s
I20260709 12:30:25.867214 30578 ts_tablet_manager.cc:1434] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 12:30:25.868358 30578 tablet_bootstrap.cc:492] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:25.869267 30577 raft_consensus.cc:359] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.870149 30577 raft_consensus.cc:385] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.870466 30577 raft_consensus.cc:740] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.871558 30577 consensus_queue.cc:260] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.874200 30577 ts_tablet_manager.cc:1434] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:30:25.875427 30577 tablet_bootstrap.cc:492] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:25.876223 30578 tablet_bootstrap.cc:654] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.879158 30593 raft_consensus.cc:493] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:25.879904 30593 raft_consensus.cc:515] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.883210 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec1f4dd8c304f46ba184c7f53010ba0" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:25.883998 30318 raft_consensus.cc:2468] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:25.885380 30563 raft_consensus.cc:493] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:25.886618 30563 raft_consensus.cc:515] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.885512 30210 leader_election.cc:304] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:25.887815 30592 raft_consensus.cc:2804] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:25.888262 30592 raft_consensus.cc:493] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:25.888608 30592 raft_consensus.cc:3060] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:25.892580 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec1f4dd8c304f46ba184c7f53010ba0" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
W20260709 12:30:25.894243 30209 leader_election.cc:343] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:25.896268 30593 leader_election.cc:290] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:25.902427 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:25.902892 30592 raft_consensus.cc:515] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
W20260709 12:30:25.904016 30210 leader_election.cc:343] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:25.906219 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:25.906909 30392 raft_consensus.cc:2468] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:25.907748 30577 tablet_bootstrap.cc:654] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.908237 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec1f4dd8c304f46ba184c7f53010ba0" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:25.908910 30318 raft_consensus.cc:3060] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:25.911203 30592 leader_election.cc:290] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:25.913957 30209 leader_election.cc:304] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:25.915452 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec1f4dd8c304f46ba184c7f53010ba0" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
W20260709 12:30:25.917306 30209 leader_election.cc:343] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:25.918262 30592 raft_consensus.cc:2804] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:25.918772 30592 raft_consensus.cc:493] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:25.919111 30592 raft_consensus.cc:3060] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:25.927243 30592 raft_consensus.cc:515] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.927747 30563 leader_election.cc:290] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:25.932941 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
W20260709 12:30:25.934435 30210 leader_election.cc:343] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:25.934386 30592 leader_election.cc:290] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:25.936043 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:25.936820 30392 raft_consensus.cc:3060] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:25.945586 30392 raft_consensus.cc:2468] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:25.946985 30209 leader_election.cc:304] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:25.947919 30592 raft_consensus.cc:2804] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:25.948452 30592 raft_consensus.cc:697] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:25.950277 30592 consensus_queue.cc:237] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.951144 30318 raft_consensus.cc:2468] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:25.952610 30210 leader_election.cc:304] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:25.953850 30563 raft_consensus.cc:2804] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:25.954330 30563 raft_consensus.cc:697] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:25.955192 30563 consensus_queue.cc:237] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.958443 30578 tablet_bootstrap.cc:492] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:25.959251 30578 ts_tablet_manager.cc:1403] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.091s	user 0.033s	sys 0.042s
I20260709 12:30:25.963680 30577 tablet_bootstrap.cc:492] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:25.964048 30581 tablet_bootstrap.cc:492] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:25.964430 30577 ts_tablet_manager.cc:1403] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.016s
I20260709 12:30:25.964666 30581 ts_tablet_manager.cc:1403] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.111s	user 0.055s	sys 0.043s
I20260709 12:30:25.965399 30578 raft_consensus.cc:359] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.966166 30578 raft_consensus.cc:385] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.966441 30578 raft_consensus.cc:740] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.967339 30577 raft_consensus.cc:359] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.967294 30578 consensus_queue.cc:260] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.967854 30581 raft_consensus.cc:359] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.968677 30581 raft_consensus.cc:385] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.968989 30581 raft_consensus.cc:740] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.970197 30578 ts_tablet_manager.cc:1434] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:30:25.970194 30581 consensus_queue.cc:260] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.971824 30578 tablet_bootstrap.cc:492] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:25.972798 30577 raft_consensus.cc:385] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.973114 30577 raft_consensus.cc:740] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.973860 30577 consensus_queue.cc:260] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.975212 30581 ts_tablet_manager.cc:1434] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:30:25.976089 30577 ts_tablet_manager.cc:1434] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:30:25.976315 30581 tablet_bootstrap.cc:492] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:25.977072 30577 tablet_bootstrap.cc:492] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:25.979801 30578 tablet_bootstrap.cc:654] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.984370 30577 tablet_bootstrap.cc:654] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.985632 30581 tablet_bootstrap.cc:654] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:25.983670 30142 catalog_manager.cc:5697] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 0 to 1, leader changed from <none> to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:25.991765 30578 tablet_bootstrap.cc:492] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:25.992328 30578 ts_tablet_manager.cc:1403] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:30:25.995515 30578 raft_consensus.cc:359] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.995927 30577 tablet_bootstrap.cc:492] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:25.996238 30578 raft_consensus.cc:385] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:25.996539 30578 raft_consensus.cc:740] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:25.997520 30577 ts_tablet_manager.cc:1403] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:30:25.997303 30578 consensus_queue.cc:260] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:25.998683 30581 tablet_bootstrap.cc:492] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:25.999186 30581 ts_tablet_manager.cc:1403] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 12:30:25.999629 30578 ts_tablet_manager.cc:1434] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:30:26.000911 30578 tablet_bootstrap.cc:492] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:26.001046 30474 raft_consensus.cc:493] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.001520 30474 raft_consensus.cc:515] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.001945 30577 raft_consensus.cc:359] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.002703 30577 raft_consensus.cc:385] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.002983 30577 raft_consensus.cc:740] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.003562 30474 leader_election.cc:290] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.004459 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:26.004834 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:26.005527 30392 raft_consensus.cc:2393] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 502bbfe1b6b44eda9b4569507a55d46a in current term 1: Already voted for candidate d79a00eaf95a47d4b3116e6bb0956efc in this term.
I20260709 12:30:26.005693 30577 consensus_queue.cc:260] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.006247 30581 raft_consensus.cc:359] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.006991 30581 raft_consensus.cc:385] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.007274 30581 raft_consensus.cc:740] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.007434 30284 leader_election.cc:304] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a; no voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:26.007763 30578 tablet_bootstrap.cc:654] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.008073 30577 ts_tablet_manager.cc:1434] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 12:30:26.007990 30581 consensus_queue.cc:260] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.009157 30577 tablet_bootstrap.cc:492] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:26.010227 30581 ts_tablet_manager.cc:1434] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:30:26.010574 30561 raft_consensus.cc:493] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.011229 30581 tablet_bootstrap.cc:492] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:26.011060 30561 raft_consensus.cc:515] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.017809 30577 tablet_bootstrap.cc:654] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.018913 30581 tablet_bootstrap.cc:654] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.020287 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:26.020944 30243 raft_consensus.cc:2468] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
I20260709 12:30:26.022264 30358 leader_election.cc:304] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.023207 30561 leader_election.cc:290] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:26.026914 30561 raft_consensus.cc:2804] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:26.028164 30561 raft_consensus.cc:493] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:26.020310 30474 raft_consensus.cc:3060] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.024930 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:26.031047 30318 raft_consensus.cc:2468] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
I20260709 12:30:26.031822 30578 tablet_bootstrap.cc:492] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:26.032395 30578 ts_tablet_manager.cc:1403] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.008s
I20260709 12:30:26.035029 30578 raft_consensus.cc:359] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.035789 30578 raft_consensus.cc:385] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.035933 30561 raft_consensus.cc:3060] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.036084 30578 raft_consensus.cc:740] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.037354 30578 consensus_queue.cc:260] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.038719 30577 tablet_bootstrap.cc:492] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:26.039321 30577 ts_tablet_manager.cc:1403] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.003s
I20260709 12:30:26.039671 30578 ts_tablet_manager.cc:1434] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:30:26.040944 30578 tablet_bootstrap.cc:492] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:26.042701 30577 raft_consensus.cc:359] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.043447 30577 raft_consensus.cc:385] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.043779 30577 raft_consensus.cc:740] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.044667 30577 consensus_queue.cc:260] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.047736 30581 tablet_bootstrap.cc:492] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:26.048307 30581 ts_tablet_manager.cc:1403] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.010s
I20260709 12:30:26.048971 30578 tablet_bootstrap.cc:654] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.055450 30577 ts_tablet_manager.cc:1434] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:30:26.056769 30581 raft_consensus.cc:359] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.057578 30581 raft_consensus.cc:385] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.057868 30581 raft_consensus.cc:740] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.058736 30581 consensus_queue.cc:260] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.059789 30139 catalog_manager.cc:5697] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 0 to 1, leader changed from <none> to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.064707 30581 ts_tablet_manager.cc:1434] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:30:26.065847 30581 tablet_bootstrap.cc:492] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:26.070035 30608 raft_consensus.cc:493] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.070623 30608 raft_consensus.cc:515] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.072829 30608 leader_election.cc:290] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.073433 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f008a41416394983b5a8d83b47081598" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:26.074072 30243 raft_consensus.cc:2468] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 0.
I20260709 12:30:26.065871 30577 tablet_bootstrap.cc:492] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:26.075511 30284 leader_election.cc:304] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.076869 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f008a41416394983b5a8d83b47081598" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:26.077524 30392 raft_consensus.cc:2468] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 0.
I20260709 12:30:26.079358 30608 raft_consensus.cc:2804] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:26.079770 30608 raft_consensus.cc:493] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:26.080116 30608 raft_consensus.cc:3060] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.085930 30581 tablet_bootstrap.cc:654] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.088500 30474 raft_consensus.cc:2749] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:26.090096 30578 tablet_bootstrap.cc:492] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:26.090227 30577 tablet_bootstrap.cc:654] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.090618 30578 ts_tablet_manager.cc:1403] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.026s
I20260709 12:30:26.090257 30608 raft_consensus.cc:515] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.093480 30578 raft_consensus.cc:359] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.094148 30578 raft_consensus.cc:385] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.094388 30608 leader_election.cc:290] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.094401 30578 raft_consensus.cc:740] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.095410 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f008a41416394983b5a8d83b47081598" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:26.095569 30578 consensus_queue.cc:260] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.095983 30243 raft_consensus.cc:3060] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.097702 30578 ts_tablet_manager.cc:1434] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:26.098671 30578 tablet_bootstrap.cc:492] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc: Bootstrap starting.
I20260709 12:30:26.103121 30392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f008a41416394983b5a8d83b47081598" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.103838 30392 raft_consensus.cc:3060] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.104398 30578 tablet_bootstrap.cc:654] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.106513 30604 raft_consensus.cc:493] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.107065 30604 raft_consensus.cc:515] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.111521 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31b3a4c53674af5b3b00793bafc9f59" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:26.112279 30244 raft_consensus.cc:2468] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
I20260709 12:30:26.114356 30358 leader_election.cc:304] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.115437 30607 raft_consensus.cc:2804] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:26.115818 30607 raft_consensus.cc:493] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:26.116150 30607 raft_consensus.cc:3060] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.119205 30563 raft_consensus.cc:493] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.119840 30563 raft_consensus.cc:515] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.123051 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69dae2e99fd4ebdb4cba00cc63b48d9" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:26.123744 30317 raft_consensus.cc:2468] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:26.125175 30210 leader_election.cc:304] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.126147 30592 raft_consensus.cc:2804] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:26.126525 30592 raft_consensus.cc:493] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:26.126909 30592 raft_consensus.cc:3060] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.135452 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31b3a4c53674af5b3b00793bafc9f59" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:26.136408 30318 raft_consensus.cc:2468] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
I20260709 12:30:26.141909 30604 leader_election.cc:290] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:26.152741 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69dae2e99fd4ebdb4cba00cc63b48d9" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:26.152462 30563 leader_election.cc:290] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.153578 30393 raft_consensus.cc:2468] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:26.170746 30243 raft_consensus.cc:2468] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:26.172479 30284 leader_election.cc:304] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.173434 30608 raft_consensus.cc:2804] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:26.173972 30608 raft_consensus.cc:697] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:26.174961 30608 consensus_queue.cc:237] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.176045 30592 raft_consensus.cc:515] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.188638 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69dae2e99fd4ebdb4cba00cc63b48d9" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:26.189772 30318 raft_consensus.cc:3060] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.194185 30563 raft_consensus.cc:493] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.197089 30139 catalog_manager.cc:5697] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 0 to 1, leader changed from <none> to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 1 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.198439 30607 raft_consensus.cc:515] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
W20260709 12:30:26.198935 30190 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:26.197508 30563 raft_consensus.cc:515] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.203208 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
W20260709 12:30:26.204846 30210 leader_election.cc:343] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:26.205996 30563 leader_election.cc:290] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.208590 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
W20260709 12:30:26.210135 30209 leader_election.cc:343] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:26.211149 30209 leader_election.cc:304] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:26.212854 30563 raft_consensus.cc:2749] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:26.214178 30392 raft_consensus.cc:2468] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 1.
I20260709 12:30:26.218676 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69dae2e99fd4ebdb4cba00cc63b48d9" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.225445 30393 raft_consensus.cc:3060] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.233922 30393 raft_consensus.cc:2468] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:26.219305 30592 leader_election.cc:290] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.238718 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31b3a4c53674af5b3b00793bafc9f59" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:26.239612 30317 raft_consensus.cc:3060] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.247028 30607 leader_election.cc:290] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:26.248242 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31b3a4c53674af5b3b00793bafc9f59" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:26.248991 30243 raft_consensus.cc:3060] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.252692 30317 raft_consensus.cc:2468] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 1.
I20260709 12:30:26.254349 30359 leader_election.cc:304] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:26.093353 30561 raft_consensus.cc:515] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.258708 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:26.259451 30244 raft_consensus.cc:3060] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.269083 30244 raft_consensus.cc:2468] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 1.
I20260709 12:30:26.272472 30358 leader_election.cc:304] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.273487 30604 raft_consensus.cc:2804] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:26.281630 30592 raft_consensus.cc:493] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.282311 30592 raft_consensus.cc:515] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.289475 30209 leader_election.cc:304] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.290316 30563 raft_consensus.cc:2804] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:26.290987 30563 raft_consensus.cc:697] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:26.291822 30581 tablet_bootstrap.cc:492] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:26.293576 30581 ts_tablet_manager.cc:1403] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.228s	user 0.064s	sys 0.102s
I20260709 12:30:26.297412 30581 raft_consensus.cc:359] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.291826 30563 consensus_queue.cc:237] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.224632 30318 raft_consensus.cc:2468] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:26.302450 30581 raft_consensus.cc:385] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.302649 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:26.303615 30319 raft_consensus.cc:3060] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.304051 30607 raft_consensus.cc:2804] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:26.306277 30604 raft_consensus.cc:697] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:26.307291 30604 consensus_queue.cc:237] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.313644 30319 raft_consensus.cc:2468] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 1.
I20260709 12:30:26.314373 30581 raft_consensus.cc:740] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.317343 30581 consensus_queue.cc:260] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.320276 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a02241adea4299bc5c3b7a12452833" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
W20260709 12:30:26.321516 30210 leader_election.cc:343] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:26.320456 30581 ts_tablet_manager.cc:1434] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:30:26.323433 30561 leader_election.cc:290] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:26.324671 30581 tablet_bootstrap.cc:492] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:26.329823 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a02241adea4299bc5c3b7a12452833" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:26.337284 30581 tablet_bootstrap.cc:654] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.337636 30607 raft_consensus.cc:697] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:26.338626 30607 consensus_queue.cc:237] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.333369 30592 leader_election.cc:290] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.340835 30139 catalog_manager.cc:5697] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 0 to 1, leader changed from <none> to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.343518 30578 tablet_bootstrap.cc:492] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc: No bootstrap required, opened a new log
I20260709 12:30:26.344018 30578 ts_tablet_manager.cc:1403] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc: Time spent bootstrapping tablet: real 0.246s	user 0.091s	sys 0.103s
I20260709 12:30:26.346333 30577 tablet_bootstrap.cc:492] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:26.346953 30577 ts_tablet_manager.cc:1403] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.281s	user 0.103s	sys 0.111s
I20260709 12:30:26.346905 30578 raft_consensus.cc:359] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.347748 30578 raft_consensus.cc:385] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.348023 30578 raft_consensus.cc:740] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.348780 30578 consensus_queue.cc:260] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.349471 30581 tablet_bootstrap.cc:492] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:26.350350 30581 ts_tablet_manager.cc:1403] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 12:30:26.350841 30578 ts_tablet_manager.cc:1434] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:30:26.349833 30577 raft_consensus.cc:359] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.352324 30577 raft_consensus.cc:385] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.352612 30577 raft_consensus.cc:740] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.353391 30577 consensus_queue.cc:260] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.353608 30581 raft_consensus.cc:359] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.354370 30581 raft_consensus.cc:385] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.354475 30616 raft_consensus.cc:493] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.354753 30581 raft_consensus.cc:740] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.355080 30616 raft_consensus.cc:515] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.355654 30577 ts_tablet_manager.cc:1434] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:30:26.355615 30581 consensus_queue.cc:260] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.356743 30577 tablet_bootstrap.cc:492] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5: Bootstrap starting.
I20260709 12:30:26.357263 30616 leader_election.cc:290] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:26.358642 30581 ts_tablet_manager.cc:1434] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:30:26.359181 30242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec1f4dd8c304f46ba184c7f53010ba0" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:26.363790 30577 tablet_bootstrap.cc:654] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.364537 30243 raft_consensus.cc:2468] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 1.
I20260709 12:30:26.366369 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec1f4dd8c304f46ba184c7f53010ba0" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:26.368148 30317 raft_consensus.cc:2393] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 811ff3960ee34275a8343e9a0ed11ae5 in current term 1: Already voted for candidate d79a00eaf95a47d4b3116e6bb0956efc in this term.
I20260709 12:30:26.366954 30581 tablet_bootstrap.cc:492] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a: Bootstrap starting.
I20260709 12:30:26.369383 30359 leader_election.cc:304] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5; no voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:26.370572 30604 raft_consensus.cc:3060] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.367246 30393 raft_consensus.cc:2468] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:26.373160 30209 leader_election.cc:304] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:26.374027 30592 raft_consensus.cc:2804] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:26.374452 30592 raft_consensus.cc:493] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:26.374835 30592 raft_consensus.cc:3060] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.375926 30577 tablet_bootstrap.cc:492] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5: No bootstrap required, opened a new log
I20260709 12:30:26.376499 30577 ts_tablet_manager.cc:1403] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 12:30:26.378141 30581 tablet_bootstrap.cc:654] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.379366 30563 raft_consensus.cc:493] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.379624 30577 raft_consensus.cc:359] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.379958 30563 raft_consensus.cc:515] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.380378 30577 raft_consensus.cc:385] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.380734 30577 raft_consensus.cc:740] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.381738 30577 consensus_queue.cc:260] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.382151 30563 leader_election.cc:290] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.383301 30592 raft_consensus.cc:515] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.383919 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d4af1baf6d44de9eb54a824b23920e" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:26.384646 30317 raft_consensus.cc:2468] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:26.384183 30577 ts_tablet_manager.cc:1434] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:30:26.384930 30604 raft_consensus.cc:2749] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:26.385984 30210 leader_election.cc:304] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.386519 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a02241adea4299bc5c3b7a12452833" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:26.386730 30592 leader_election.cc:290] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.386932 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a02241adea4299bc5c3b7a12452833" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.387169 30318 raft_consensus.cc:3060] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.387270 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d4af1baf6d44de9eb54a824b23920e" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5" is_pre_election: true
I20260709 12:30:26.387612 30391 raft_consensus.cc:3060] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.386809 30563 raft_consensus.cc:2804] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:26.388163 30563 raft_consensus.cc:493] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:26.388509 30563 raft_consensus.cc:3060] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.389649 30393 raft_consensus.cc:2468] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 0.
I20260709 12:30:26.393311 30391 raft_consensus.cc:2468] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:26.394565 30209 leader_election.cc:304] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.394650 30318 raft_consensus.cc:2468] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:26.395471 30593 raft_consensus.cc:2804] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:26.395933 30593 raft_consensus.cc:697] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:26.397373 30563 raft_consensus.cc:515] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.398910 30593 consensus_queue.cc:237] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.399722 30563 leader_election.cc:290] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.400439 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d4af1baf6d44de9eb54a824b23920e" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:26.401094 30318 raft_consensus.cc:3060] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.401710 30581 tablet_bootstrap.cc:492] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a: No bootstrap required, opened a new log
I20260709 12:30:26.402240 30581 ts_tablet_manager.cc:1403] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:30:26.403211 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d4af1baf6d44de9eb54a824b23920e" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.403831 30391 raft_consensus.cc:3060] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.405268 30581 raft_consensus.cc:359] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.405997 30581 raft_consensus.cc:385] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.406255 30581 raft_consensus.cc:740] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.409073 30318 raft_consensus.cc:2468] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:26.412010 30142 catalog_manager.cc:5697] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 0 to 1, leader changed from <none> to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.414157 30391 raft_consensus.cc:2468] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 1.
I20260709 12:30:26.407083 30581 consensus_queue.cc:260] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.415298 30210 leader_election.cc:304] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.416694 30593 raft_consensus.cc:2804] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:26.417181 30593 raft_consensus.cc:697] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:26.416541 30139 catalog_manager.cc:5697] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:26.417301 30581 ts_tablet_manager.cc:1434] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:30:26.418025 30593 consensus_queue.cc:237] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.418322 30139 catalog_manager.cc:5697] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:26.428192 30140 catalog_manager.cc:5697] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 0 to 1, leader changed from <none> to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 1 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.455714 30593 consensus_queue.cc:1048] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.470392 30593 consensus_queue.cc:1048] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.474061 30607 raft_consensus.cc:493] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:26.474671 30607 raft_consensus.cc:515] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.478615 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a" is_pre_election: true
I20260709 12:30:26.479264 30319 raft_consensus.cc:2468] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
I20260709 12:30:26.479573 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" is_pre_election: true
I20260709 12:30:26.479168 30607 leader_election.cc:290] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:26.480254 30243 raft_consensus.cc:2468] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 0.
I20260709 12:30:26.480795 30359 leader_election.cc:304] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:26.481592 30607 raft_consensus.cc:2804] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:26.481945 30607 raft_consensus.cc:493] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:26.482264 30607 raft_consensus.cc:3060] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.489017 30607 raft_consensus.cc:515] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.490903 30607 leader_election.cc:290] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:26.491415 30243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:26.491807 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:26.491916 30243 raft_consensus.cc:3060] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.492327 30319 raft_consensus.cc:3060] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.496505 30243 raft_consensus.cc:2468] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 1.
I20260709 12:30:26.497282 30319 raft_consensus.cc:2468] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 1.
I20260709 12:30:26.497486 30358 leader_election.cc:304] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.498370 30607 raft_consensus.cc:2804] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:26.498900 30607 raft_consensus.cc:697] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:26.499647 30607 consensus_queue.cc:237] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.506515 30140 catalog_manager.cc:5697] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 1 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:26.532320 30593 consensus_queue.cc:1048] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.542157 30593 consensus_queue.cc:1048] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.670130 30391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
mode: GRACEFUL
new_leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:60590
I20260709 12:30:26.670679 30391 raft_consensus.cc:606] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Received request to transfer leadership to TS d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:26.674942 30319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f008a41416394983b5a8d83b47081598"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
mode: GRACEFUL
new_leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:60206
I20260709 12:30:26.675423 30319 raft_consensus.cc:606] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Received request to transfer leadership to TS d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:26.679600 30243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
mode: GRACEFUL
new_leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:30:26.679997 30243 raft_consensus.cc:606] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Received request to transfer leadership to TS 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:26.684268 30391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a31b3a4c53674af5b3b00793bafc9f59"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
mode: GRACEFUL
new_leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60590
I20260709 12:30:26.684760 30391 raft_consensus.cc:606] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Received request to transfer leadership to TS 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:26.688055 30602 consensus_queue.cc:1048] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.689383 30391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
mode: GRACEFUL
new_leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60590
I20260709 12:30:26.690018 30391 raft_consensus.cc:606] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Received request to transfer leadership to TS 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:26.692353 30602 consensus_queue.cc:1048] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.695931 30244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90a02241adea4299bc5c3b7a12452833"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
mode: GRACEFUL
new_leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:30:26.696575 30244 raft_consensus.cc:606] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Received request to transfer leadership to TS 502bbfe1b6b44eda9b4569507a55d46a
I20260709 12:30:26.703177 30244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10d4af1baf6d44de9eb54a824b23920e"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
mode: GRACEFUL
new_leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:30:26.703970 30244 raft_consensus.cc:606] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Received request to transfer leadership to TS 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:26.706853 30608 raft_consensus.cc:993] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a: : Instructing follower d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:26.710781 30602 raft_consensus.cc:1081] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Signalling peer d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:26.713543 30244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f008a41416394983b5a8d83b47081598"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:30:26.714130 30244 raft_consensus.cc:493] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:26.714623 30244 raft_consensus.cc:3060] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.721000 30244 raft_consensus.cc:515] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.724869 30319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f008a41416394983b5a8d83b47081598" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:26.725349 30319 raft_consensus.cc:3055] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:26.725597 30319 raft_consensus.cc:740] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:26.726270 30319 consensus_queue.cc:260] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.727291 30319 raft_consensus.cc:3060] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.730937 30243 raft_consensus.cc:1240] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Rejecting Update request from peer 502bbfe1b6b44eda9b4569507a55d46a for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:26.734437 30244 leader_election.cc:290] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.734364 30319 raft_consensus.cc:2468] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:26.735970 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f008a41416394983b5a8d83b47081598" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.737032 30391 raft_consensus.cc:3060] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.737107 30210 leader_election.cc:304] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.738170 30593 raft_consensus.cc:2804] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:26.738677 30593 raft_consensus.cc:697] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:26.739449 30593 consensus_queue.cc:237] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.746333 30391 raft_consensus.cc:2468] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:26.748632 30140 catalog_manager.cc:5697] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 1 to 2, leader changed from 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66) to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.759897 30607 consensus_queue.cc:1048] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.770890 30616 raft_consensus.cc:993] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: : Instructing follower 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:26.771330 30616 raft_consensus.cc:1081] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Signalling peer 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:26.775444 30561 consensus_queue.cc:1048] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.777279 30593 consensus_queue.cc:1048] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.777933 30317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a31b3a4c53674af5b3b00793bafc9f59"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60186
I20260709 12:30:26.778930 30317 raft_consensus.cc:493] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:26.779295 30317 raft_consensus.cc:3060] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.787057 30317 raft_consensus.cc:515] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.789633 30242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31b3a4c53674af5b3b00793bafc9f59" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:26.790460 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31b3a4c53674af5b3b00793bafc9f59" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.791112 30391 raft_consensus.cc:3055] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:26.791409 30391 raft_consensus.cc:740] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:26.792172 30391 consensus_queue.cc:260] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.793051 30391 raft_consensus.cc:3060] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.803350 30593 consensus_queue.cc:1048] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.818397 30317 leader_election.cc:290] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.821187 30391 raft_consensus.cc:2468] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:26.822574 30284 leader_election.cc:304] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: d79a00eaf95a47d4b3116e6bb0956efc
I20260709 12:30:26.823710 30608 raft_consensus.cc:2804] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:26.824203 30608 raft_consensus.cc:697] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:26.825001 30608 consensus_queue.cc:237] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.838364 30561 consensus_queue.cc:1048] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:26.838205 30140 catalog_manager.cc:5697] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 1 to 2, leader changed from 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67) to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.848974 30607 consensus_queue.cc:1048] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.857030 30561 raft_consensus.cc:993] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: : Instructing follower d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:26.857525 30607 raft_consensus.cc:1081] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Signalling peer d79a00eaf95a47d4b3116e6bb0956efc to start an election
I20260709 12:30:26.859180 30244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
 from {username='slave'} at 127.0.0.1:54622
I20260709 12:30:26.859743 30244 raft_consensus.cc:493] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:26.860846 30244 raft_consensus.cc:3060] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.866273 30244 raft_consensus.cc:515] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.868096 30244 leader_election.cc:290] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Requested vote from peers 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.869133 30317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:26.869248 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fcd78b4ab24fc7b7a28aa5cac92afd" candidate_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.869944 30393 raft_consensus.cc:3055] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:26.869798 30317 raft_consensus.cc:3060] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.870334 30393 raft_consensus.cc:740] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:26.871299 30393 consensus_queue.cc:260] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.872588 30393 raft_consensus.cc:3060] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.877239 30317 raft_consensus.cc:2468] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:26.878401 30210 leader_election.cc:304] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:26.878399 30393 raft_consensus.cc:2468] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79a00eaf95a47d4b3116e6bb0956efc in term 2.
I20260709 12:30:26.879249 30593 raft_consensus.cc:2804] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:26.879727 30593 raft_consensus.cc:697] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Becoming Leader. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:26.880414 30593 consensus_queue.cc:237] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.886343 30139 catalog_manager.cc:5697] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc reported cstate change: term changed from 1 to 2, leader changed from 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67) to d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65). New cstate: current_term: 2 leader_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.890564 30607 consensus_queue.cc:1048] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.892976 30593 consensus_queue.cc:1048] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.903272 30593 raft_consensus.cc:993] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc: : Instructing follower 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:26.903927 30593 raft_consensus.cc:1081] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Signalling peer 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:26.907097 30561 consensus_queue.cc:1048] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:26.909205 30316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90a02241adea4299bc5c3b7a12452833"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60192
I20260709 12:30:26.909945 30316 raft_consensus.cc:493] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:26.910315 30316 raft_consensus.cc:3060] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.913916 30591 consensus_queue.cc:1048] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.916500 30592 consensus_queue.cc:1048] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.920270 30316 raft_consensus.cc:515] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.923285 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a02241adea4299bc5c3b7a12452833" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:26.923918 30244 raft_consensus.cc:3055] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:26.924345 30244 raft_consensus.cc:740] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:26.925233 30244 consensus_queue.cc:260] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.926162 30244 raft_consensus.cc:3060] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.929417 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a02241adea4299bc5c3b7a12452833" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.931362 30316 leader_election.cc:290] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.942093 30561 raft_consensus.cc:993] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5: : Instructing follower 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:26.942744 30561 raft_consensus.cc:1081] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Signalling peer 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:26.944953 30318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60186
I20260709 12:30:26.945652 30318 raft_consensus.cc:493] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:26.947130 30318 raft_consensus.cc:3060] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.952354 30244 raft_consensus.cc:2468] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:26.953516 30284 leader_election.cc:304] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:26.954560 30608 raft_consensus.cc:2804] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:26.955057 30608 raft_consensus.cc:697] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:26.955767 30318 raft_consensus.cc:515] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.955840 30608 consensus_queue.cc:237] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.962049 30318 leader_election.cc:290] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:26.963177 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:26.963924 30244 raft_consensus.cc:3060] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.963174 30391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f760603a1a0e4ab2a7c8d8e4cadec9a6" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:26.967068 30391 raft_consensus.cc:3055] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:26.967367 30391 raft_consensus.cc:740] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:26.968133 30391 consensus_queue.cc:260] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.968694 30592 consensus_queue.cc:1048] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:26.969389 30391 raft_consensus.cc:3060] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.975904 30391 raft_consensus.cc:2468] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:26.977067 30284 leader_election.cc:304] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:26.977012 30139 catalog_manager.cc:5697] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 1 to 2, leader changed from d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65) to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:26.978199 30608 raft_consensus.cc:2804] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:26.978868 30608 raft_consensus.cc:697] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:26.979748 30608 consensus_queue.cc:237] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.979773 30244 raft_consensus.cc:2468] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:26.985296 30592 raft_consensus.cc:993] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc: : Instructing follower 811ff3960ee34275a8343e9a0ed11ae5 to start an election
I20260709 12:30:26.985740 30592 raft_consensus.cc:1081] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Signalling peer 811ff3960ee34275a8343e9a0ed11ae5 to start an election
I20260709 12:30:26.987454 30393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10d4af1baf6d44de9eb54a824b23920e"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
 from {username='slave'} at 127.0.0.1:60572
I20260709 12:30:26.988016 30393 raft_consensus.cc:493] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:26.988368 30393 raft_consensus.cc:3060] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:26.994585 30393 raft_consensus.cc:515] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:26.994266 30142 catalog_manager.cc:5697] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 1 to 2, leader changed from 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67) to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.000114 30318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d4af1baf6d44de9eb54a824b23920e" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:27.000231 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d4af1baf6d44de9eb54a824b23920e" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:27.000783 30318 raft_consensus.cc:3060] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:27.000924 30244 raft_consensus.cc:3055] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:27.001396 30244 raft_consensus.cc:740] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:27.002215 30244 consensus_queue.cc:260] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:27.003556 30244 raft_consensus.cc:3060] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:27.003789 30393 leader_election.cc:290] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:27.008519 30318 raft_consensus.cc:2468] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 2.
I20260709 12:30:27.009584 30359 leader_election.cc:304] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:27.010272 30561 raft_consensus.cc:2804] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:27.010773 30561 raft_consensus.cc:697] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:27.011552 30561 consensus_queue.cc:237] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:27.012331 30244 raft_consensus.cc:2468] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 2.
I20260709 12:30:27.018975 30593 raft_consensus.cc:993] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc: : Instructing follower 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:27.019405 30592 raft_consensus.cc:1081] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Signalling peer 502bbfe1b6b44eda9b4569507a55d46a to start an election
I20260709 12:30:27.019148 30142 catalog_manager.cc:5697] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 1 to 2, leader changed from d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65) to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 2 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:27.021127 30318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
 from {username='slave'} at 127.0.0.1:60192
I20260709 12:30:27.021593 30318 raft_consensus.cc:493] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:27.021874 30318 raft_consensus.cc:3060] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:27.027361 30318 raft_consensus.cc:515] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:27.028810 30318 leader_election.cc:290] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687)
I20260709 12:30:27.029778 30393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
I20260709 12:30:27.030299 30393 raft_consensus.cc:3060] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:27.030732 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bec8c26e2042dc9297cfa76fee3a80" candidate_uuid: "502bbfe1b6b44eda9b4569507a55d46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:27.031288 30244 raft_consensus.cc:3055] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:27.031586 30244 raft_consensus.cc:740] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:27.032300 30244 consensus_queue.cc:260] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:27.033425 30244 raft_consensus.cc:3060] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:27.037330 30393 raft_consensus.cc:2468] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:27.038502 30284 leader_election.cc:304] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502bbfe1b6b44eda9b4569507a55d46a, 811ff3960ee34275a8343e9a0ed11ae5; no voters: 
I20260709 12:30:27.039295 30608 raft_consensus.cc:2804] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:27.039705 30608 raft_consensus.cc:697] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Leader. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:27.039882 30244 raft_consensus.cc:2468] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 502bbfe1b6b44eda9b4569507a55d46a in term 2.
I20260709 12:30:27.040500 30608 consensus_queue.cc:237] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:27.046993 30142 catalog_manager.cc:5697] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a reported cstate change: term changed from 1 to 2, leader changed from d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65) to 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66). New cstate: current_term: 2 leader_uuid: "502bbfe1b6b44eda9b4569507a55d46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.202335 30318 raft_consensus.cc:1275] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.203716 30593 consensus_queue.cc:1048] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.212642 30391 raft_consensus.cc:1275] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.217061 30593 consensus_queue.cc:1048] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.229341 30244 raft_consensus.cc:3060] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:27.234367 30244 raft_consensus.cc:1275] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.235517 30602 consensus_queue.cc:1048] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.244294 30391 raft_consensus.cc:1275] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.247457 30649 consensus_queue.cc:1048] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.351652 30318 raft_consensus.cc:1275] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.352980 30593 consensus_queue.cc:1048] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.360795 30391 raft_consensus.cc:1275] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer d79a00eaf95a47d4b3116e6bb0956efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.362948 30593 consensus_queue.cc:1048] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.403398 30318 raft_consensus.cc:1275] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Refusing update from remote peer 811ff3960ee34275a8343e9a0ed11ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.404579 30561 consensus_queue.cc:1048] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.411643 30244 raft_consensus.cc:1275] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 811ff3960ee34275a8343e9a0ed11ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.413611 30607 consensus_queue.cc:1048] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.426554 30391 raft_consensus.cc:3060] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:27.432412 30391 raft_consensus.cc:1275] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.433388 30649 consensus_queue.cc:1048] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.441694 30244 raft_consensus.cc:1275] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.443084 30649 consensus_queue.cc:1048] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.480232 30391 raft_consensus.cc:1275] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.481321 30649 consensus_queue.cc:1048] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.485857 30244 raft_consensus.cc:1275] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.488229 30608 consensus_queue.cc:1048] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.507449 30391 raft_consensus.cc:1275] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.508443 30608 consensus_queue.cc:1048] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:27.515632 30244 raft_consensus.cc:1275] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Refusing update from remote peer 502bbfe1b6b44eda9b4569507a55d46a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:27.517592 30649 consensus_queue.cc:1048] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:29.707101 30140 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51260:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:30:29.725592 30140 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51260:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:30:29.758929 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:30:29.857412 30679 log.cc:927] Time spent T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:30:29.923395 30678 log.cc:927] Time spent T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:30:29.953063 30674 log.cc:927] Time spent T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5: Append to log took a long time: real 0.109s	user 0.006s	sys 0.000s
W20260709 12:30:29.959137 30682 log.cc:927] Time spent T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: Append to log took a long time: real 0.113s	user 0.000s	sys 0.003s
W20260709 12:30:29.959988 30680 log.cc:927] Time spent T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc: Append to log took a long time: real 0.115s	user 0.002s	sys 0.003s
I20260709 12:30:29.960665 30241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810"
dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
mode: GRACEFUL
new_leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
 from {username='slave'} at 127.0.0.1:43844
I20260709 12:30:29.961380 30241 raft_consensus.cc:606] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Received request to transfer leadership to TS 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:29.965992 30707 tablet.cc:1724] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:29.976652 30705 tablet.cc:1724] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:29.993871 30686 log.cc:927] Time spent T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:30:30.028173 30714 tablet.cc:1724] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.062922 30723 tablet.cc:1724] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.072144 30715 tablet.cc:1724] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:30.055557 30284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.109.65:45627, user_credentials={real_user=slave}} blocked reactor thread for 84059.7us
I20260709 12:30:30.083285 30717 tablet.cc:1724] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.083487 30721 tablet.cc:1724] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.109429 30728 tablet.cc:1724] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.114902 30722 tablet.cc:1724] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.086472 30716 tablet.cc:1724] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.133103 30715 tablet.cc:1724] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.114333 30707 tablet.cc:1724] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.148752 30717 tablet.cc:1724] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.163192 30725 tablet.cc:1724] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.173884 30705 tablet.cc:1724] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.176199 30692 raft_consensus.cc:993] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc: : Instructing follower 811ff3960ee34275a8343e9a0ed11ae5 to start an election
I20260709 12:30:30.176193 30140 catalog_manager.cc:5789] TS 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67:38687) does not have the latest schema for tablet 10d4af1baf6d44de9eb54a824b23920e (table soft_deleted_table [id=687b6941493f4d07b71675994d24651c]). Expected version 1 got 0
I20260709 12:30:30.176774 30692 raft_consensus.cc:1081] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Signalling peer 811ff3960ee34275a8343e9a0ed11ae5 to start an election
I20260709 12:30:30.179066 30389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
 from {username='slave'} at 127.0.0.1:60572
I20260709 12:30:30.179247 30721 tablet.cc:1724] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.189041 30726 tablet.cc:1724] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.173772 30722 tablet.cc:1724] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.194542 30389 raft_consensus.cc:493] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:30.200039 30389 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:30.196749 30140 catalog_manager.cc:5789] TS 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059) does not have the latest schema for tablet f760603a1a0e4ab2a7c8d8e4cadec9a6 (table soft_deleted_table [id=687b6941493f4d07b71675994d24651c]). Expected version 1 got 0
I20260709 12:30:30.204913 30140 catalog_manager.cc:5789] TS 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059) does not have the latest schema for tablet b6bec8c26e2042dc9297cfa76fee3a80 (table soft_deleted_table [id=687b6941493f4d07b71675994d24651c]). Expected version 1 got 0
I20260709 12:30:30.211223 30714 tablet.cc:1724] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.162262 30716 tablet.cc:1724] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.213759 30723 tablet.cc:1724] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.218809 30726 tablet.cc:1724] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.229977 30726 tablet.cc:1724] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.239979 30316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87548997099485f80226ece2937951f"
dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
mode: GRACEFUL
new_leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
 from {username='slave'} at 127.0.0.1:55350
I20260709 12:30:30.240691 30316 raft_consensus.cc:606] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Received request to transfer leadership to TS 811ff3960ee34275a8343e9a0ed11ae5
I20260709 12:30:30.242147 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:30:30.242801 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:30.236850 30389 raft_consensus.cc:515] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:30.247633 30725 tablet.cc:1724] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.249387 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:30.249977 30244 raft_consensus.cc:3055] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:30.250294 30244 raft_consensus.cc:740] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d79a00eaf95a47d4b3116e6bb0956efc, State: Running, Role: LEADER
I20260709 12:30:30.249843 30723 tablet.cc:1724] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.251061 30244 consensus_queue.cc:260] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:30.252066 30244 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:30.265996 30244 raft_consensus.cc:2468] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 3.
I20260709 12:30:30.267489 30358 leader_election.cc:304] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:30.268568 30654 raft_consensus.cc:2804] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:30.269039 30654 raft_consensus.cc:697] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:30.269843 30654 consensus_queue.cc:237] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:30.269655 30715 tablet.cc:1724] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.274915 30389 leader_election.cc:290] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 3 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:30.275552 30316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21363ae62c4c48b299c33fc5b2b9c810" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:30.282823 30316 raft_consensus.cc:3060] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:30.272964 30728 tablet.cc:1724] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:30.303190 30139 catalog_manager.cc:5697] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 2 to 3, leader changed from d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65) to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 3 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:30.310431 30316 raft_consensus.cc:2468] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 3.
I20260709 12:30:30.317269 30140 catalog_manager.cc:6242] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f: soft_deleted_table [id=687b6941493f4d07b71675994d24651c] alter complete (version 1)
I20260709 12:30:30.362300 30718 raft_consensus.cc:993] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a: : Instructing follower 811ff3960ee34275a8343e9a0ed11ae5 to start an election
I20260709 12:30:30.362914 30695 raft_consensus.cc:1081] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Signalling peer 811ff3960ee34275a8343e9a0ed11ae5 to start an election
I20260709 12:30:30.364370 30389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87548997099485f80226ece2937951f"
dest_uuid: "811ff3960ee34275a8343e9a0ed11ae5"
 from {username='slave'} at 127.0.0.1:60580
I20260709 12:30:30.364934 30389 raft_consensus.cc:493] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:30.365217 30389 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:30.370905 30389 raft_consensus.cc:515] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:30.372434 30389 leader_election.cc:290] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 3 election: Requested vote from peers d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627), 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059)
I20260709 12:30:30.373164 30244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87548997099485f80226ece2937951f" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d79a00eaf95a47d4b3116e6bb0956efc"
I20260709 12:30:30.373518 30316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87548997099485f80226ece2937951f" candidate_uuid: "811ff3960ee34275a8343e9a0ed11ae5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "502bbfe1b6b44eda9b4569507a55d46a"
I20260709 12:30:30.373803 30244 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:30.374121 30316 raft_consensus.cc:3055] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:30.374444 30316 raft_consensus.cc:740] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 502bbfe1b6b44eda9b4569507a55d46a, State: Running, Role: LEADER
I20260709 12:30:30.375291 30316 consensus_queue.cc:260] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:30.376574 30316 raft_consensus.cc:3060] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:30.380096 30244 raft_consensus.cc:2468] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 3.
I20260709 12:30:30.381210 30358 leader_election.cc:304] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811ff3960ee34275a8343e9a0ed11ae5, d79a00eaf95a47d4b3116e6bb0956efc; no voters: 
I20260709 12:30:30.381851 30654 raft_consensus.cc:2804] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:30.382229 30654 raft_consensus.cc:697] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 LEADER]: Becoming Leader. State: Replica: 811ff3960ee34275a8343e9a0ed11ae5, State: Running, Role: LEADER
I20260709 12:30:30.382992 30654 consensus_queue.cc:237] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } }
I20260709 12:30:30.383337 30316 raft_consensus.cc:2468] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811ff3960ee34275a8343e9a0ed11ae5 in term 3.
I20260709 12:30:30.389743 30139 catalog_manager.cc:5697] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 reported cstate change: term changed from 2 to 3, leader changed from 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66) to 811ff3960ee34275a8343e9a0ed11ae5 (127.20.109.67). New cstate: current_term: 3 leader_uuid: "811ff3960ee34275a8343e9a0ed11ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811ff3960ee34275a8343e9a0ed11ae5" member_type: VOTER last_known_addr { host: "127.20.109.67" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:30.690635 30244 raft_consensus.cc:1275] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Refusing update from remote peer 811ff3960ee34275a8343e9a0ed11ae5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:30.691685 30654 consensus_queue.cc:1048] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:30.700757 30316 raft_consensus.cc:1275] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Refusing update from remote peer 811ff3960ee34275a8343e9a0ed11ae5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:30.702723 30739 consensus_queue.cc:1048] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:30.850507 30244 raft_consensus.cc:1275] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Refusing update from remote peer 811ff3960ee34275a8343e9a0ed11ae5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:30.852161 30739 consensus_queue.cc:1048] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79a00eaf95a47d4b3116e6bb0956efc" member_type: VOTER last_known_addr { host: "127.20.109.65" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:30.865831 30316 raft_consensus.cc:1275] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Refusing update from remote peer 811ff3960ee34275a8343e9a0ed11ae5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:30.867949 30739 consensus_queue.cc:1048] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "502bbfe1b6b44eda9b4569507a55d46a" member_type: VOTER last_known_addr { host: "127.20.109.66" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:31.244035 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:31.250767 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:31.251196 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:32.252226 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:32.257616 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:32.258134 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:33.259526 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:33.265520 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:33.265897 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:34.266917 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:34.274183 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:34.274648 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:35.888492 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:35.893384 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:35.893776 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:30:36.632728 30414 debug-util.cc:398] Leaking SignalData structure 0x7b080029d240 after lost signal to thread 20920
W20260709 12:30:36.633770 30414 debug-util.cc:398] Leaking SignalData structure 0x7b080018f580 after lost signal to thread 30176
W20260709 12:30:36.634797 30414 debug-util.cc:398] Leaking SignalData structure 0x7b0800149c40 after lost signal to thread 30268
W20260709 12:30:36.635716 30414 debug-util.cc:398] Leaking SignalData structure 0x7b0800243b00 after lost signal to thread 30343
W20260709 12:30:36.636607 30414 debug-util.cc:398] Leaking SignalData structure 0x7b080024e000 after lost signal to thread 30417
I20260709 12:30:36.894855 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:36.900887 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:36.901352 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:37.902369 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:37.909761 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:37.910286 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:38.911502 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:38.918872 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:38.919485 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:39.920578 20917 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:39.927237 20917 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:39.927690 20917 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:41.002812 20917 tablet_server.cc:179] TabletServer@127.20.109.65:0 shutting down...
W20260709 12:30:41.019150 30284 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 12:30:41.030236 30284 consensus_peers.cc:597] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a -> Peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Couldn't send request to peer d79a00eaf95a47d4b3116e6bb0956efc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:41.031720 30284 consensus_peers.cc:597] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a -> Peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Couldn't send request to peer d79a00eaf95a47d4b3116e6bb0956efc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:41.032323 30284 consensus_peers.cc:597] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a -> Peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Couldn't send request to peer d79a00eaf95a47d4b3116e6bb0956efc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:41.040537 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:41.041414 20917 tablet_replica.cc:333] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.042613 20917 raft_consensus.cc:2243] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.043537 20917 raft_consensus.cc:2272] T 10d4af1baf6d44de9eb54a824b23920e P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.047029 20917 tablet_replica.cc:333] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.047744 20917 raft_consensus.cc:2243] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.049150 20917 raft_consensus.cc:2272] T f008a41416394983b5a8d83b47081598 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.052325 20917 tablet_replica.cc:333] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.053107 20917 raft_consensus.cc:2243] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.055492 20917 raft_consensus.cc:2272] T 2ec1f4dd8c304f46ba184c7f53010ba0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.060010 20917 tablet_replica.cc:333] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.060693 20917 raft_consensus.cc:2243] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.061358 20917 raft_consensus.cc:2272] T 4bb4db1d0c394e57bb66954b2104e730 P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.064246 20917 tablet_replica.cc:333] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.064971 20917 raft_consensus.cc:2243] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.065645 20917 raft_consensus.cc:2272] T a31b3a4c53674af5b3b00793bafc9f59 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.068259 20917 tablet_replica.cc:333] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.068858 20917 raft_consensus.cc:2243] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.070016 20917 raft_consensus.cc:2272] T ef3aaadaad0b4777ad44e4fe3399cebd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.072824 20917 tablet_replica.cc:333] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.073479 20917 raft_consensus.cc:2243] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.074055 20917 raft_consensus.cc:2272] T a6df216c755843fbb47dd91756df4ae5 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.077625 20917 tablet_replica.cc:333] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.078377 20917 raft_consensus.cc:2243] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.080137 20917 raft_consensus.cc:2272] T 200d711c63b54d5ba14bcd5d09642d60 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:41.080681 30358 consensus_peers.cc:597] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 -> Peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Couldn't send request to peer d79a00eaf95a47d4b3116e6bb0956efc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:41.082840 20917 tablet_replica.cc:333] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.083534 20917 raft_consensus.cc:2243] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.084088 20917 raft_consensus.cc:2272] T 21363ae62c4c48b299c33fc5b2b9c810 P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.086720 20917 tablet_replica.cc:333] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.087343 20917 raft_consensus.cc:2243] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.087952 20917 raft_consensus.cc:2272] T 2462c1993c4249b5aa38ccf9d9c247fc P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.090667 20917 tablet_replica.cc:333] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.091213 20917 raft_consensus.cc:2243] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.091828 20917 raft_consensus.cc:2272] T 90a02241adea4299bc5c3b7a12452833 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.094174 20917 tablet_replica.cc:333] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.095054 20917 raft_consensus.cc:2243] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.096534 20917 raft_consensus.cc:2272] T bd04beb8b3814ca0bac81760e3fabcc0 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.099651 20917 tablet_replica.cc:333] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.100186 20917 raft_consensus.cc:2243] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.100746 20917 raft_consensus.cc:2272] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.103037 20917 tablet_replica.cc:333] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.103538 20917 raft_consensus.cc:2243] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.104451 20917 raft_consensus.cc:2272] T 67fcd78b4ab24fc7b7a28aa5cac92afd P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.106864 20917 tablet_replica.cc:333] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.107458 20917 raft_consensus.cc:2243] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.107975 20917 raft_consensus.cc:2272] T b6bec8c26e2042dc9297cfa76fee3a80 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.110284 20917 tablet_replica.cc:333] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.110781 20917 raft_consensus.cc:2243] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.111271 20917 raft_consensus.cc:2272] T d87548997099485f80226ece2937951f P d79a00eaf95a47d4b3116e6bb0956efc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.113575 20917 tablet_replica.cc:333] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.114040 20917 raft_consensus.cc:2243] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.115254 20917 raft_consensus.cc:2272] T b69dae2e99fd4ebdb4cba00cc63b48d9 P d79a00eaf95a47d4b3116e6bb0956efc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.118775 20917 tablet_replica.cc:333] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc: stopping tablet replica
I20260709 12:30:41.119622 20917 raft_consensus.cc:2243] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.120457 20917 raft_consensus.cc:2272] T ae79d8ed87d640aa846b221492024674 P d79a00eaf95a47d4b3116e6bb0956efc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:41.137971 30358 consensus_peers.cc:597] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 -> Peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Couldn't send request to peer d79a00eaf95a47d4b3116e6bb0956efc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:41.171905 20917 tablet_server.cc:196] TabletServer@127.20.109.65:0 shutdown complete.
I20260709 12:30:41.218699 20917 tablet_server.cc:179] TabletServer@127.20.109.66:0 shutting down...
W20260709 12:30:41.234511 30284 consensus_peers.cc:597] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a -> Peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Couldn't send request to peer d79a00eaf95a47d4b3116e6bb0956efc. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:45627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:41.247345 30359 consensus_peers.cc:597] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 -> Peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Couldn't send request to peer 502bbfe1b6b44eda9b4569507a55d46a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:41.251097 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:41.252040 20917 tablet_replica.cc:333] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.253198 20917 raft_consensus.cc:2243] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.254009 20917 raft_consensus.cc:2272] T 10d4af1baf6d44de9eb54a824b23920e P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:41.254899 30358 consensus_peers.cc:597] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 -> Peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Couldn't send request to peer d79a00eaf95a47d4b3116e6bb0956efc. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:45627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:41.256698 20917 tablet_replica.cc:333] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.257344 20917 raft_consensus.cc:2243] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.258266 20917 raft_consensus.cc:2272] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.260509 20917 tablet_replica.cc:333] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.261133 20917 raft_consensus.cc:2243] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.261690 20917 raft_consensus.cc:2272] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.263967 20917 tablet_replica.cc:333] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.264533 20917 raft_consensus.cc:2243] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.265070 20917 raft_consensus.cc:2272] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.267277 20917 tablet_replica.cc:333] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.267910 20917 raft_consensus.cc:2243] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.269078 20917 raft_consensus.cc:2272] T ae79d8ed87d640aa846b221492024674 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.271577 20917 tablet_replica.cc:333] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.272142 20917 raft_consensus.cc:2243] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.272622 20917 raft_consensus.cc:2272] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.274876 20917 tablet_replica.cc:333] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.275455 20917 raft_consensus.cc:2243] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.275965 20917 raft_consensus.cc:2272] T f008a41416394983b5a8d83b47081598 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.278148 20917 tablet_replica.cc:333] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.278713 20917 raft_consensus.cc:2243] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.279201 20917 raft_consensus.cc:2272] T 21363ae62c4c48b299c33fc5b2b9c810 P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.281301 20917 tablet_replica.cc:333] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.281818 20917 raft_consensus.cc:2243] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.282801 20917 raft_consensus.cc:2272] T 2462c1993c4249b5aa38ccf9d9c247fc P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.284984 20917 tablet_replica.cc:333] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.285507 20917 raft_consensus.cc:2243] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.285970 20917 raft_consensus.cc:2272] T 200d711c63b54d5ba14bcd5d09642d60 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.288518 20917 tablet_replica.cc:333] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.289064 20917 raft_consensus.cc:2243] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.289912 20917 raft_consensus.cc:2272] T a6df216c755843fbb47dd91756df4ae5 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.292052 20917 tablet_replica.cc:333] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.292560 20917 raft_consensus.cc:2243] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.293452 20917 raft_consensus.cc:2272] T 90a02241adea4299bc5c3b7a12452833 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.295693 20917 tablet_replica.cc:333] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.296236 20917 raft_consensus.cc:2243] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.296710 20917 raft_consensus.cc:2272] T bd04beb8b3814ca0bac81760e3fabcc0 P 502bbfe1b6b44eda9b4569507a55d46a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.298880 20917 tablet_replica.cc:333] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.299394 20917 raft_consensus.cc:2243] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.300210 20917 raft_consensus.cc:2272] T b6bec8c26e2042dc9297cfa76fee3a80 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.302618 20917 tablet_replica.cc:333] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.303141 20917 raft_consensus.cc:2243] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.303581 20917 raft_consensus.cc:2272] T d87548997099485f80226ece2937951f P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.305732 20917 tablet_replica.cc:333] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.306202 20917 raft_consensus.cc:2243] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.307179 20917 raft_consensus.cc:2272] T a31b3a4c53674af5b3b00793bafc9f59 P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.309247 20917 tablet_replica.cc:333] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.309693 20917 raft_consensus.cc:2243] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.310119 20917 raft_consensus.cc:2272] T ef3aaadaad0b4777ad44e4fe3399cebd P 502bbfe1b6b44eda9b4569507a55d46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.312251 20917 tablet_replica.cc:333] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a: stopping tablet replica
I20260709 12:30:41.312686 20917 raft_consensus.cc:2243] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.313140 20917 raft_consensus.cc:2272] T 4bb4db1d0c394e57bb66954b2104e730 P 502bbfe1b6b44eda9b4569507a55d46a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:41.348626 30359 consensus_peers.cc:597] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 -> Peer 502bbfe1b6b44eda9b4569507a55d46a (127.20.109.66:33059): Couldn't send request to peer 502bbfe1b6b44eda9b4569507a55d46a. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.66:33059: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:41.355257 20917 tablet_server.cc:196] TabletServer@127.20.109.66:0 shutdown complete.
I20260709 12:30:41.395416 20917 tablet_server.cc:179] TabletServer@127.20.109.67:0 shutting down...
W20260709 12:30:41.418987 30358 consensus_peers.cc:597] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 -> Peer d79a00eaf95a47d4b3116e6bb0956efc (127.20.109.65:45627): Couldn't send request to peer d79a00eaf95a47d4b3116e6bb0956efc. Status: Network error: Client connection negotiation failed: client connection to 127.20.109.65:45627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:41.425203 20917 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:41.426076 20917 tablet_replica.cc:333] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.426903 20917 raft_consensus.cc:2243] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.427855 20917 raft_consensus.cc:2272] T 10d4af1baf6d44de9eb54a824b23920e P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.430050 20917 tablet_replica.cc:333] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.430689 20917 raft_consensus.cc:2243] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.431170 20917 raft_consensus.cc:2272] T 2ec1f4dd8c304f46ba184c7f53010ba0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.433400 20917 tablet_replica.cc:333] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.433966 20917 raft_consensus.cc:2243] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.434485 20917 raft_consensus.cc:2272] T f760603a1a0e4ab2a7c8d8e4cadec9a6 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.436625 20917 tablet_replica.cc:333] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.437181 20917 raft_consensus.cc:2243] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.437716 20917 raft_consensus.cc:2272] T 67fcd78b4ab24fc7b7a28aa5cac92afd P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.439770 20917 tablet_replica.cc:333] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.440305 20917 raft_consensus.cc:2243] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.440784 20917 raft_consensus.cc:2272] T ae79d8ed87d640aa846b221492024674 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.442909 20917 tablet_replica.cc:333] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.443455 20917 raft_consensus.cc:2243] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.443924 20917 raft_consensus.cc:2272] T b69dae2e99fd4ebdb4cba00cc63b48d9 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.446199 20917 tablet_replica.cc:333] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.446816 20917 raft_consensus.cc:2243] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.447312 20917 raft_consensus.cc:2272] T 90a02241adea4299bc5c3b7a12452833 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.449389 20917 tablet_replica.cc:333] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.449942 20917 raft_consensus.cc:2243] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.450511 20917 raft_consensus.cc:2272] T bd04beb8b3814ca0bac81760e3fabcc0 P 811ff3960ee34275a8343e9a0ed11ae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.452579 20917 tablet_replica.cc:333] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.453110 20917 raft_consensus.cc:2243] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.453580 20917 raft_consensus.cc:2272] T 2462c1993c4249b5aa38ccf9d9c247fc P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.455719 20917 tablet_replica.cc:333] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.456254 20917 raft_consensus.cc:2243] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.457108 20917 raft_consensus.cc:2272] T 21363ae62c4c48b299c33fc5b2b9c810 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.459211 20917 tablet_replica.cc:333] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.459771 20917 raft_consensus.cc:2243] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.460249 20917 raft_consensus.cc:2272] T 200d711c63b54d5ba14bcd5d09642d60 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.462266 20917 tablet_replica.cc:333] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.462857 20917 raft_consensus.cc:2243] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.463284 20917 raft_consensus.cc:2272] T a6df216c755843fbb47dd91756df4ae5 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.465404 20917 tablet_replica.cc:333] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.465932 20917 raft_consensus.cc:2243] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.466427 20917 raft_consensus.cc:2272] T f008a41416394983b5a8d83b47081598 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.468565 20917 tablet_replica.cc:333] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.469090 20917 raft_consensus.cc:2243] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.469911 20917 raft_consensus.cc:2272] T 4bb4db1d0c394e57bb66954b2104e730 P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.472031 20917 tablet_replica.cc:333] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.472576 20917 raft_consensus.cc:2243] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.473089 20917 raft_consensus.cc:2272] T a31b3a4c53674af5b3b00793bafc9f59 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.475234 20917 tablet_replica.cc:333] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.475755 20917 raft_consensus.cc:2243] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.476270 20917 raft_consensus.cc:2272] T ef3aaadaad0b4777ad44e4fe3399cebd P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.478344 20917 tablet_replica.cc:333] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.478996 20917 raft_consensus.cc:2243] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.479475 20917 raft_consensus.cc:2272] T b6bec8c26e2042dc9297cfa76fee3a80 P 811ff3960ee34275a8343e9a0ed11ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.481556 20917 tablet_replica.cc:333] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5: stopping tablet replica
I20260709 12:30:41.482043 20917 raft_consensus.cc:2243] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.482918 20917 raft_consensus.cc:2272] T d87548997099485f80226ece2937951f P 811ff3960ee34275a8343e9a0ed11ae5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.540097 20917 tablet_server.cc:196] TabletServer@127.20.109.67:0 shutdown complete.
I20260709 12:30:41.577244 20917 master.cc:562] Master@127.20.109.126:35217 shutting down...
I20260709 12:30:41.599556 20917 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.600160 20917 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.600457 20917 tablet_replica.cc:333] T 00000000000000000000000000000000 P cf2eeaef052c4704ba4d564aebe9651f: stopping tablet replica
I20260709 12:30:41.620847 20917 master.cc:584] Master@127.20.109.126:35217 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (22663 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44319 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (347866 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:30:41.675086 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2267 messages since previous log ~33 seconds ago
I20260709 12:30:41.675307 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2266 messages since previous log ~33 seconds ago
I20260709 12:30:41.675474 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2261 messages since previous log ~33 seconds ago
I20260709 12:30:41.675661 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~52 seconds ago
I20260709 12:30:41.675838 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~52 seconds ago
I20260709 12:30:41.676021 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~175 seconds ago
I20260709 12:30:41.676185 20917 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~209 seconds ago
I20260709 12:30:41.676370 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 2 messages since previous log ~238 seconds ago
I20260709 12:30:41.676614 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 12:30:41.676870 20917 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
